[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:15:37 dist-test-slave-qg60 krb5kdc[7979](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:15:37 dist-test-slave-qg60 krb5kdc[7979](info): set up 2 sockets
Aug 07 04:15:37 dist-test-slave-qg60 krb5kdc[7979](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260807 04:15:38.485481 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.009s sys 0.015s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:15:38 dist-test-slave-qg60 krb5kdc[7979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076138, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:15:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:15:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
I20260807 04:15:38.702440 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:37807
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:33795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:37807
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:15:39.062461 7992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:15:39.062750 7992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:15:39.062927 7992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:15:39.070233 7992 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:15:39.070338 7992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:15:39.070441 7992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:15:39.070557 7992 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:15:39.070623 7992 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:15:39.080982 7992 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:33795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:37807
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:37807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:15:39.082460 7992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:15:39.083876 7992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:15:39.096164 7997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:39.096179 7998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:39.096184 8000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:15:39.096992 7992 server_base.cc:1034] running on GCE node
I20260807 04:15:39.097806 7992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:15:39.099251 7992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:15:39.100490 7992 hybrid_clock.cc:648] HybridClock initialized: now 1786076139100448 us; error 46 us; skew 500 ppm
I20260807 04:15:39.100929 7992 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:15:39 dist-test-slave-qg60 krb5kdc[7979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076139, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:15:39.105072 7992 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:15:39.106716 7992 webserver.cc:460] Webserver started at http://127.7.200.254:45633/ using document root <none> and password file <none>
I20260807 04:15:39.107375 7992 fs_manager.cc:359] Metadata directory not provided
I20260807 04:15:39.107487 7992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:15:39.107740 7992 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:15:39.112409 7992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "8956e48510d740e28552f61c632c4770"
format_stamp: "Formatted at 2026-08-07 04:15:39 on dist-test-slave-qg60"
server_key: "33c52b568bbbf73e4b04afe08f9f2632"
server_key_iv: "aca3caf8378fcccec46f6f144ebd1e84"
server_key_version: "encryptionkey@0"
I20260807 04:15:39.113219 7992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "8956e48510d740e28552f61c632c4770"
format_stamp: "Formatted at 2026-08-07 04:15:39 on dist-test-slave-qg60"
server_key: "33c52b568bbbf73e4b04afe08f9f2632"
server_key_iv: "aca3caf8378fcccec46f6f144ebd1e84"
server_key_version: "encryptionkey@0"
I20260807 04:15:39.118582 7992 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 04:15:39.122067 8007 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:39.123536 7992 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:15:39.123677 7992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "8956e48510d740e28552f61c632c4770"
format_stamp: "Formatted at 2026-08-07 04:15:39 on dist-test-slave-qg60"
server_key: "33c52b568bbbf73e4b04afe08f9f2632"
server_key_iv: "aca3caf8378fcccec46f6f144ebd1e84"
server_key_version: "encryptionkey@0"
I20260807 04:15:39.123840 7992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:15:39.148075 7992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:15:39.152858 7992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:15:39.153120 7992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:15:39.173417 7992 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:37807
I20260807 04:15:39.173444 8065 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:37807 every 8 connection(s)
I20260807 04:15:39.174870 7992 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:15:39.178747 8066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:39.185158 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 7992
I20260807 04:15:39.185537 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:15:39.188112 7971 external_mini_cluster.cc:1428] Setting key 19ef017ca191dd14612e85caa5b50c18
I20260807 04:15:39.191612 8066 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8956e48510d740e28552f61c632c4770: Bootstrap starting.
I20260807 04:15:39.195317 8066 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8956e48510d740e28552f61c632c4770: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:39.196395 8066 log.cc:824] T 00000000000000000000000000000000 P 8956e48510d740e28552f61c632c4770: Log is configured to *not* fsync() on all Append() calls
I20260807 04:15:39.199258 8066 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8956e48510d740e28552f61c632c4770: No bootstrap required, opened a new log
I20260807 04:15:39.207693 8066 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8956e48510d740e28552f61c632c4770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8956e48510d740e28552f61c632c4770" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 37807 } }
I20260807 04:15:39.208109 8066 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8956e48510d740e28552f61c632c4770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:39.208256 8066 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8956e48510d740e28552f61c632c4770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8956e48510d740e28552f61c632c4770, State: Initialized, Role: FOLLOWER
I20260807 04:15:39.208961 8066 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8956e48510d740e28552f61c632c4770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8956e48510d740e28552f61c632c4770" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 37807 } }
I20260807 04:15:39.209215 8066 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8956e48510d740e28552f61c632c4770 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:15:39.209369 8066 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8956e48510d740e28552f61c632c4770 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:15:39.209556 8066 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8956e48510d740e28552f61c632c4770 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:39.211784 8066 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8956e48510d740e28552f61c632c4770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8956e48510d740e28552f61c632c4770" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 37807 } }
I20260807 04:15:39.212338 8066 leader_election.cc:302] T 00000000000000000000000000000000 P 8956e48510d740e28552f61c632c4770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8956e48510d740e28552f61c632c4770; no voters:
I20260807 04:15:39.213217 8066 leader_election.cc:288] T 00000000000000000000000000000000 P 8956e48510d740e28552f61c632c4770 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:15:39.213320 8071 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8956e48510d740e28552f61c632c4770 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:15:39.214654 8071 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8956e48510d740e28552f61c632c4770 [term 1 LEADER]: Becoming Leader. State: Replica: 8956e48510d740e28552f61c632c4770, State: Running, Role: LEADER
I20260807 04:15:39.215267 8071 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8956e48510d740e28552f61c632c4770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8956e48510d740e28552f61c632c4770" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 37807 } }
I20260807 04:15:39.215680 8066 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8956e48510d740e28552f61c632c4770 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:15:39.218298 8073 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8956e48510d740e28552f61c632c4770 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8956e48510d740e28552f61c632c4770. Latest consensus state: current_term: 1 leader_uuid: "8956e48510d740e28552f61c632c4770" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8956e48510d740e28552f61c632c4770" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 37807 } } }
I20260807 04:15:39.218370 8072 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8956e48510d740e28552f61c632c4770 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8956e48510d740e28552f61c632c4770" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8956e48510d740e28552f61c632c4770" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 37807 } } }
I20260807 04:15:39.218744 8073 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8956e48510d740e28552f61c632c4770 [sys.catalog]: This master's current role is: LEADER
I20260807 04:15:39.218798 8072 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8956e48510d740e28552f61c632c4770 [sys.catalog]: This master's current role is: LEADER
I20260807 04:15:39.219839 8078 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 07 04:15:39 dist-test-slave-qg60 krb5kdc[7979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076138, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:15:39.239588 8068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:39.193055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60628 (local address 127.7.200.254:37807)
0807 04:15:39.194066 (+ 1011us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:39.194082 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:39.195470 (+ 1388us) server_negotiation.cc:407] Connection header received
0807 04:15:39.207192 (+ 11722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:39.207214 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:39.207606 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:39.208051 (+ 445us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:39.211357 (+ 3306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:39.212896 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:39.215313 (+ 2417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:39.216200 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:39.216415 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:39.225565 (+ 9150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:39.225580 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:39.225606 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:39.225684 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:39.231374 (+ 5690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:39.232784 (+ 1410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:39.232797 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:39.232809 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:39.233077 (+ 268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:39.233798 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:39.233806 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:39.233812 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:39.234907 (+ 1095us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:39.235394 (+ 487us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:39.237086 (+ 1692us) server_negotiation.cc:299] Negotiation successful
0807 04:15:39.237727 (+ 641us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":766,"thread_start_us":492,"threads_started":1}
I20260807 04:15:39.251041 8078 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:15:39.261768 8078 catalog_manager.cc:1347] Generated new cluster ID: 88410d41a8634feca163302e9bd22ce8
I20260807 04:15:39.261909 8078 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:15:39.272951 8078 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:15:39.274852 8078 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:15:39.287724 8078 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8956e48510d740e28552f61c632c4770: Generated new TSK 0
I20260807 04:15:39.288638 8078 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.200.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
I20260807 04:15:39.350745 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:0
--local_ip_for_outbound_sockets=127.7.200.193
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:37807
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:33795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:15:39.720427 8096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:15:39.720709 8096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:15:39.720883 8096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:15:39.728397 8096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:15:39.728550 8096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:15:39.728760 8096 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:15:39.738934 8096 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:33795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:37807
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:15:39.740365 8096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:15:39.741868 8096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:15:39.755676 8101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:39.755712 8105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:39.755754 8102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:15:39.756783 8096 server_base.cc:1034] running on GCE node
I20260807 04:15:39.757443 8096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:15:39.758379 8096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:15:39.759624 8096 hybrid_clock.cc:648] HybridClock initialized: now 1786076139759571 us; error 33 us; skew 500 ppm
I20260807 04:15:39.759950 8096 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:15:39 dist-test-slave-qg60 krb5kdc[7979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076139, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:15:39.763337 8096 init.cc:377] Logged in from keytab as kudu/127.7.200.193@KRBTEST.COM (short username kudu)
I20260807 04:15:39.765516 8096 webserver.cc:460] Webserver started at http://127.7.200.193:45579/ using document root <none> and password file <none>
I20260807 04:15:39.766204 8096 fs_manager.cc:359] Metadata directory not provided
I20260807 04:15:39.766338 8096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:15:39.766677 8096 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:15:39.769771 8096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-0/data/instance:
uuid: "a71cd28d4e2e431fa10111731860693d"
format_stamp: "Formatted at 2026-08-07 04:15:39 on dist-test-slave-qg60"
server_key: "a85e72fafe3207b9b187560f1a086896"
server_key_iv: "6557b7985ea3894cc3579271871a8c46"
server_key_version: "encryptionkey@0"
I20260807 04:15:39.770541 8096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance:
uuid: "a71cd28d4e2e431fa10111731860693d"
format_stamp: "Formatted at 2026-08-07 04:15:39 on dist-test-slave-qg60"
server_key: "a85e72fafe3207b9b187560f1a086896"
server_key_iv: "6557b7985ea3894cc3579271871a8c46"
server_key_version: "encryptionkey@0"
I20260807 04:15:39.776012 8096 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 04:15:39.779608 8112 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:39.781208 8096 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:15:39.781409 8096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "a71cd28d4e2e431fa10111731860693d"
format_stamp: "Formatted at 2026-08-07 04:15:39 on dist-test-slave-qg60"
server_key: "a85e72fafe3207b9b187560f1a086896"
server_key_iv: "6557b7985ea3894cc3579271871a8c46"
server_key_version: "encryptionkey@0"
I20260807 04:15:39.781631 8096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:15:39.802388 8096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:15:39.807353 8096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:15:39.807698 8096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:15:39.808874 8096 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:15:39.810441 8096 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:15:39.810568 8096 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:39.810734 8096 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:15:39.810802 8096 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:39.850001 8096 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:37843
I20260807 04:15:39.850057 8235 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:37843 every 8 connection(s)
I20260807 04:15:39.851446 8096 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:15:39.854800 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 8096
I20260807 04:15:39.855051 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance
I20260807 04:15:39.855957 7971 external_mini_cluster.cc:1428] Setting key 827458d0d4182d939bad7c25302242bc
Aug 07 04:15:39 dist-test-slave-qg60 krb5kdc[7979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076139, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:15:39.874536 8238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:39.854378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:43435 (local address 127.7.200.254:37807)
0807 04:15:39.854925 (+ 547us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:39.854933 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:39.856325 (+ 1392us) server_negotiation.cc:407] Connection header received
0807 04:15:39.858728 (+ 2403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:39.858733 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:39.858830 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:39.858973 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:39.860696 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:39.861576 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:39.863396 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:39.863875 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:39.864029 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:39.868166 (+ 4137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:39.868172 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:39.868176 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:39.868211 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:39.871089 (+ 2878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:39.871929 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:39.871935 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:39.871938 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:39.872094 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:39.872556 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:39.872563 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:39.872569 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:39.872924 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:39.873091 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:39.873849 (+ 758us) server_negotiation.cc:299] Negotiation successful
0807 04:15:39.874106 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":294,"threads_started":1}
WARNING: no policy specified for kudu/127.7.200.194@KRBTEST.COM; defaulting to no policy
I20260807 04:15:39.875705 8239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:39.855158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:37807 (local address 127.7.200.193:43435)
0807 04:15:39.856148 (+ 990us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:39.856192 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:39.858425 (+ 2233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:39.859260 (+ 835us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:39.859269 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:39.859857 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:15:39.860507 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:39.860527 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:39.861782 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:39.861786 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:39.863220 (+ 1434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:39.863234 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:39.864142 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:39.864152 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:39.864425 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:39.865191 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:15:39.865220 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:15:39.867840 (+ 2620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:15:39.871257 (+ 3417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:39.871268 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:39.871287 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:39.871788 (+ 501us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:39.872213 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:39.872219 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:39.872223 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:39.872435 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:39.873061 (+ 626us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:15:39.873070 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:15:39.873448 (+ 378us) client_negotiation.cc:769] Sending connection context
0807 04:15:39.873744 (+ 296us) client_negotiation.cc:240] Negotiation successful
0807 04:15:39.874336 (+ 592us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":369,"threads_started":1}
I20260807 04:15:39.877436 8236 heartbeater.cc:347] Connected to a master server at 127.7.200.254:37807
I20260807 04:15:39.877785 8236 heartbeater.cc:464] Registering TS with master...
I20260807 04:15:39.878613 8236 heartbeater.cc:511] Master 127.7.200.254:37807 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.194@KRBTEST.COM" created.
I20260807 04:15:39.880879 8025 ts_manager.cc:194] Registered new tserver with Master: a71cd28d4e2e431fa10111731860693d (127.7.200.193:37843)
I20260807 04:15:39.882349 8025 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.193@KRBTEST.COM'} at 127.7.200.193:43435
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
I20260807 04:15:39.904963 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:0
--local_ip_for_outbound_sockets=127.7.200.194
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:37807
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:33795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:15:40.249022 8242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:15:40.249326 8242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:15:40.249500 8242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:15:40.256903 8242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:15:40.257032 8242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:15:40.257229 8242 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:15:40.267220 8242 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:33795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:37807
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:15:40.268630 8242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:15:40.270048 8242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:15:40.283681 8248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:40.283861 8252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:40.283833 8249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:15:40.285084 8242 server_base.cc:1034] running on GCE node
I20260807 04:15:40.285797 8242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:15:40.286907 8242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:15:40.288144 8242 hybrid_clock.cc:648] HybridClock initialized: now 1786076140288091 us; error 39 us; skew 500 ppm
I20260807 04:15:40.288568 8242 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:15:40 dist-test-slave-qg60 krb5kdc[7979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076140, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:15:40.291853 8242 init.cc:377] Logged in from keytab as kudu/127.7.200.194@KRBTEST.COM (short username kudu)
I20260807 04:15:40.293385 8242 webserver.cc:460] Webserver started at http://127.7.200.194:35415/ using document root <none> and password file <none>
I20260807 04:15:40.294024 8242 fs_manager.cc:359] Metadata directory not provided
I20260807 04:15:40.294127 8242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:15:40.294394 8242 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:15:40.297329 8242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-1/data/instance:
uuid: "626525e355c14ae5a3ade2165af10304"
format_stamp: "Formatted at 2026-08-07 04:15:40 on dist-test-slave-qg60"
server_key: "c215fc0dd4d4ec6fd3160f3996c60bd6"
server_key_iv: "8ced329ed902feb8d3941444d9eff5db"
server_key_version: "encryptionkey@0"
I20260807 04:15:40.298079 8242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance:
uuid: "626525e355c14ae5a3ade2165af10304"
format_stamp: "Formatted at 2026-08-07 04:15:40 on dist-test-slave-qg60"
server_key: "c215fc0dd4d4ec6fd3160f3996c60bd6"
server_key_iv: "8ced329ed902feb8d3941444d9eff5db"
server_key_version: "encryptionkey@0"
I20260807 04:15:40.303452 8242 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 04:15:40.306953 8259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:40.308300 8242 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 04:15:40.308439 8242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "626525e355c14ae5a3ade2165af10304"
format_stamp: "Formatted at 2026-08-07 04:15:40 on dist-test-slave-qg60"
server_key: "c215fc0dd4d4ec6fd3160f3996c60bd6"
server_key_iv: "8ced329ed902feb8d3941444d9eff5db"
server_key_version: "encryptionkey@0"
I20260807 04:15:40.308614 8242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:15:40.349795 8242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:15:40.354840 8242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:15:40.355134 8242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:15:40.356231 8242 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:15:40.357682 8242 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:15:40.357772 8242 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:40.357873 8242 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:15:40.357941 8242 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:40.398061 8242 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:39645
I20260807 04:15:40.398159 8376 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:39645 every 8 connection(s)
I20260807 04:15:40.399492 8242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:15:40.399964 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 8242
I20260807 04:15:40.400177 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance
I20260807 04:15:40.400832 7971 external_mini_cluster.cc:1428] Setting key e83fd627fefec645f93c2513bcec21fc
Aug 07 04:15:40 dist-test-slave-qg60 krb5kdc[7979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076140, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:15:40.421667 8379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:40.402957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:57697 (local address 127.7.200.254:37807)
0807 04:15:40.403507 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:40.403516 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:40.404233 (+ 717us) server_negotiation.cc:407] Connection header received
0807 04:15:40.406365 (+ 2132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:40.406370 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:40.406470 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:40.406593 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:40.408554 (+ 1961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:40.409473 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:40.411019 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:40.411448 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:40.411583 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:40.415424 (+ 3841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:40.415431 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:40.415436 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:40.415477 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:40.418415 (+ 2938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:40.419171 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:40.419178 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:40.419181 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:40.419329 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:40.419772 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:40.419777 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:40.419780 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:40.420063 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:40.420223 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:40.421029 (+ 806us) server_negotiation.cc:299] Negotiation successful
0807 04:15:40.421268 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":264,"threads_started":1}
WARNING: no policy specified for kudu/127.7.200.195@KRBTEST.COM; defaulting to no policy
I20260807 04:15:40.422740 8380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:40.403225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:37807 (local address 127.7.200.194:57697)
0807 04:15:40.404080 (+ 855us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:40.404121 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:40.406063 (+ 1942us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:40.406868 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:40.406877 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:40.407770 (+ 893us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:15:40.408361 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:40.408379 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:40.409636 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:40.409641 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:40.410869 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:40.410881 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:40.411702 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:40.411710 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:40.412008 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:40.412798 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:15:40.412830 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:15:40.415140 (+ 2310us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:15:40.418570 (+ 3430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:40.418580 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:40.418597 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:40.419051 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:40.419449 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:40.419454 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:40.419457 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:40.419659 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:40.420202 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:15:40.420210 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:15:40.420594 (+ 384us) client_negotiation.cc:769] Sending connection context
0807 04:15:40.420918 (+ 324us) client_negotiation.cc:240] Negotiation successful
0807 04:15:40.421489 (+ 571us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":363,"threads_started":1}
I20260807 04:15:40.424420 8377 heartbeater.cc:347] Connected to a master server at 127.7.200.254:37807
I20260807 04:15:40.424808 8377 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.195@KRBTEST.COM" created.
I20260807 04:15:40.425693 8377 heartbeater.cc:511] Master 127.7.200.254:37807 requested a full tablet report, sending...
I20260807 04:15:40.427294 8025 ts_manager.cc:194] Registered new tserver with Master: 626525e355c14ae5a3ade2165af10304 (127.7.200.194:39645)
I20260807 04:15:40.428226 8025 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.194@KRBTEST.COM'} at 127.7.200.194:57697
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
I20260807 04:15:40.450107 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:0
--local_ip_for_outbound_sockets=127.7.200.195
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:37807
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:33795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:15:40.816211 8383 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:15:40.816504 8383 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:15:40.816607 8383 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:15:40.824046 8383 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:15:40.824163 8383 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:15:40.824278 8383 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:15:40.834218 8383 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:33795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:37807
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:15:40.835507 8383 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:15:40.836894 8383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:15:40.851224 8389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:40.851195 8390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:40.851783 8392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:15:40.852521 8383 server_base.cc:1034] running on GCE node
I20260807 04:15:40.853386 8383 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:15:40.854730 8383 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:15:40.855996 8383 hybrid_clock.cc:648] HybridClock initialized: now 1786076140855923 us; error 62 us; skew 500 ppm
I20260807 04:15:40.856385 8383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:15:40 dist-test-slave-qg60 krb5kdc[7979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076140, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:15:40.859915 8383 init.cc:377] Logged in from keytab as kudu/127.7.200.195@KRBTEST.COM (short username kudu)
I20260807 04:15:40.861531 8383 webserver.cc:460] Webserver started at http://127.7.200.195:36481/ using document root <none> and password file <none>
I20260807 04:15:40.862246 8383 fs_manager.cc:359] Metadata directory not provided
I20260807 04:15:40.862394 8383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:15:40.862730 8383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:15:40.865891 8383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-2/data/instance:
uuid: "968ba07fe9db430da943c6be11be72f6"
format_stamp: "Formatted at 2026-08-07 04:15:40 on dist-test-slave-qg60"
server_key: "04668518b14782efea89c6d18bede706"
server_key_iv: "5e3a101863ee2bbd85ff22a7e8f54540"
server_key_version: "encryptionkey@0"
I20260807 04:15:40.866729 8383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance:
uuid: "968ba07fe9db430da943c6be11be72f6"
format_stamp: "Formatted at 2026-08-07 04:15:40 on dist-test-slave-qg60"
server_key: "04668518b14782efea89c6d18bede706"
server_key_iv: "5e3a101863ee2bbd85ff22a7e8f54540"
server_key_version: "encryptionkey@0"
I20260807 04:15:40.872517 8383 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260807 04:15:40.876590 8399 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:40.878110 8383 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:15:40.878348 8383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "968ba07fe9db430da943c6be11be72f6"
format_stamp: "Formatted at 2026-08-07 04:15:40 on dist-test-slave-qg60"
server_key: "04668518b14782efea89c6d18bede706"
server_key_iv: "5e3a101863ee2bbd85ff22a7e8f54540"
server_key_version: "encryptionkey@0"
I20260807 04:15:40.878576 8383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:15:40.885535 8236 heartbeater.cc:503] Master 127.7.200.254:37807 was elected leader, sending a full tablet report...
I20260807 04:15:40.905112 8383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:15:40.910036 8383 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:15:40.910308 8383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:15:40.911449 8383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:15:40.913106 8383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:15:40.913194 8383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:40.913307 8383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:15:40.913376 8383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:40.950519 8383 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:41021
I20260807 04:15:40.950609 8518 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:41021 every 8 connection(s)
I20260807 04:15:40.951889 8383 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:15:40.952317 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 8383
I20260807 04:15:40.952582 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance
I20260807 04:15:40.953372 7971 external_mini_cluster.cc:1428] Setting key 2e4caf329b6da8c5c0a3ecfba1c7cd2c
Aug 07 04:15:40 dist-test-slave-qg60 krb5kdc[7979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076140, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:15:40.973399 8521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:40.955015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:50057 (local address 127.7.200.254:37807)
0807 04:15:40.955509 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:40.955515 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:40.956897 (+ 1382us) server_negotiation.cc:407] Connection header received
0807 04:15:40.958801 (+ 1904us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:40.958807 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:40.958878 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:40.958986 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:40.960569 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:40.961478 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:40.963127 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:40.963554 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:40.963668 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:40.967343 (+ 3675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:40.967347 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:40.967351 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:40.967394 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:40.970477 (+ 3083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:40.971203 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:40.971207 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:40.971209 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:40.971327 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:40.971728 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:40.971732 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:40.971738 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:40.972077 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:40.972211 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:40.972937 (+ 726us) server_negotiation.cc:299] Negotiation successful
0807 04:15:40.973106 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":259,"threads_started":1}
I20260807 04:15:40.974411 8522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:40.955722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:37807 (local address 127.7.200.195:50057)
0807 04:15:40.956685 (+ 963us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:40.956762 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:40.958531 (+ 1769us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:40.959196 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:40.959205 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:40.959815 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:15:40.960392 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:40.960409 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:40.961639 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:40.961643 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:40.962978 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:40.962997 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:40.963767 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:40.963772 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:40.964043 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:40.964775 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:15:40.964813 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:15:40.967133 (+ 2320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:15:40.970599 (+ 3466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:40.970606 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:40.970619 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:40.971105 (+ 486us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:40.971416 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:40.971419 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:40.971421 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:40.971613 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:40.972202 (+ 589us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:15:40.972208 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:15:40.972549 (+ 341us) client_negotiation.cc:769] Sending connection context
0807 04:15:40.972852 (+ 303us) client_negotiation.cc:240] Negotiation successful
0807 04:15:40.973262 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":690,"thread_start_us":425,"threads_started":1}
I20260807 04:15:40.975777 8519 heartbeater.cc:347] Connected to a master server at 127.7.200.254:37807
I20260807 04:15:40.976112 8519 heartbeater.cc:464] Registering TS with master...
I20260807 04:15:40.976944 8519 heartbeater.cc:511] Master 127.7.200.254:37807 requested a full tablet report, sending...
I20260807 04:15:40.978495 8025 ts_manager.cc:194] Registered new tserver with Master: 968ba07fe9db430da943c6be11be72f6 (127.7.200.195:41021)
I20260807 04:15:40.979346 8025 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.195@KRBTEST.COM'} at 127.7.200.195:50057
I20260807 04:15:40.982728 7971 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 04:15:41 dist-test-slave-qg60 krb5kdc[7979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076141, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 04:15:41 dist-test-slave-qg60 krb5kdc[7979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076141, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.200.193@KRBTEST.COM
I20260807 04:15:41.038844 8528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:41.021822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52358 (local address 127.7.200.193:37843)
0807 04:15:41.022779 (+ 957us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:41.022787 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:41.022813 (+ 26us) server_negotiation.cc:407] Connection header received
0807 04:15:41.022875 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:41.022882 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:41.023101 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:41.023303 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:41.025025 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:41.026052 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:41.027418 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:41.028071 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:41.028228 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:41.032639 (+ 4411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:41.032655 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:41.032671 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:41.032709 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:41.035750 (+ 3041us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:41.036489 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:41.036498 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:41.036500 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:41.036641 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:41.037097 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:41.037102 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:41.037105 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:41.037480 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:41.037819 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:41.038167 (+ 348us) server_negotiation.cc:299] Negotiation successful
0807 04:15:41.038468 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":746,"thread_start_us":548,"threads_started":1}
W20260807 04:15:41.040443 8141 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52358
Aug 07 04:15:41 dist-test-slave-qg60 krb5kdc[7979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076141, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 04:15:41 dist-test-slave-qg60 krb5kdc[7979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076141, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.193@KRBTEST.COM
I20260807 04:15:41.093923 8528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:41.079009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52370 (local address 127.7.200.193:37843)
0807 04:15:41.079252 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:41.079262 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:41.079625 (+ 363us) server_negotiation.cc:407] Connection header received
0807 04:15:41.079833 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:41.079839 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:41.079916 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:41.080022 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:41.081529 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:41.082333 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:41.083632 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:41.084071 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:41.084211 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:41.088510 (+ 4299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:41.088515 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:41.088518 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:41.088557 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:41.091258 (+ 2701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:41.091915 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:41.091922 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:41.091925 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:41.092058 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:41.092435 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:41.092440 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:41.092443 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:41.092775 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:41.093030 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:41.093342 (+ 312us) server_negotiation.cc:299] Negotiation successful
0807 04:15:41.093576 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 04:15:41.095548 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 8096
I20260807 04:15:41.108875 8528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:41.096659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52372 (local address 127.7.200.193:37843)
0807 04:15:41.096899 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:41.096909 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:41.097032 (+ 123us) server_negotiation.cc:407] Connection header received
0807 04:15:41.097196 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:41.097201 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:41.097260 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:41.097347 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:41.098733 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:41.099487 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:41.100951 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:41.101406 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:41.101521 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:41.103723 (+ 2202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:41.103727 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:41.103730 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:41.103759 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:41.106559 (+ 2800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:41.107189 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:41.107193 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:41.107195 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:41.107323 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:41.107624 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:41.107627 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:41.107629 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:41.107872 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:41.108070 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:41.108289 (+ 219us) server_negotiation.cc:299] Negotiation successful
0807 04:15:41.108471 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260807 04:15:41.109751 8231 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:15:41.197212 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 8096
I20260807 04:15:41.216542 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 8242
Aug 07 04:15:41 dist-test-slave-qg60 krb5kdc[7979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076141, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.194@KRBTEST.COM
I20260807 04:15:41.233291 8535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:41.217580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42630 (local address 127.7.200.194:39645)
0807 04:15:41.218351 (+ 771us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:41.218359 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:41.218387 (+ 28us) server_negotiation.cc:407] Connection header received
0807 04:15:41.218456 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:41.218463 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:41.218681 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:41.218819 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:41.220060 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:41.221275 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:41.222543 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:41.223097 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:41.223205 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:41.227240 (+ 4035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:41.227252 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:41.227265 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:41.227308 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:41.230536 (+ 3228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:41.231249 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:41.231257 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:41.231259 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:41.231394 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:41.231803 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:41.231806 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:41.231808 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:41.232170 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:41.232420 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:41.232691 (+ 271us) server_negotiation.cc:299] Negotiation successful
0807 04:15:41.232956 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":613,"thread_start_us":457,"threads_started":1}
I20260807 04:15:41.234665 8372 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:15:41.318689 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 8242
I20260807 04:15:41.337625 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 8383
Aug 07 04:15:41 dist-test-slave-qg60 krb5kdc[7979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076141, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.195@KRBTEST.COM
I20260807 04:15:41.354686 8538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:41.338656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45478 (local address 127.7.200.195:41021)
0807 04:15:41.339280 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:41.339288 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:41.339318 (+ 30us) server_negotiation.cc:407] Connection header received
0807 04:15:41.339379 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:41.339385 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:41.339601 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:41.339780 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:41.341200 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:41.342244 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:41.343551 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:41.344125 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:41.344266 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:41.348575 (+ 4309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:41.348586 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:41.348600 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:41.348639 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:41.351653 (+ 3014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:41.352335 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:41.352344 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:41.352347 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:41.352502 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:41.352980 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:41.352985 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:41.352989 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:41.353367 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:41.353703 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:41.354023 (+ 320us) server_negotiation.cc:299] Negotiation successful
0807 04:15:41.354315 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":477,"thread_start_us":294,"threads_started":1}
I20260807 04:15:41.356010 8514 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:15:41.442011 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 8383
I20260807 04:15:41.461387 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 7992
I20260807 04:15:41.462736 8061 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:15:41.574060 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 7992
2026-08-07T04:15:41Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4271 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:15:41 dist-test-slave-qg60 krb5kdc[8543](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:15:41 dist-test-slave-qg60 krb5kdc[8543](info): set up 2 sockets
Aug 07 04:15:41 dist-test-slave-qg60 krb5kdc[8543](info): commencing operation
krb5kdc: starting...
W20260807 04:15:42.808111 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.185s user 0.007s sys 0.015s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:15:42 dist-test-slave-qg60 krb5kdc[8543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076142, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:15:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:15:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
I20260807 04:15:43.027936 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:39611
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:34931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:39611
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:15:43.359256 8559 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:15:43.359577 8559 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:15:43.359742 8559 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:15:43.367111 8559 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:15:43.367233 8559 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:15:43.367352 8559 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:15:43.367446 8559 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:15:43.367527 8559 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:15:43.377746 8559 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:34931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:39611
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:39611
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:15:43.379174 8559 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:15:43.380535 8559 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:15:43.392963 8567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:43.392933 8566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:43.392895 8570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:15:43.393805 8559 server_base.cc:1034] running on GCE node
I20260807 04:15:43.394532 8559 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:15:43.395957 8559 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:15:43.397166 8559 hybrid_clock.cc:648] HybridClock initialized: now 1786076143397120 us; error 34 us; skew 500 ppm
I20260807 04:15:43.397537 8559 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:15:43 dist-test-slave-qg60 krb5kdc[8543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076143, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:15:43.406113 8559 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:15:43.407739 8559 webserver.cc:460] Webserver started at http://127.7.200.254:44115/ using document root <none> and password file <none>
I20260807 04:15:43.408483 8559 fs_manager.cc:359] Metadata directory not provided
I20260807 04:15:43.408633 8559 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:15:43.409011 8559 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:15:43.412091 8559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "409cad6f3930413cabbd1afec1ee5ca8"
format_stamp: "Formatted at 2026-08-07 04:15:43 on dist-test-slave-qg60"
server_key: "9cbd1e438cf8b9e1450abc4cfe43f3c0"
server_key_iv: "fa45fdd632f04215cc34872fbf8dc56b"
server_key_version: "encryptionkey@0"
I20260807 04:15:43.412987 8559 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "409cad6f3930413cabbd1afec1ee5ca8"
format_stamp: "Formatted at 2026-08-07 04:15:43 on dist-test-slave-qg60"
server_key: "9cbd1e438cf8b9e1450abc4cfe43f3c0"
server_key_iv: "fa45fdd632f04215cc34872fbf8dc56b"
server_key_version: "encryptionkey@0"
I20260807 04:15:43.418457 8559 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 04:15:43.422056 8577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:43.423453 8559 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:15:43.423647 8559 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "409cad6f3930413cabbd1afec1ee5ca8"
format_stamp: "Formatted at 2026-08-07 04:15:43 on dist-test-slave-qg60"
server_key: "9cbd1e438cf8b9e1450abc4cfe43f3c0"
server_key_iv: "fa45fdd632f04215cc34872fbf8dc56b"
server_key_version: "encryptionkey@0"
I20260807 04:15:43.423866 8559 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:15:43.447100 8559 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:15:43.451714 8559 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:15:43.452018 8559 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:15:43.470913 8559 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:39611
I20260807 04:15:43.470927 8632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:39611 every 8 connection(s)
I20260807 04:15:43.472334 8559 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:15:43.476060 8633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:43.479204 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 8559
I20260807 04:15:43.479465 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:15:43.480319 7971 external_mini_cluster.cc:1428] Setting key b6973469a6d293cb6f209666d469d9ea
I20260807 04:15:43.489521 8633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 409cad6f3930413cabbd1afec1ee5ca8: Bootstrap starting.
I20260807 04:15:43.493520 8633 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 409cad6f3930413cabbd1afec1ee5ca8: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:43.494946 8633 log.cc:824] T 00000000000000000000000000000000 P 409cad6f3930413cabbd1afec1ee5ca8: Log is configured to *not* fsync() on all Append() calls
Aug 07 04:15:43 dist-test-slave-qg60 krb5kdc[8543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076142, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:15:43.498319 8633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 409cad6f3930413cabbd1afec1ee5ca8: No bootstrap required, opened a new log
I20260807 04:15:43.505060 8636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:43.482655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33418 (local address 127.7.200.254:39611)
0807 04:15:43.483483 (+ 828us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:43.483495 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:43.483535 (+ 40us) server_negotiation.cc:407] Connection header received
0807 04:15:43.485286 (+ 1751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:43.485309 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:43.485718 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:43.486051 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:43.487930 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:43.489350 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:43.491081 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:43.491771 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:43.491903 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:43.497208 (+ 5305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:43.497217 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:43.497236 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:43.497279 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:43.500546 (+ 3267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:43.501340 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:43.501346 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:43.501352 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:43.501525 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:43.501931 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:43.501936 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:43.501939 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:43.502502 (+ 563us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:43.502863 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:43.503462 (+ 599us) server_negotiation.cc:299] Negotiation successful
0807 04:15:43.503903 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":623,"thread_start_us":406,"threads_started":1}
I20260807 04:15:43.506520 8633 raft_consensus.cc:348] T 00000000000000000000000000000000 P 409cad6f3930413cabbd1afec1ee5ca8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "409cad6f3930413cabbd1afec1ee5ca8" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 39611 } }
I20260807 04:15:43.506909 8633 raft_consensus.cc:374] T 00000000000000000000000000000000 P 409cad6f3930413cabbd1afec1ee5ca8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:43.507022 8633 raft_consensus.cc:729] T 00000000000000000000000000000000 P 409cad6f3930413cabbd1afec1ee5ca8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 409cad6f3930413cabbd1afec1ee5ca8, State: Initialized, Role: FOLLOWER
I20260807 04:15:43.507637 8633 consensus_queue.cc:260] T 00000000000000000000000000000000 P 409cad6f3930413cabbd1afec1ee5ca8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "409cad6f3930413cabbd1afec1ee5ca8" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 39611 } }
I20260807 04:15:43.507889 8633 raft_consensus.cc:388] T 00000000000000000000000000000000 P 409cad6f3930413cabbd1afec1ee5ca8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:15:43.508057 8633 raft_consensus.cc:482] T 00000000000000000000000000000000 P 409cad6f3930413cabbd1afec1ee5ca8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:15:43.508227 8633 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 409cad6f3930413cabbd1afec1ee5ca8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:43.510495 8633 raft_consensus.cc:504] T 00000000000000000000000000000000 P 409cad6f3930413cabbd1afec1ee5ca8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "409cad6f3930413cabbd1afec1ee5ca8" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 39611 } }
I20260807 04:15:43.511005 8633 leader_election.cc:302] T 00000000000000000000000000000000 P 409cad6f3930413cabbd1afec1ee5ca8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 409cad6f3930413cabbd1afec1ee5ca8; no voters:
I20260807 04:15:43.511657 8633 leader_election.cc:288] T 00000000000000000000000000000000 P 409cad6f3930413cabbd1afec1ee5ca8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:15:43.511812 8638 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 409cad6f3930413cabbd1afec1ee5ca8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:15:43.513306 8638 raft_consensus.cc:686] T 00000000000000000000000000000000 P 409cad6f3930413cabbd1afec1ee5ca8 [term 1 LEADER]: Becoming Leader. State: Replica: 409cad6f3930413cabbd1afec1ee5ca8, State: Running, Role: LEADER
I20260807 04:15:43.514040 8638 consensus_queue.cc:237] T 00000000000000000000000000000000 P 409cad6f3930413cabbd1afec1ee5ca8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "409cad6f3930413cabbd1afec1ee5ca8" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 39611 } }
I20260807 04:15:43.514253 8633 sys_catalog.cc:564] T 00000000000000000000000000000000 P 409cad6f3930413cabbd1afec1ee5ca8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:15:43.517196 8640 sys_catalog.cc:455] T 00000000000000000000000000000000 P 409cad6f3930413cabbd1afec1ee5ca8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 409cad6f3930413cabbd1afec1ee5ca8. Latest consensus state: current_term: 1 leader_uuid: "409cad6f3930413cabbd1afec1ee5ca8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "409cad6f3930413cabbd1afec1ee5ca8" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 39611 } } }
I20260807 04:15:43.517643 8640 sys_catalog.cc:458] T 00000000000000000000000000000000 P 409cad6f3930413cabbd1afec1ee5ca8 [sys.catalog]: This master's current role is: LEADER
I20260807 04:15:43.517179 8639 sys_catalog.cc:455] T 00000000000000000000000000000000 P 409cad6f3930413cabbd1afec1ee5ca8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "409cad6f3930413cabbd1afec1ee5ca8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "409cad6f3930413cabbd1afec1ee5ca8" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 39611 } } }
I20260807 04:15:43.518245 8639 sys_catalog.cc:458] T 00000000000000000000000000000000 P 409cad6f3930413cabbd1afec1ee5ca8 [sys.catalog]: This master's current role is: LEADER
I20260807 04:15:43.518800 8647 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:15:43.525794 8647 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:15:43.535910 8647 catalog_manager.cc:1347] Generated new cluster ID: a305e0f9d4a74202ac41bbb14f4729e4
I20260807 04:15:43.536056 8647 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:15:43.552066 8647 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:15:43.554049 8647 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:15:43.567672 8647 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 409cad6f3930413cabbd1afec1ee5ca8: Generated new TSK 0
I20260807 04:15:43.568840 8647 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.200.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
I20260807 04:15:43.625135 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:0
--local_ip_for_outbound_sockets=127.7.200.193
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:39611
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:34931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:15:43.970074 8661 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:15:43.970371 8661 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:15:43.970549 8661 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:15:43.978037 8661 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:15:43.978155 8661 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:15:43.978339 8661 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:15:43.988560 8661 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:34931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:39611
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:15:43.990010 8661 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:15:43.991376 8661 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:15:44.005304 8669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:44.005324 8666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:44.005446 8667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:15:44.006705 8661 server_base.cc:1034] running on GCE node
I20260807 04:15:44.007447 8661 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:15:44.008661 8661 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:15:44.009953 8661 hybrid_clock.cc:648] HybridClock initialized: now 1786076144009864 us; error 79 us; skew 500 ppm
I20260807 04:15:44.010370 8661 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:15:44 dist-test-slave-qg60 krb5kdc[8543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076144, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:15:44.014215 8661 init.cc:377] Logged in from keytab as kudu/127.7.200.193@KRBTEST.COM (short username kudu)
I20260807 04:15:44.016141 8661 webserver.cc:460] Webserver started at http://127.7.200.193:44621/ using document root <none> and password file <none>
I20260807 04:15:44.017028 8661 fs_manager.cc:359] Metadata directory not provided
I20260807 04:15:44.017146 8661 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:15:44.017431 8661 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:15:44.020915 8661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-0/data/instance:
uuid: "064562a179b441709a8c34b5c58d2f98"
format_stamp: "Formatted at 2026-08-07 04:15:44 on dist-test-slave-qg60"
server_key: "8f70adef49712a7c10114b0e9ac53238"
server_key_iv: "bba79940b8a30a7df1f75437a8d09219"
server_key_version: "encryptionkey@0"
I20260807 04:15:44.021799 8661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance:
uuid: "064562a179b441709a8c34b5c58d2f98"
format_stamp: "Formatted at 2026-08-07 04:15:44 on dist-test-slave-qg60"
server_key: "8f70adef49712a7c10114b0e9ac53238"
server_key_iv: "bba79940b8a30a7df1f75437a8d09219"
server_key_version: "encryptionkey@0"
I20260807 04:15:44.027545 8661 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 04:15:44.031330 8676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:44.032884 8661 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:15:44.033066 8661 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "064562a179b441709a8c34b5c58d2f98"
format_stamp: "Formatted at 2026-08-07 04:15:44 on dist-test-slave-qg60"
server_key: "8f70adef49712a7c10114b0e9ac53238"
server_key_iv: "bba79940b8a30a7df1f75437a8d09219"
server_key_version: "encryptionkey@0"
I20260807 04:15:44.033286 8661 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:15:44.046249 8661 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:15:44.050552 8661 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:15:44.050869 8661 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:15:44.051915 8661 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:15:44.053386 8661 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:15:44.053489 8661 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:44.053643 8661 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:15:44.053719 8661 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:44.089382 8661 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:38747
I20260807 04:15:44.089437 8794 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:38747 every 8 connection(s)
I20260807 04:15:44.090821 8661 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:15:44.097220 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 8661
I20260807 04:15:44.097462 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance
I20260807 04:15:44.098112 7971 external_mini_cluster.cc:1428] Setting key a55a87c5635b00563a3b6124b0ef1812
Aug 07 04:15:44 dist-test-slave-qg60 krb5kdc[8543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076144, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:15:44.112565 8797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:44.093541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:52867 (local address 127.7.200.254:39611)
0807 04:15:44.094025 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:44.094030 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:44.094834 (+ 804us) server_negotiation.cc:407] Connection header received
0807 04:15:44.096722 (+ 1888us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:44.096765 (+ 43us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:44.096867 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:44.096995 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:44.098705 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:44.099591 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:44.101391 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:44.101820 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:44.101962 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:44.106051 (+ 4089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:44.106056 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:44.106060 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:44.106096 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:44.109312 (+ 3216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:44.110139 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:44.110144 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:44.110146 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:44.110270 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:44.110728 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:44.110734 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:44.110737 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:44.111016 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:44.111176 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:44.111931 (+ 755us) server_negotiation.cc:299] Negotiation successful
0807 04:15:44.112178 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":268,"threads_started":1}
I20260807 04:15:44.113672 8798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:44.093940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:39611 (local address 127.7.200.193:52867)
0807 04:15:44.094657 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:44.094703 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:44.096440 (+ 1737us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:44.097248 (+ 808us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:44.097256 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:44.097880 (+ 624us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:15:44.098532 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:44.098551 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:44.099765 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:44.099769 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:44.101246 (+ 1477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:44.101259 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:44.102084 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:44.102092 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:44.102332 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:44.103151 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:15:44.103174 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:15:44.105779 (+ 2605us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:15:44.109496 (+ 3717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:44.109505 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:44.109521 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:44.109982 (+ 461us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:44.110387 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:44.110392 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:44.110400 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:44.110605 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:44.111151 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:15:44.111159 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:15:44.111531 (+ 372us) client_negotiation.cc:769] Sending connection context
0807 04:15:44.111813 (+ 282us) client_negotiation.cc:240] Negotiation successful
0807 04:15:44.112425 (+ 612us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":280,"threads_started":1}
I20260807 04:15:44.115653 8795 heartbeater.cc:347] Connected to a master server at 127.7.200.254:39611
I20260807 04:15:44.115983 8795 heartbeater.cc:464] Registering TS with master...
I20260807 04:15:44.116839 8795 heartbeater.cc:511] Master 127.7.200.254:39611 requested a full tablet report, sending...
I20260807 04:15:44.119577 8596 ts_manager.cc:194] Registered new tserver with Master: 064562a179b441709a8c34b5c58d2f98 (127.7.200.193:38747)
WARNING: no policy specified for kudu/127.7.200.194@KRBTEST.COM; defaulting to no policy
I20260807 04:15:44.121495 8596 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.193@KRBTEST.COM'} at 127.7.200.193:52867
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
I20260807 04:15:44.148815 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:0
--local_ip_for_outbound_sockets=127.7.200.194
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:39611
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:34931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:15:44.485615 8801 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:15:44.485900 8801 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:15:44.486016 8801 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:15:44.493425 8801 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:15:44.493538 8801 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:15:44.493659 8801 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:15:44.503935 8801 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:34931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:39611
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:15:44.505514 8801 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:15:44.506910 8801 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:15:44.520961 8807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:44.520965 8809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:44.520896 8806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:15:44.526471 8801 server_base.cc:1034] running on GCE node
I20260807 04:15:44.527185 8801 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:15:44.528383 8801 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:15:44.529618 8801 hybrid_clock.cc:648] HybridClock initialized: now 1786076144529491 us; error 129 us; skew 500 ppm
I20260807 04:15:44.529961 8801 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:15:44 dist-test-slave-qg60 krb5kdc[8543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076144, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:15:44.533360 8801 init.cc:377] Logged in from keytab as kudu/127.7.200.194@KRBTEST.COM (short username kudu)
I20260807 04:15:44.534958 8801 webserver.cc:460] Webserver started at http://127.7.200.194:43019/ using document root <none> and password file <none>
I20260807 04:15:44.535691 8801 fs_manager.cc:359] Metadata directory not provided
I20260807 04:15:44.535837 8801 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:15:44.536176 8801 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:15:44.539306 8801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-1/data/instance:
uuid: "5cd3567f19db4c93b6f5656ae9849968"
format_stamp: "Formatted at 2026-08-07 04:15:44 on dist-test-slave-qg60"
server_key: "48661c92678e74625a7aac6d96f91358"
server_key_iv: "c6f19ce8b912c7c8e59b581ccf0e5cb4"
server_key_version: "encryptionkey@0"
I20260807 04:15:44.540199 8801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance:
uuid: "5cd3567f19db4c93b6f5656ae9849968"
format_stamp: "Formatted at 2026-08-07 04:15:44 on dist-test-slave-qg60"
server_key: "48661c92678e74625a7aac6d96f91358"
server_key_iv: "c6f19ce8b912c7c8e59b581ccf0e5cb4"
server_key_version: "encryptionkey@0"
I20260807 04:15:44.545924 8801 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260807 04:15:44.549934 8816 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:44.551311 8801 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 04:15:44.551497 8801 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "5cd3567f19db4c93b6f5656ae9849968"
format_stamp: "Formatted at 2026-08-07 04:15:44 on dist-test-slave-qg60"
server_key: "48661c92678e74625a7aac6d96f91358"
server_key_iv: "c6f19ce8b912c7c8e59b581ccf0e5cb4"
server_key_version: "encryptionkey@0"
I20260807 04:15:44.551721 8801 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:15:44.572970 8801 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:15:44.577858 8801 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:15:44.578207 8801 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:15:44.579272 8801 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:15:44.580904 8801 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:15:44.581012 8801 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:44.581179 8801 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:15:44.581259 8801 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:44.619177 8801 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:40419
I20260807 04:15:44.619208 8936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:40419 every 8 connection(s)
I20260807 04:15:44.620867 8801 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:15:44.621284 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 8801
I20260807 04:15:44.621495 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance
I20260807 04:15:44.622100 7971 external_mini_cluster.cc:1428] Setting key 624c36b84da45e4870508647bcd33972
Aug 07 04:15:44 dist-test-slave-qg60 krb5kdc[8543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076144, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.200.195@KRBTEST.COM; defaulting to no policy
I20260807 04:15:44.646821 8939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:44.623921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:47667 (local address 127.7.200.254:39611)
0807 04:15:44.624421 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:44.624428 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:44.625692 (+ 1264us) server_negotiation.cc:407] Connection header received
0807 04:15:44.628207 (+ 2515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:44.628215 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:44.628339 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:44.628468 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:44.630791 (+ 2323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:44.631680 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:44.633376 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:44.634277 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:44.634436 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:44.638621 (+ 4185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:44.638632 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:44.638640 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:44.638695 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:44.643104 (+ 4409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:44.644065 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:44.644074 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:44.644081 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:44.644271 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:44.644800 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:44.644806 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:44.644809 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:44.645265 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:44.645453 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:44.646256 (+ 803us) server_negotiation.cc:299] Negotiation successful
0807 04:15:44.646461 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":265,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.195@KRBTEST.COM" created.
I20260807 04:15:44.648408 8940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:44.624671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:39611 (local address 127.7.200.194:47667)
0807 04:15:44.625525 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:44.625574 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:44.627722 (+ 2148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:44.628903 (+ 1181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:44.628918 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:44.629734 (+ 816us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:15:44.630579 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:44.630609 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:44.631844 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:44.631849 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:44.633226 (+ 1377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:44.633239 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:44.634522 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:44.634528 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:44.634747 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:44.635525 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:15:44.635552 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:15:44.638285 (+ 2733us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:15:44.643318 (+ 5033us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:44.643327 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:44.643343 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:44.643890 (+ 547us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:44.644403 (+ 513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:44.644406 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:44.644409 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:44.644618 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:44.645424 (+ 806us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:15:44.645431 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:15:44.645870 (+ 439us) client_negotiation.cc:769] Sending connection context
0807 04:15:44.646130 (+ 260us) client_negotiation.cc:240] Negotiation successful
0807 04:15:44.646566 (+ 436us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":354,"threads_started":1}
I20260807 04:15:44.651088 8937 heartbeater.cc:347] Connected to a master server at 127.7.200.254:39611
I20260807 04:15:44.651467 8937 heartbeater.cc:464] Registering TS with master...
I20260807 04:15:44.652297 8937 heartbeater.cc:511] Master 127.7.200.254:39611 requested a full tablet report, sending...
I20260807 04:15:44.654160 8596 ts_manager.cc:194] Registered new tserver with Master: 5cd3567f19db4c93b6f5656ae9849968 (127.7.200.194:40419)
I20260807 04:15:44.655512 8596 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.194@KRBTEST.COM'} at 127.7.200.194:47667
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
I20260807 04:15:44.676693 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:0
--local_ip_for_outbound_sockets=127.7.200.195
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:39611
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:34931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:15:45.013832 8943 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:15:45.014191 8943 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:15:45.014387 8943 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:15:45.022662 8943 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:15:45.022787 8943 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:15:45.022975 8943 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:15:45.033363 8943 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:34931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:39611
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:15:45.034700 8943 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:15:45.036134 8943 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:15:45.050011 8948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:45.050088 8949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:45.050088 8951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:15:45.051156 8943 server_base.cc:1034] running on GCE node
I20260807 04:15:45.051807 8943 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:15:45.052933 8943 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:15:45.054193 8943 hybrid_clock.cc:648] HybridClock initialized: now 1786076145054109 us; error 70 us; skew 500 ppm
I20260807 04:15:45.054534 8943 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:15:45 dist-test-slave-qg60 krb5kdc[8543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076145, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:15:45.058082 8943 init.cc:377] Logged in from keytab as kudu/127.7.200.195@KRBTEST.COM (short username kudu)
I20260807 04:15:45.059662 8943 webserver.cc:460] Webserver started at http://127.7.200.195:36765/ using document root <none> and password file <none>
I20260807 04:15:45.060400 8943 fs_manager.cc:359] Metadata directory not provided
I20260807 04:15:45.060560 8943 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:15:45.060949 8943 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:15:45.063942 8943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-2/data/instance:
uuid: "210ef4bfb8ba44d2aaefa8a826e67ed9"
format_stamp: "Formatted at 2026-08-07 04:15:45 on dist-test-slave-qg60"
server_key: "af6d087b6ba47ae8cf69e028f7ae8dfa"
server_key_iv: "52202eb183de77900cf72c06faa997b1"
server_key_version: "encryptionkey@0"
I20260807 04:15:45.064806 8943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance:
uuid: "210ef4bfb8ba44d2aaefa8a826e67ed9"
format_stamp: "Formatted at 2026-08-07 04:15:45 on dist-test-slave-qg60"
server_key: "af6d087b6ba47ae8cf69e028f7ae8dfa"
server_key_iv: "52202eb183de77900cf72c06faa997b1"
server_key_version: "encryptionkey@0"
I20260807 04:15:45.070139 8943 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260807 04:15:45.073690 8959 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:45.074994 8943 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260807 04:15:45.075176 8943 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "210ef4bfb8ba44d2aaefa8a826e67ed9"
format_stamp: "Formatted at 2026-08-07 04:15:45 on dist-test-slave-qg60"
server_key: "af6d087b6ba47ae8cf69e028f7ae8dfa"
server_key_iv: "52202eb183de77900cf72c06faa997b1"
server_key_version: "encryptionkey@0"
I20260807 04:15:45.075383 8943 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:15:45.089232 8943 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:15:45.093870 8943 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:15:45.094177 8943 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:15:45.095230 8943 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:15:45.096616 8943 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:15:45.096731 8943 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:45.096877 8943 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:15:45.096956 8943 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:45.124892 8795 heartbeater.cc:503] Master 127.7.200.254:39611 was elected leader, sending a full tablet report...
I20260807 04:15:45.133255 8943 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:38225
I20260807 04:15:45.133355 9079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:38225 every 8 connection(s)
I20260807 04:15:45.134552 8943 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:15:45.138263 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 8943
I20260807 04:15:45.138520 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance
I20260807 04:15:45.139142 7971 external_mini_cluster.cc:1428] Setting key 85472251418e50c2e543ca02dd84a7d0
Aug 07 04:15:45 dist-test-slave-qg60 krb5kdc[8543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076145, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:15:45.156632 8939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:45.137270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:45215 (local address 127.7.200.254:39611)
0807 04:15:45.137496 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:45.137503 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:45.138984 (+ 1481us) server_negotiation.cc:407] Connection header received
0807 04:15:45.141271 (+ 2287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:45.141276 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:45.141387 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:45.141517 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:45.143082 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.143891 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.145529 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.146018 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.146128 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:45.149799 (+ 3671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:45.149804 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:45.149807 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:45.149845 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:45.152990 (+ 3145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:45.153985 (+ 995us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:45.153989 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:45.153991 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:45.154167 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:45.154720 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:45.154730 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:45.154732 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:45.155079 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:45.155241 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:45.156019 (+ 778us) server_negotiation.cc:299] Negotiation successful
0807 04:15:45.156256 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 04:15:45.157670 9082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:45.137943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:39611 (local address 127.7.200.195:45215)
0807 04:15:45.138836 (+ 893us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:45.138875 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:45.140975 (+ 2100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:45.141713 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:45.141723 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:45.142351 (+ 628us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:15:45.142924 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:45.142942 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.144064 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.144068 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:45.145379 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:45.145392 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.146239 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.146244 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:45.146443 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:45.147110 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:15:45.147148 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:15:45.149587 (+ 2439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:15:45.153173 (+ 3586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:45.153183 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:45.153200 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:45.153803 (+ 603us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:45.154301 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:45.154306 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:45.154310 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:45.154579 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:45.155215 (+ 636us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:15:45.155223 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:15:45.155588 (+ 365us) client_negotiation.cc:769] Sending connection context
0807 04:15:45.155895 (+ 307us) client_negotiation.cc:240] Negotiation successful
0807 04:15:45.156498 (+ 603us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":632,"thread_start_us":382,"threads_started":1}
I20260807 04:15:45.158970 9080 heartbeater.cc:347] Connected to a master server at 127.7.200.254:39611
I20260807 04:15:45.159302 9080 heartbeater.cc:464] Registering TS with master...
I20260807 04:15:45.160064 9080 heartbeater.cc:511] Master 127.7.200.254:39611 requested a full tablet report, sending...
I20260807 04:15:45.161494 8596 ts_manager.cc:194] Registered new tserver with Master: 210ef4bfb8ba44d2aaefa8a826e67ed9 (127.7.200.195:38225)
I20260807 04:15:45.162314 8596 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.195@KRBTEST.COM'} at 127.7.200.195:45215
I20260807 04:15:45.167304 7971 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 04:15:45.187425 8939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:45.174003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33428 (local address 127.7.200.254:39611)
0807 04:15:45.174232 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:45.174242 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:45.174786 (+ 544us) server_negotiation.cc:407] Connection header received
0807 04:15:45.175018 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:45.175023 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:45.175101 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:45.175212 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:45.176856 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.177679 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.179107 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.179528 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.179675 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:45.182262 (+ 2587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:45.182267 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:45.182271 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:45.182305 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:45.184688 (+ 2383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:45.185375 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:45.185389 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:45.185393 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:45.185528 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:45.185896 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:45.185901 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:45.185907 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:45.186229 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:45.186518 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:45.186814 (+ 296us) server_negotiation.cc:299] Negotiation successful
0807 04:15:45.187076 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 04:15:45.194054 8596 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33428:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:15:45.201274 8596 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:15:45.236760 9097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:45.215123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37558 (local address 127.7.200.194:40419)
0807 04:15:45.226016 (+ 10893us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:45.226028 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:45.226935 (+ 907us) server_negotiation.cc:407] Connection header received
0807 04:15:45.227073 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:45.227084 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:45.227421 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:45.227694 (+ 273us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:15:45.228825 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.231024 (+ 2199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.233962 (+ 2938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.235539 (+ 1577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.235698 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:45.235932 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:45.236201 (+ 269us) server_negotiation.cc:299] Negotiation successful
0807 04:15:45.236369 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10710,"thread_start_us":10550,"threads_started":1}
I20260807 04:15:45.236841 9093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:45.214448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:40419 (local address 127.0.0.1:37558)
0807 04:15:45.226579 (+ 12131us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:45.226603 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:45.226771 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:45.228041 (+ 1270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:45.228052 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:45.228095 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:15:45.228597 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:45.228615 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.231186 (+ 2571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.231191 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:45.233716 (+ 2525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:45.233731 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.235737 (+ 2006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.235742 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:45.235950 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:45.236005 (+ 55us) client_negotiation.cc:769] Sending connection context
0807 04:15:45.236140 (+ 135us) client_negotiation.cc:240] Negotiation successful
0807 04:15:45.236335 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11965,"mutex_wait_us":49,"thread_start_us":11775,"threads_started":1}
I20260807 04:15:45.237811 9092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:45.214343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:38225 (local address 127.0.0.1:47462)
0807 04:15:45.225223 (+ 10880us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:45.225279 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:45.225513 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:45.230297 (+ 4784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:45.230306 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:45.230331 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:15:45.230780 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:45.230795 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.232794 (+ 1999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.232800 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:45.234889 (+ 2089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:45.234902 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.236900 (+ 1998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.236907 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:45.237098 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:45.237132 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 04:15:45.237238 (+ 106us) client_negotiation.cc:240] Negotiation successful
0807 04:15:45.237408 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10558,"thread_start_us":10390,"threads_started":1}
I20260807 04:15:45.238750 9095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:45.214843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:38747 (local address 127.0.0.1:47728)
0807 04:15:45.230223 (+ 15380us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:45.230242 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:45.230352 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:45.231053 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:45.231060 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:45.231092 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:15:45.231648 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:45.231665 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.233205 (+ 1540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.233215 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:45.235435 (+ 2220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:45.235452 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.237726 (+ 2274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.237733 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:45.238101 (+ 368us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:45.238149 (+ 48us) client_negotiation.cc:769] Sending connection context
0807 04:15:45.238235 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 04:15:45.238360 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15254,"mutex_wait_us":3,"thread_start_us":15092,"threads_started":1}
I20260807 04:15:45.239075 9094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:45.214455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47462 (local address 127.7.200.195:38225)
0807 04:15:45.229371 (+ 14916us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:45.229382 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:45.229432 (+ 50us) server_negotiation.cc:407] Connection header received
0807 04:15:45.229535 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:45.229544 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:45.229779 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:45.229999 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:15:45.231018 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.232622 (+ 1604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.235049 (+ 2427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.236354 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.236480 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:45.236717 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:45.238156 (+ 1439us) server_negotiation.cc:299] Negotiation successful
0807 04:15:45.238718 (+ 562us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14721,"thread_start_us":14564,"threads_started":1}
I20260807 04:15:45.239487 9098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:45.215578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47728 (local address 127.7.200.193:38747)
0807 04:15:45.229755 (+ 14177us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:45.229763 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:45.230489 (+ 726us) server_negotiation.cc:407] Connection header received
0807 04:15:45.230599 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:45.230608 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:45.230832 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:45.231032 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:15:45.231836 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.233046 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.235622 (+ 2576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.237209 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.237339 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:45.237558 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:45.238979 (+ 1421us) server_negotiation.cc:299] Negotiation successful
0807 04:15:45.239185 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14007,"thread_start_us":13854,"threads_started":1}
I20260807 04:15:45.241297 8867 tablet_service.cc:1467] Processing CreateTablet for tablet eb824af5ac48417ca20e4029efd91bc0 (DEFAULT_TABLE table=test-table [id=ba824d8805374ab6a306b53d824fcc4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:15:45.242971 8867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb824af5ac48417ca20e4029efd91bc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:45.242517 9010 tablet_service.cc:1467] Processing CreateTablet for tablet eb824af5ac48417ca20e4029efd91bc0 (DEFAULT_TABLE table=test-table [id=ba824d8805374ab6a306b53d824fcc4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:15:45.243666 8727 tablet_service.cc:1467] Processing CreateTablet for tablet eb824af5ac48417ca20e4029efd91bc0 (DEFAULT_TABLE table=test-table [id=ba824d8805374ab6a306b53d824fcc4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:15:45.244776 9010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb824af5ac48417ca20e4029efd91bc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:45.245111 8727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb824af5ac48417ca20e4029efd91bc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:45.257939 9099 tablet_bootstrap.cc:492] T eb824af5ac48417ca20e4029efd91bc0 P 210ef4bfb8ba44d2aaefa8a826e67ed9: Bootstrap starting.
I20260807 04:15:45.259560 9101 tablet_bootstrap.cc:492] T eb824af5ac48417ca20e4029efd91bc0 P 064562a179b441709a8c34b5c58d2f98: Bootstrap starting.
I20260807 04:15:45.261759 9099 tablet_bootstrap.cc:654] T eb824af5ac48417ca20e4029efd91bc0 P 210ef4bfb8ba44d2aaefa8a826e67ed9: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:45.263155 9099 log.cc:824] T eb824af5ac48417ca20e4029efd91bc0 P 210ef4bfb8ba44d2aaefa8a826e67ed9: Log is configured to *not* fsync() on all Append() calls
I20260807 04:15:45.263402 9101 tablet_bootstrap.cc:654] T eb824af5ac48417ca20e4029efd91bc0 P 064562a179b441709a8c34b5c58d2f98: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:45.264047 9100 tablet_bootstrap.cc:492] T eb824af5ac48417ca20e4029efd91bc0 P 5cd3567f19db4c93b6f5656ae9849968: Bootstrap starting.
I20260807 04:15:45.265087 9101 log.cc:824] T eb824af5ac48417ca20e4029efd91bc0 P 064562a179b441709a8c34b5c58d2f98: Log is configured to *not* fsync() on all Append() calls
I20260807 04:15:45.267789 9100 tablet_bootstrap.cc:654] T eb824af5ac48417ca20e4029efd91bc0 P 5cd3567f19db4c93b6f5656ae9849968: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:45.268040 9099 tablet_bootstrap.cc:492] T eb824af5ac48417ca20e4029efd91bc0 P 210ef4bfb8ba44d2aaefa8a826e67ed9: No bootstrap required, opened a new log
I20260807 04:15:45.268348 9099 ts_tablet_manager.cc:1397] T eb824af5ac48417ca20e4029efd91bc0 P 210ef4bfb8ba44d2aaefa8a826e67ed9: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260807 04:15:45.268790 9101 tablet_bootstrap.cc:492] T eb824af5ac48417ca20e4029efd91bc0 P 064562a179b441709a8c34b5c58d2f98: No bootstrap required, opened a new log
I20260807 04:15:45.269055 9101 ts_tablet_manager.cc:1397] T eb824af5ac48417ca20e4029efd91bc0 P 064562a179b441709a8c34b5c58d2f98: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260807 04:15:45.269084 9100 log.cc:824] T eb824af5ac48417ca20e4029efd91bc0 P 5cd3567f19db4c93b6f5656ae9849968: Log is configured to *not* fsync() on all Append() calls
I20260807 04:15:45.275445 9100 tablet_bootstrap.cc:492] T eb824af5ac48417ca20e4029efd91bc0 P 5cd3567f19db4c93b6f5656ae9849968: No bootstrap required, opened a new log
I20260807 04:15:45.275732 9100 ts_tablet_manager.cc:1397] T eb824af5ac48417ca20e4029efd91bc0 P 5cd3567f19db4c93b6f5656ae9849968: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.006s
I20260807 04:15:45.277407 9101 raft_consensus.cc:348] T eb824af5ac48417ca20e4029efd91bc0 P 064562a179b441709a8c34b5c58d2f98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "210ef4bfb8ba44d2aaefa8a826e67ed9" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 38225 } } peers { permanent_uuid: "5cd3567f19db4c93b6f5656ae9849968" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 40419 } } peers { permanent_uuid: "064562a179b441709a8c34b5c58d2f98" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 38747 } }
I20260807 04:15:45.277789 9101 raft_consensus.cc:374] T eb824af5ac48417ca20e4029efd91bc0 P 064562a179b441709a8c34b5c58d2f98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:45.277913 9101 raft_consensus.cc:729] T eb824af5ac48417ca20e4029efd91bc0 P 064562a179b441709a8c34b5c58d2f98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 064562a179b441709a8c34b5c58d2f98, State: Initialized, Role: FOLLOWER
I20260807 04:15:45.278581 9101 consensus_queue.cc:260] T eb824af5ac48417ca20e4029efd91bc0 P 064562a179b441709a8c34b5c58d2f98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "210ef4bfb8ba44d2aaefa8a826e67ed9" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 38225 } } peers { permanent_uuid: "5cd3567f19db4c93b6f5656ae9849968" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 40419 } } peers { permanent_uuid: "064562a179b441709a8c34b5c58d2f98" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 38747 } }
I20260807 04:15:45.280155 9099 raft_consensus.cc:348] T eb824af5ac48417ca20e4029efd91bc0 P 210ef4bfb8ba44d2aaefa8a826e67ed9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "210ef4bfb8ba44d2aaefa8a826e67ed9" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 38225 } } peers { permanent_uuid: "5cd3567f19db4c93b6f5656ae9849968" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 40419 } } peers { permanent_uuid: "064562a179b441709a8c34b5c58d2f98" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 38747 } }
I20260807 04:15:45.280643 9099 raft_consensus.cc:374] T eb824af5ac48417ca20e4029efd91bc0 P 210ef4bfb8ba44d2aaefa8a826e67ed9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:45.280671 9101 ts_tablet_manager.cc:1428] T eb824af5ac48417ca20e4029efd91bc0 P 064562a179b441709a8c34b5c58d2f98: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20260807 04:15:45.280828 9099 raft_consensus.cc:729] T eb824af5ac48417ca20e4029efd91bc0 P 210ef4bfb8ba44d2aaefa8a826e67ed9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 210ef4bfb8ba44d2aaefa8a826e67ed9, State: Initialized, Role: FOLLOWER
I20260807 04:15:45.281620 9099 consensus_queue.cc:260] T eb824af5ac48417ca20e4029efd91bc0 P 210ef4bfb8ba44d2aaefa8a826e67ed9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "210ef4bfb8ba44d2aaefa8a826e67ed9" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 38225 } } peers { permanent_uuid: "5cd3567f19db4c93b6f5656ae9849968" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 40419 } } peers { permanent_uuid: "064562a179b441709a8c34b5c58d2f98" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 38747 } }
I20260807 04:15:45.282740 9080 heartbeater.cc:503] Master 127.7.200.254:39611 was elected leader, sending a full tablet report...
I20260807 04:15:45.284615 9099 ts_tablet_manager.cc:1428] T eb824af5ac48417ca20e4029efd91bc0 P 210ef4bfb8ba44d2aaefa8a826e67ed9: Time spent starting tablet: real 0.016s user 0.016s sys 0.000s
I20260807 04:15:45.286286 9100 raft_consensus.cc:348] T eb824af5ac48417ca20e4029efd91bc0 P 5cd3567f19db4c93b6f5656ae9849968 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "210ef4bfb8ba44d2aaefa8a826e67ed9" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 38225 } } peers { permanent_uuid: "5cd3567f19db4c93b6f5656ae9849968" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 40419 } } peers { permanent_uuid: "064562a179b441709a8c34b5c58d2f98" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 38747 } }
I20260807 04:15:45.286761 9100 raft_consensus.cc:374] T eb824af5ac48417ca20e4029efd91bc0 P 5cd3567f19db4c93b6f5656ae9849968 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:45.286885 9100 raft_consensus.cc:729] T eb824af5ac48417ca20e4029efd91bc0 P 5cd3567f19db4c93b6f5656ae9849968 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cd3567f19db4c93b6f5656ae9849968, State: Initialized, Role: FOLLOWER
I20260807 04:15:45.287521 9100 consensus_queue.cc:260] T eb824af5ac48417ca20e4029efd91bc0 P 5cd3567f19db4c93b6f5656ae9849968 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "210ef4bfb8ba44d2aaefa8a826e67ed9" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 38225 } } peers { permanent_uuid: "5cd3567f19db4c93b6f5656ae9849968" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 40419 } } peers { permanent_uuid: "064562a179b441709a8c34b5c58d2f98" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 38747 } }
I20260807 04:15:45.288456 8937 heartbeater.cc:503] Master 127.7.200.254:39611 was elected leader, sending a full tablet report...
I20260807 04:15:45.289108 9100 ts_tablet_manager.cc:1428] T eb824af5ac48417ca20e4029efd91bc0 P 5cd3567f19db4c93b6f5656ae9849968: Time spent starting tablet: real 0.013s user 0.006s sys 0.010s
I20260807 04:15:45.295822 9105 raft_consensus.cc:482] T eb824af5ac48417ca20e4029efd91bc0 P 064562a179b441709a8c34b5c58d2f98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:15:45.296098 9105 raft_consensus.cc:504] T eb824af5ac48417ca20e4029efd91bc0 P 064562a179b441709a8c34b5c58d2f98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "210ef4bfb8ba44d2aaefa8a826e67ed9" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 38225 } } peers { permanent_uuid: "5cd3567f19db4c93b6f5656ae9849968" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 40419 } } peers { permanent_uuid: "064562a179b441709a8c34b5c58d2f98" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 38747 } }
I20260807 04:15:45.297991 9105 leader_election.cc:288] T eb824af5ac48417ca20e4029efd91bc0 P 064562a179b441709a8c34b5c58d2f98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 210ef4bfb8ba44d2aaefa8a826e67ed9 (127.7.200.195:38225), 5cd3567f19db4c93b6f5656ae9849968 (127.7.200.194:40419)
I20260807 04:15:45.307233 9097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:45.298366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:47883 (local address 127.7.200.194:40419)
0807 04:15:45.298588 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:45.298594 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:45.299474 (+ 880us) server_negotiation.cc:407] Connection header received
0807 04:15:45.299580 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:45.299585 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:45.299678 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:45.299790 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:15:45.300802 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.301980 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.305218 (+ 3238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.306245 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.306454 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:45.306529 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:45.306833 (+ 304us) server_negotiation.cc:299] Negotiation successful
0807 04:15:45.306962 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 04:15:45.307312 9094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:45.298490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:60335 (local address 127.7.200.195:38225)
0807 04:15:45.298698 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:45.298705 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:45.299409 (+ 704us) server_negotiation.cc:407] Connection header received
0807 04:15:45.299618 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:45.299624 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:45.299695 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:45.299790 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:15:45.300728 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.301982 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.305138 (+ 3156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.306286 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.306445 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:45.306534 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:45.306917 (+ 383us) server_negotiation.cc:299] Negotiation successful
0807 04:15:45.307054 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 04:15:45.307603 9109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:45.298444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:40419 (local address 127.7.200.193:47883)
0807 04:15:45.299360 (+ 916us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:45.299375 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:45.299471 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:45.299820 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:45.299825 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:45.299917 (+ 92us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:15:45.300610 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:45.300622 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.302156 (+ 1534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.302162 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:45.304960 (+ 2798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:45.304984 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.306480 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.306487 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:45.306669 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:45.306696 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 04:15:45.306805 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 04:15:45.306944 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":789,"mutex_wait_us":239,"spinlock_wait_cycles":24448,"thread_start_us":373,"threads_started":1}
I20260807 04:15:45.307636 9108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:45.298444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:38225 (local address 127.7.200.193:60335)
0807 04:15:45.299255 (+ 811us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:45.299284 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:45.299459 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:45.299820 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:45.299825 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:45.299853 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:15:45.300518 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:45.300538 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.302156 (+ 1618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.302162 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:45.304983 (+ 2821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:45.304992 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.306626 (+ 1634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.306631 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:45.306750 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:45.306773 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 04:15:45.306880 (+ 107us) client_negotiation.cc:240] Negotiation successful
0807 04:15:45.307024 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":664,"mutex_wait_us":216,"thread_start_us":431,"threads_started":1}
I20260807 04:15:45.308542 8888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb824af5ac48417ca20e4029efd91bc0" candidate_uuid: "064562a179b441709a8c34b5c58d2f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cd3567f19db4c93b6f5656ae9849968" is_pre_election: true
I20260807 04:15:45.308542 9031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb824af5ac48417ca20e4029efd91bc0" candidate_uuid: "064562a179b441709a8c34b5c58d2f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "210ef4bfb8ba44d2aaefa8a826e67ed9" is_pre_election: true
I20260807 04:15:45.309132 9031 raft_consensus.cc:2454] T eb824af5ac48417ca20e4029efd91bc0 P 210ef4bfb8ba44d2aaefa8a826e67ed9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 064562a179b441709a8c34b5c58d2f98 in term 0.
I20260807 04:15:45.309192 8888 raft_consensus.cc:2454] T eb824af5ac48417ca20e4029efd91bc0 P 5cd3567f19db4c93b6f5656ae9849968 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 064562a179b441709a8c34b5c58d2f98 in term 0.
I20260807 04:15:45.309847 8678 leader_election.cc:302] T eb824af5ac48417ca20e4029efd91bc0 P 064562a179b441709a8c34b5c58d2f98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 064562a179b441709a8c34b5c58d2f98, 210ef4bfb8ba44d2aaefa8a826e67ed9, 5cd3567f19db4c93b6f5656ae9849968; no voters:
I20260807 04:15:45.310247 9105 raft_consensus.cc:2781] T eb824af5ac48417ca20e4029efd91bc0 P 064562a179b441709a8c34b5c58d2f98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:15:45.310388 9105 raft_consensus.cc:482] T eb824af5ac48417ca20e4029efd91bc0 P 064562a179b441709a8c34b5c58d2f98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:15:45.310472 9105 raft_consensus.cc:3037] T eb824af5ac48417ca20e4029efd91bc0 P 064562a179b441709a8c34b5c58d2f98 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:45.312821 9105 raft_consensus.cc:504] T eb824af5ac48417ca20e4029efd91bc0 P 064562a179b441709a8c34b5c58d2f98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "210ef4bfb8ba44d2aaefa8a826e67ed9" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 38225 } } peers { permanent_uuid: "5cd3567f19db4c93b6f5656ae9849968" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 40419 } } peers { permanent_uuid: "064562a179b441709a8c34b5c58d2f98" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 38747 } }
I20260807 04:15:45.313462 9105 leader_election.cc:288] T eb824af5ac48417ca20e4029efd91bc0 P 064562a179b441709a8c34b5c58d2f98 [CANDIDATE]: Term 1 election: Requested vote from peers 210ef4bfb8ba44d2aaefa8a826e67ed9 (127.7.200.195:38225), 5cd3567f19db4c93b6f5656ae9849968 (127.7.200.194:40419)
I20260807 04:15:45.313876 9031 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb824af5ac48417ca20e4029efd91bc0" candidate_uuid: "064562a179b441709a8c34b5c58d2f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "210ef4bfb8ba44d2aaefa8a826e67ed9"
I20260807 04:15:45.313995 8888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb824af5ac48417ca20e4029efd91bc0" candidate_uuid: "064562a179b441709a8c34b5c58d2f98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cd3567f19db4c93b6f5656ae9849968"
I20260807 04:15:45.314138 9031 raft_consensus.cc:3037] T eb824af5ac48417ca20e4029efd91bc0 P 210ef4bfb8ba44d2aaefa8a826e67ed9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:45.314213 8888 raft_consensus.cc:3037] T eb824af5ac48417ca20e4029efd91bc0 P 5cd3567f19db4c93b6f5656ae9849968 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:45.317775 9031 raft_consensus.cc:2454] T eb824af5ac48417ca20e4029efd91bc0 P 210ef4bfb8ba44d2aaefa8a826e67ed9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 064562a179b441709a8c34b5c58d2f98 in term 1.
I20260807 04:15:45.317755 8888 raft_consensus.cc:2454] T eb824af5ac48417ca20e4029efd91bc0 P 5cd3567f19db4c93b6f5656ae9849968 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 064562a179b441709a8c34b5c58d2f98 in term 1.
I20260807 04:15:45.318288 8678 leader_election.cc:302] T eb824af5ac48417ca20e4029efd91bc0 P 064562a179b441709a8c34b5c58d2f98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 064562a179b441709a8c34b5c58d2f98, 5cd3567f19db4c93b6f5656ae9849968; no voters:
I20260807 04:15:45.318750 9105 raft_consensus.cc:2781] T eb824af5ac48417ca20e4029efd91bc0 P 064562a179b441709a8c34b5c58d2f98 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:15:45.319368 9105 raft_consensus.cc:686] T eb824af5ac48417ca20e4029efd91bc0 P 064562a179b441709a8c34b5c58d2f98 [term 1 LEADER]: Becoming Leader. State: Replica: 064562a179b441709a8c34b5c58d2f98, State: Running, Role: LEADER
I20260807 04:15:45.319922 9105 consensus_queue.cc:237] T eb824af5ac48417ca20e4029efd91bc0 P 064562a179b441709a8c34b5c58d2f98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "210ef4bfb8ba44d2aaefa8a826e67ed9" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 38225 } } peers { permanent_uuid: "5cd3567f19db4c93b6f5656ae9849968" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 40419 } } peers { permanent_uuid: "064562a179b441709a8c34b5c58d2f98" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 38747 } }
I20260807 04:15:45.325068 8594 catalog_manager.cc:5495] T eb824af5ac48417ca20e4029efd91bc0 P 064562a179b441709a8c34b5c58d2f98 reported cstate change: term changed from 0 to 1, leader changed from <none> to 064562a179b441709a8c34b5c58d2f98 (127.7.200.193). New cstate: current_term: 1 leader_uuid: "064562a179b441709a8c34b5c58d2f98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "210ef4bfb8ba44d2aaefa8a826e67ed9" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 38225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cd3567f19db4c93b6f5656ae9849968" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 40419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "064562a179b441709a8c34b5c58d2f98" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 38747 } health_report { overall_health: HEALTHY } } }
W20260807 04:15:45.343326 8796 tablet.cc:2369] T eb824af5ac48417ca20e4029efd91bc0 P 064562a179b441709a8c34b5c58d2f98: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 04:15:45 dist-test-slave-qg60 krb5kdc[8543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076142, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.193@KRBTEST.COM
I20260807 04:15:45.369067 9098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:45.352826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47744 (local address 127.7.200.193:38747)
0807 04:15:45.353044 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:45.353048 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:45.353584 (+ 536us) server_negotiation.cc:407] Connection header received
0807 04:15:45.353799 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:45.353803 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:45.353868 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:45.354045 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:45.356052 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.356927 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.358202 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.358621 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.358759 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:45.363071 (+ 4312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:45.363086 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:45.363100 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:45.363140 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:45.366141 (+ 3001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:45.366844 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:45.366852 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:45.366854 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:45.367032 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:45.367406 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:45.367412 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:45.367415 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:45.367783 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:45.368100 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:45.368400 (+ 300us) server_negotiation.cc:299] Negotiation successful
0807 04:15:45.368699 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260807 04:15:45.373211 8938 tablet.cc:2369] T eb824af5ac48417ca20e4029efd91bc0 P 5cd3567f19db4c93b6f5656ae9849968: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 04:15:45.386443 9081 tablet.cc:2369] T eb824af5ac48417ca20e4029efd91bc0 P 210ef4bfb8ba44d2aaefa8a826e67ed9: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 04:15:45 dist-test-slave-qg60 krb5kdc[8543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076145, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 04:15:45 dist-test-slave-qg60 krb5kdc[8543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076145, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.200.193@KRBTEST.COM
I20260807 04:15:45.423045 9098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:45.408328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47748 (local address 127.7.200.193:38747)
0807 04:15:45.408554 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:45.408563 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:45.409022 (+ 459us) server_negotiation.cc:407] Connection header received
0807 04:15:45.409266 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:45.409270 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:45.409336 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:45.409450 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:45.410878 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.411644 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.413034 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.413457 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.413591 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:45.417900 (+ 4309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:45.417905 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:45.417908 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:45.417942 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:45.420655 (+ 2713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:45.421393 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:45.421396 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:45.421399 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:45.421521 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:45.421857 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:45.421860 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:45.421862 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:45.422145 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:45.422369 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:45.422594 (+ 225us) server_negotiation.cc:299] Negotiation successful
0807 04:15:45.422788 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
Aug 07 04:15:45 dist-test-slave-qg60 krb5kdc[8543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076145, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 04:15:45 dist-test-slave-qg60 krb5kdc[8543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076145, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.193@KRBTEST.COM
I20260807 04:15:45.476521 9098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:45.460571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47760 (local address 127.7.200.193:38747)
0807 04:15:45.460830 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:45.460838 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:45.461077 (+ 239us) server_negotiation.cc:407] Connection header received
0807 04:15:45.461311 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:45.461315 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:45.461395 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:45.461501 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:45.463116 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.464010 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.465467 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.465939 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.466090 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:45.470733 (+ 4643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:45.470738 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:45.470742 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:45.470778 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:45.473767 (+ 2989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:45.474599 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:45.474603 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:45.474605 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:45.474736 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:45.475164 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:45.475169 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:45.475171 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:45.475460 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:45.475675 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:45.476014 (+ 339us) server_negotiation.cc:299] Negotiation successful
0807 04:15:45.476185 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
W20260807 04:15:45.478494 8707 tablet_service.cc:2908] Rejecting scan request for tablet eb824af5ac48417ca20e4029efd91bc0: Uninitialized: clean time has not yet been initialized
I20260807 04:15:45.482733 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 8661
I20260807 04:15:45.496701 9098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:45.483657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47764 (local address 127.7.200.193:38747)
0807 04:15:45.483889 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:45.483896 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:45.484220 (+ 324us) server_negotiation.cc:407] Connection header received
0807 04:15:45.484372 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:45.484375 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:45.484436 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:45.484517 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:45.486067 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.486829 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.488600 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.489069 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.489171 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:45.491396 (+ 2225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:45.491401 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:45.491404 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:45.491435 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:45.494168 (+ 2733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:45.494802 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:45.494805 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:45.494807 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:45.494931 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:45.495303 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:45.495307 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:45.495309 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:45.495555 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:45.495774 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:45.496084 (+ 310us) server_negotiation.cc:299] Negotiation successful
0807 04:15:45.496285 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 04:15:45.497486 8790 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:15:45.591429 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 8661
I20260807 04:15:45.611935 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 8801
Aug 07 04:15:45 dist-test-slave-qg60 krb5kdc[8543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076145, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.194@KRBTEST.COM
I20260807 04:15:45.628499 9097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:45.612771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37572 (local address 127.7.200.194:40419)
0807 04:15:45.612979 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:45.612984 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:45.613004 (+ 20us) server_negotiation.cc:407] Connection header received
0807 04:15:45.613089 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:45.613092 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:45.613168 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:45.613254 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:45.614536 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.615369 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.616646 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.617117 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.617219 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:45.622180 (+ 4961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:45.622191 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:45.622204 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:45.622243 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:45.625578 (+ 3335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:45.626271 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:45.626278 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:45.626281 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:45.626412 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:45.626798 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:45.626803 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:45.626806 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:45.627288 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:45.627634 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:45.627913 (+ 279us) server_negotiation.cc:299] Negotiation successful
0807 04:15:45.628139 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 04:15:45.629204 8932 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:15:45.721613 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 8801
I20260807 04:15:45.742226 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 8943
Aug 07 04:15:45 dist-test-slave-qg60 krb5kdc[8543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076145, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.195@KRBTEST.COM
I20260807 04:15:45.758366 9094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:45.743233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47466 (local address 127.7.200.195:38225)
0807 04:15:45.743551 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:45.743556 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:45.743577 (+ 21us) server_negotiation.cc:407] Connection header received
0807 04:15:45.743639 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:45.743643 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:45.743709 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:45.743814 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:45.745366 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.746173 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.747513 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:45.747924 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:45.748024 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:45.752711 (+ 4687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:45.752767 (+ 56us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:45.752792 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:45.752835 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:45.755691 (+ 2856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:45.756376 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:45.756383 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:45.756385 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:45.756522 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:45.757019 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:45.757022 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:45.757024 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:45.757393 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:45.757628 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:45.757924 (+ 296us) server_negotiation.cc:299] Negotiation successful
0807 04:15:45.758093 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171}
I20260807 04:15:45.759076 9074 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:15:45.852159 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 8943
I20260807 04:15:45.871747 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 8559
I20260807 04:15:45.872970 8628 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:15:45.984319 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 8559
2026-08-07T04:15:46Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4409 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:15:46 dist-test-slave-qg60 krb5kdc[9129](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:15:46 dist-test-slave-qg60 krb5kdc[9129](info): set up 2 sockets
Aug 07 04:15:46 dist-test-slave-qg60 krb5kdc[9129](info): commencing operation
krb5kdc: starting...
W20260807 04:15:47.155254 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.000s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:15:47 dist-test-slave-qg60 krb5kdc[9129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:15:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:15:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
I20260807 04:15:47.445664 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:36095
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:35585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:36095
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:15:47.998346 9142 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:15:47.998911 9142 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:15:47.999197 9142 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:15:48.011511 9142 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:15:48.011704 9142 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 04:15:48.011869 9142 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:15:48.012056 9142 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:15:48.012183 9142 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:15:48.012349 9142 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:15:48.029181 9142 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:35585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:36095
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:36095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:15:48.031570 9142 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:15:48.034222 9142 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:15:48.055433 9147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:48.055543 9150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:48.055591 9148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:15:48.057428 9142 server_base.cc:1034] running on GCE node
I20260807 04:15:48.058745 9142 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:15:48.061314 9142 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:15:48.062651 9142 hybrid_clock.cc:648] HybridClock initialized: now 1786076148062536 us; error 59 us; skew 500 ppm
I20260807 04:15:48.063264 9142 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:15:48 dist-test-slave-qg60 krb5kdc[9129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076148, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:15:48.068670 9142 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:15:48.071276 9142 webserver.cc:460] Webserver started at http://127.7.200.254:45399/ using document root <none> and password file <none>
I20260807 04:15:48.072423 9142 fs_manager.cc:359] Metadata directory not provided
I20260807 04:15:48.072548 9142 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:15:48.073112 9142 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:15:48.078372 9142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "14722d342fe146b69606fcfd6c95dbda"
format_stamp: "Formatted at 2026-08-07 04:15:48 on dist-test-slave-qg60"
server_key: "171b7e33a980694380c474abae293d9d"
server_key_iv: "950c3ce3572c69f0a393c49537944ee1"
server_key_version: "encryptionkey@0"
I20260807 04:15:48.079607 9142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "14722d342fe146b69606fcfd6c95dbda"
format_stamp: "Formatted at 2026-08-07 04:15:48 on dist-test-slave-qg60"
server_key: "171b7e33a980694380c474abae293d9d"
server_key_iv: "950c3ce3572c69f0a393c49537944ee1"
server_key_version: "encryptionkey@0"
I20260807 04:15:48.088696 9142 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.006s sys 0.004s
I20260807 04:15:48.094749 9157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:48.097293 9142 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.004s
I20260807 04:15:48.097611 9142 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "14722d342fe146b69606fcfd6c95dbda"
format_stamp: "Formatted at 2026-08-07 04:15:48 on dist-test-slave-qg60"
server_key: "171b7e33a980694380c474abae293d9d"
server_key_iv: "950c3ce3572c69f0a393c49537944ee1"
server_key_version: "encryptionkey@0"
I20260807 04:15:48.097970 9142 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:15:48.137202 9142 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:15:48.144764 9142 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:15:48.145365 9142 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:15:48.185679 9142 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:36095
I20260807 04:15:48.185767 9224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:36095 every 8 connection(s)
I20260807 04:15:48.188131 9142 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:15:48.194847 9225 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:48.194864 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 9142
I20260807 04:15:48.195188 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:15:48.196273 7971 external_mini_cluster.cc:1428] Setting key 3d31541983aa4369aaee5e81840317b7
I20260807 04:15:48.222841 9225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14722d342fe146b69606fcfd6c95dbda: Bootstrap starting.
Aug 07 04:15:48 dist-test-slave-qg60 krb5kdc[9129](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:15:48.230386 9225 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 14722d342fe146b69606fcfd6c95dbda: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:48.232378 9225 log.cc:824] T 00000000000000000000000000000000 P 14722d342fe146b69606fcfd6c95dbda: Log is configured to *not* fsync() on all Append() calls
I20260807 04:15:48.238548 9225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14722d342fe146b69606fcfd6c95dbda: No bootstrap required, opened a new log
I20260807 04:15:48.241331 9228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:48.199886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37954 (local address 127.7.200.254:36095)
0807 04:15:48.201380 (+ 1494us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:48.201407 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:48.201470 (+ 63us) server_negotiation.cc:407] Connection header received
0807 04:15:48.205209 (+ 3739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:48.205263 (+ 54us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:48.206043 (+ 780us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:48.206696 (+ 653us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:48.211071 (+ 4375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:48.213321 (+ 2250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:48.217175 (+ 3854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:48.218374 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:48.218621 (+ 247us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:48.228295 (+ 9674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:48.228306 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:48.228338 (+ 32us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:48.228416 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:48.234038 (+ 5622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:48.235442 (+ 1404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:48.235450 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:48.235457 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:48.235728 (+ 271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:48.236400 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:48.236403 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:48.236412 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:48.237286 (+ 874us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:48.237696 (+ 410us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:48.238602 (+ 906us) server_negotiation.cc:299] Negotiation successful
0807 04:15:48.239524 (+ 922us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1087,"thread_start_us":709,"threads_started":1}
I20260807 04:15:48.251931 9225 raft_consensus.cc:348] T 00000000000000000000000000000000 P 14722d342fe146b69606fcfd6c95dbda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14722d342fe146b69606fcfd6c95dbda" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 36095 } }
I20260807 04:15:48.252646 9225 raft_consensus.cc:374] T 00000000000000000000000000000000 P 14722d342fe146b69606fcfd6c95dbda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:48.252943 9225 raft_consensus.cc:729] T 00000000000000000000000000000000 P 14722d342fe146b69606fcfd6c95dbda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14722d342fe146b69606fcfd6c95dbda, State: Initialized, Role: FOLLOWER
I20260807 04:15:48.253923 9225 consensus_queue.cc:260] T 00000000000000000000000000000000 P 14722d342fe146b69606fcfd6c95dbda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14722d342fe146b69606fcfd6c95dbda" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 36095 } }
I20260807 04:15:48.254345 9225 raft_consensus.cc:388] T 00000000000000000000000000000000 P 14722d342fe146b69606fcfd6c95dbda [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:15:48.254590 9225 raft_consensus.cc:482] T 00000000000000000000000000000000 P 14722d342fe146b69606fcfd6c95dbda [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:15:48.254905 9225 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 14722d342fe146b69606fcfd6c95dbda [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:48.258985 9225 raft_consensus.cc:504] T 00000000000000000000000000000000 P 14722d342fe146b69606fcfd6c95dbda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14722d342fe146b69606fcfd6c95dbda" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 36095 } }
I20260807 04:15:48.259799 9225 leader_election.cc:302] T 00000000000000000000000000000000 P 14722d342fe146b69606fcfd6c95dbda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 14722d342fe146b69606fcfd6c95dbda; no voters:
I20260807 04:15:48.260855 9225 leader_election.cc:288] T 00000000000000000000000000000000 P 14722d342fe146b69606fcfd6c95dbda [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:15:48.261019 9230 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 14722d342fe146b69606fcfd6c95dbda [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:15:48.262354 9230 raft_consensus.cc:686] T 00000000000000000000000000000000 P 14722d342fe146b69606fcfd6c95dbda [term 1 LEADER]: Becoming Leader. State: Replica: 14722d342fe146b69606fcfd6c95dbda, State: Running, Role: LEADER
I20260807 04:15:48.263320 9230 consensus_queue.cc:237] T 00000000000000000000000000000000 P 14722d342fe146b69606fcfd6c95dbda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14722d342fe146b69606fcfd6c95dbda" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 36095 } }
I20260807 04:15:48.264854 9225 sys_catalog.cc:564] T 00000000000000000000000000000000 P 14722d342fe146b69606fcfd6c95dbda [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:15:48.269049 9232 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14722d342fe146b69606fcfd6c95dbda [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "14722d342fe146b69606fcfd6c95dbda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14722d342fe146b69606fcfd6c95dbda" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 36095 } } }
I20260807 04:15:48.270093 9232 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14722d342fe146b69606fcfd6c95dbda [sys.catalog]: This master's current role is: LEADER
I20260807 04:15:48.270164 9231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14722d342fe146b69606fcfd6c95dbda [sys.catalog]: SysCatalogTable state changed. Reason: New leader 14722d342fe146b69606fcfd6c95dbda. Latest consensus state: current_term: 1 leader_uuid: "14722d342fe146b69606fcfd6c95dbda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14722d342fe146b69606fcfd6c95dbda" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 36095 } } }
I20260807 04:15:48.270689 9231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14722d342fe146b69606fcfd6c95dbda [sys.catalog]: This master's current role is: LEADER
I20260807 04:15:48.273298 9238 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:15:48.281387 9238 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:15:48.297139 9238 catalog_manager.cc:1347] Generated new cluster ID: 1a94b5554a0c4aab922bc0d492005fdd
I20260807 04:15:48.297374 9238 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:15:48.320133 9238 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:15:48.323652 9238 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:15:48.339196 9238 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 14722d342fe146b69606fcfd6c95dbda: Generated new TSK 0
I20260807 04:15:48.340689 9238 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.200.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
I20260807 04:15:48.434008 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:0
--local_ip_for_outbound_sockets=127.7.200.193
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:36095
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:35585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:15:48.880524 9253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:15:48.880892 9253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:15:48.881074 9253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:15:48.893580 9253 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:15:48.893731 9253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:15:48.893882 9253 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 04:15:48.894018 9253 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:15:48.908558 9253 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:35585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.200.254:36095
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:15:48.910065 9253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:15:48.911526 9253 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:15:48.926607 9259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:48.926936 9262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:48.926651 9260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:15:48.927947 9253 server_base.cc:1034] running on GCE node
I20260807 04:15:48.928692 9253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:15:48.929778 9253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:15:48.931008 9253 hybrid_clock.cc:648] HybridClock initialized: now 1786076148930938 us; error 41 us; skew 500 ppm
I20260807 04:15:48.931304 9253 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:15:48 dist-test-slave-qg60 krb5kdc[9129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076148, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:15:48.934736 9253 init.cc:377] Logged in from keytab as kudu/127.7.200.193@KRBTEST.COM (short username kudu)
I20260807 04:15:48.936400 9253 webserver.cc:460] Webserver started at http://127.7.200.193:34345/ using document root <none> and password file <none>
I20260807 04:15:48.937198 9253 fs_manager.cc:359] Metadata directory not provided
I20260807 04:15:48.937290 9253 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:15:48.937561 9253 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:15:48.940579 9253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-0/data/instance:
uuid: "4ea9c9a2efdb4d76bde192d713e503a0"
format_stamp: "Formatted at 2026-08-07 04:15:48 on dist-test-slave-qg60"
server_key: "68e20af5c39ec408066b29bc8535cb59"
server_key_iv: "5c9e798b999f730df3714cf0aec746bf"
server_key_version: "encryptionkey@0"
I20260807 04:15:48.941464 9253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance:
uuid: "4ea9c9a2efdb4d76bde192d713e503a0"
format_stamp: "Formatted at 2026-08-07 04:15:48 on dist-test-slave-qg60"
server_key: "68e20af5c39ec408066b29bc8535cb59"
server_key_iv: "5c9e798b999f730df3714cf0aec746bf"
server_key_version: "encryptionkey@0"
I20260807 04:15:48.946735 9253 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 04:15:48.950425 9269 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:48.951938 9253 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 04:15:48.952157 9253 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "4ea9c9a2efdb4d76bde192d713e503a0"
format_stamp: "Formatted at 2026-08-07 04:15:48 on dist-test-slave-qg60"
server_key: "68e20af5c39ec408066b29bc8535cb59"
server_key_iv: "5c9e798b999f730df3714cf0aec746bf"
server_key_version: "encryptionkey@0"
I20260807 04:15:48.952421 9253 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:15:48.972481 9253 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:15:48.977351 9253 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:15:48.977661 9253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:15:48.980634 9253 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:15:48.980758 9253 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:48.980901 9253 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:15:48.980981 9253 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 04:15:48 dist-test-slave-qg60 krb5kdc[9129](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076148, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:15:49.007539 9278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:48.981345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:51057 (local address 127.7.200.254:36095)
0807 04:15:48.982043 (+ 698us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:48.982049 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:48.983087 (+ 1038us) server_negotiation.cc:407] Connection header received
0807 04:15:48.985434 (+ 2347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:48.985439 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:48.985544 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:48.985675 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:48.988715 (+ 3040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:48.989874 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:48.992491 (+ 2617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:48.993116 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:48.993261 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:48.999265 (+ 6004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:48.999274 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:48.999279 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:48.999358 (+ 79us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:49.003387 (+ 4029us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:49.004618 (+ 1231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:49.004627 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:49.004633 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:49.004873 (+ 240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:49.005478 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:49.005484 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:49.005487 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:49.005859 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:49.006037 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:49.006868 (+ 831us) server_negotiation.cc:299] Negotiation successful
0807 04:15:49.007127 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":578,"thread_start_us":462,"threads_started":1}
I20260807 04:15:49.008656 9279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:48.982009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:36095 (local address 127.7.200.193:51057)
0807 04:15:48.982896 (+ 887us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:48.982934 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:48.985138 (+ 2204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:48.985972 (+ 834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:48.985987 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:48.986934 (+ 947us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:15:48.988468 (+ 1534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:48.988506 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:48.990060 (+ 1554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:48.990067 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:48.992334 (+ 2267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:48.992348 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:48.993661 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:48.993673 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:48.993992 (+ 319us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:48.994888 (+ 896us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:15:48.994927 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:15:48.998953 (+ 4026us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:15:49.003629 (+ 4676us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:49.003644 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:49.003671 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:49.004411 (+ 740us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:49.005117 (+ 706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:49.005121 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:49.005123 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:49.005343 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:49.006017 (+ 674us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:15:49.006026 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:15:49.006468 (+ 442us) client_negotiation.cc:769] Sending connection context
0807 04:15:49.006771 (+ 303us) client_negotiation.cc:240] Negotiation successful
0807 04:15:49.007357 (+ 586us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":640,"thread_start_us":405,"threads_started":1}
I20260807 04:15:49.035146 9278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:49.016330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:55629 (local address 127.7.200.254:36095)
0807 04:15:49.016528 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:49.016533 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:49.017289 (+ 756us) server_negotiation.cc:407] Connection header received
0807 04:15:49.017426 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:49.017435 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:49.017549 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:49.017692 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:49.018821 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:49.020130 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:49.023041 (+ 2911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:49.023862 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:49.024021 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:49.026519 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:49.026526 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:49.026531 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:49.026591 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:49.031095 (+ 4504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:49.032323 (+ 1228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:49.032331 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:49.032335 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:49.032568 (+ 233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:49.033192 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:49.033222 (+ 30us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:49.033227 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:49.033748 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:49.033941 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:49.034420 (+ 479us) server_negotiation.cc:299] Negotiation successful
0807 04:15:49.034707 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 04:15:49.035266 9354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:49.016386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:36095 (local address 127.7.200.193:55629)
0807 04:15:49.017149 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:49.017166 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:49.017307 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:49.017732 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:49.017735 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:49.018325 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:15:49.018651 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:49.018662 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:49.020333 (+ 1671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:49.020338 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:49.022806 (+ 2468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:49.022829 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:49.024111 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:49.024121 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:49.024273 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:49.025083 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:15:49.025106 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:15:49.026306 (+ 1200us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:15:49.031318 (+ 5012us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:49.031329 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:49.031334 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:49.032104 (+ 770us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:49.032758 (+ 654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:49.032767 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:49.032773 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:49.033012 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:49.033900 (+ 888us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:15:49.033906 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:15:49.034134 (+ 228us) client_negotiation.cc:769] Sending connection context
0807 04:15:49.034296 (+ 162us) client_negotiation.cc:240] Negotiation successful
0807 04:15:49.034703 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":623,"thread_start_us":449,"threads_started":1}
I20260807 04:15:49.041680 9253 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:40231
I20260807 04:15:49.041714 9399 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:40231 every 8 connection(s)
I20260807 04:15:49.042935 9253 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:15:49.045167 9400 heartbeater.cc:347] Connected to a master server at 127.7.200.254:36095
I20260807 04:15:49.045436 9400 heartbeater.cc:464] Registering TS with master...
I20260807 04:15:49.046216 9400 heartbeater.cc:511] Master 127.7.200.254:36095 requested a full tablet report, sending...
I20260807 04:15:49.048247 9176 ts_manager.cc:194] Registered new tserver with Master: 4ea9c9a2efdb4d76bde192d713e503a0 (127.7.200.193:40231)
I20260807 04:15:49.049546 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 9253
I20260807 04:15:49.049788 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance
I20260807 04:15:49.049986 9176 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.193@KRBTEST.COM'} at 127.7.200.193:51057
I20260807 04:15:49.050550 7971 external_mini_cluster.cc:1428] Setting key 42c820dfe9b4ee222c410396af1fe173
WARNING: no policy specified for kudu/127.7.200.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
I20260807 04:15:49.100987 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:0
--local_ip_for_outbound_sockets=127.7.200.194
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:36095
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:35585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:15:49.455304 9404 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:15:49.455600 9404 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:15:49.455770 9404 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:15:49.463622 9404 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:15:49.463749 9404 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:15:49.463923 9404 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 04:15:49.464061 9404 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:15:49.474540 9404 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:35585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.200.254:36095
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:15:49.475926 9404 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:15:49.477396 9404 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:15:49.491072 9411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:49.491132 9413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:49.491115 9410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:15:49.492302 9404 server_base.cc:1034] running on GCE node
I20260807 04:15:49.493136 9404 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:15:49.494109 9404 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:15:49.495352 9404 hybrid_clock.cc:648] HybridClock initialized: now 1786076149495261 us; error 61 us; skew 500 ppm
I20260807 04:15:49.495690 9404 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:15:49 dist-test-slave-qg60 krb5kdc[9129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076149, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:15:49.499159 9404 init.cc:377] Logged in from keytab as kudu/127.7.200.194@KRBTEST.COM (short username kudu)
I20260807 04:15:49.500694 9404 webserver.cc:460] Webserver started at http://127.7.200.194:40041/ using document root <none> and password file <none>
I20260807 04:15:49.501456 9404 fs_manager.cc:359] Metadata directory not provided
I20260807 04:15:49.501549 9404 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:15:49.501837 9404 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:15:49.505030 9404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-1/data/instance:
uuid: "044090eb74d94af397c391808cf14c3a"
format_stamp: "Formatted at 2026-08-07 04:15:49 on dist-test-slave-qg60"
server_key: "b3dd4f536f1e27540855a1c8dc6825ed"
server_key_iv: "bf40fce318ee1287fbbf33ab0904036a"
server_key_version: "encryptionkey@0"
I20260807 04:15:49.506006 9404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance:
uuid: "044090eb74d94af397c391808cf14c3a"
format_stamp: "Formatted at 2026-08-07 04:15:49 on dist-test-slave-qg60"
server_key: "b3dd4f536f1e27540855a1c8dc6825ed"
server_key_iv: "bf40fce318ee1287fbbf33ab0904036a"
server_key_version: "encryptionkey@0"
I20260807 04:15:49.511574 9404 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 04:15:49.515352 9420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:49.516963 9404 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:15:49.517179 9404 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "044090eb74d94af397c391808cf14c3a"
format_stamp: "Formatted at 2026-08-07 04:15:49 on dist-test-slave-qg60"
server_key: "b3dd4f536f1e27540855a1c8dc6825ed"
server_key_iv: "bf40fce318ee1287fbbf33ab0904036a"
server_key_version: "encryptionkey@0"
I20260807 04:15:49.517387 9404 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:15:49.546684 9404 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:15:49.551651 9404 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:15:49.551977 9404 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:15:49.555068 9404 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:15:49.555191 9404 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:49.555368 9404 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:15:49.555490 9404 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
Aug 07 04:15:49 dist-test-slave-qg60 krb5kdc[9129](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076149, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:15:49.583542 9429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:49.555576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:39405 (local address 127.7.200.254:36095)
0807 04:15:49.556125 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:49.556133 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:49.557545 (+ 1412us) server_negotiation.cc:407] Connection header received
0807 04:15:49.560032 (+ 2487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:49.560039 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:49.560133 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:49.560267 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:49.562846 (+ 2579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:49.564053 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:49.567015 (+ 2962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:49.567739 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:49.567929 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:49.574025 (+ 6096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:49.574034 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:49.574043 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:49.574095 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:49.578599 (+ 4504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:49.580151 (+ 1552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:49.580156 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:49.580160 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:49.580331 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:49.581136 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:49.581140 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:49.581144 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:49.581582 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:49.581806 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:49.582587 (+ 781us) server_negotiation.cc:299] Negotiation successful
0807 04:15:49.582949 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":295,"threads_started":1}
I20260807 04:15:49.584110 9431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:49.556431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:36095 (local address 127.7.200.194:39405)
0807 04:15:49.557375 (+ 944us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:49.557415 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:49.559615 (+ 2200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:49.560548 (+ 933us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:49.560557 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:49.561532 (+ 975us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:15:49.562604 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:49.562640 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:49.564227 (+ 1587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:49.564233 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:49.566744 (+ 2511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:49.566787 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:49.568122 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:49.568133 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:49.568432 (+ 299us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:49.569436 (+ 1004us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:15:49.569467 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:15:49.573682 (+ 4215us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:15:49.578860 (+ 5178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:49.578878 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:49.578909 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:49.579909 (+ 1000us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:49.580501 (+ 592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:49.580511 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:49.580515 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:49.580932 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:49.581726 (+ 794us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:15:49.581734 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:15:49.582110 (+ 376us) client_negotiation.cc:769] Sending connection context
0807 04:15:49.582380 (+ 270us) client_negotiation.cc:240] Negotiation successful
0807 04:15:49.582824 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":680,"thread_start_us":407,"threads_started":1}
I20260807 04:15:49.607889 9429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:49.592119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:34743 (local address 127.7.200.254:36095)
0807 04:15:49.592341 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:49.592349 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:49.593295 (+ 946us) server_negotiation.cc:407] Connection header received
0807 04:15:49.593498 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:49.593505 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:49.593595 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:49.593700 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:49.594831 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:49.595587 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:49.597105 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:49.597597 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:49.597695 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:49.600809 (+ 3114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:49.600819 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:49.600826 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:49.600871 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:49.604787 (+ 3916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:49.605659 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:49.605668 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:49.605674 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:49.605846 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:49.606361 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:49.606369 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:49.606374 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:49.606704 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:49.606892 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:49.607288 (+ 396us) server_negotiation.cc:299] Negotiation successful
0807 04:15:49.607541 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 04:15:49.608131 9517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:49.592176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:36095 (local address 127.7.200.194:34743)
0807 04:15:49.593158 (+ 982us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:49.593181 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:49.593340 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:49.593761 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:49.593766 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:49.594373 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:15:49.594670 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:49.594680 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:49.595739 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:49.595745 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:49.596890 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:49.596903 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:49.597821 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:49.597828 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:49.598055 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:49.598981 (+ 926us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:15:49.599017 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:15:49.600524 (+ 1507us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:15:49.604927 (+ 4403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:49.604933 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:49.604938 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:49.605495 (+ 557us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:49.606033 (+ 538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:49.606041 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:49.606047 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:49.606246 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:49.606842 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:15:49.606847 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:15:49.607043 (+ 196us) client_negotiation.cc:769] Sending connection context
0807 04:15:49.607195 (+ 152us) client_negotiation.cc:240] Negotiation successful
0807 04:15:49.607608 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":790,"thread_start_us":565,"threads_started":1}
I20260807 04:15:49.609117 9404 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:45357
I20260807 04:15:49.609120 9548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:45357 every 8 connection(s)
I20260807 04:15:49.610606 9404 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:15:49.613543 9549 heartbeater.cc:347] Connected to a master server at 127.7.200.254:36095
I20260807 04:15:49.613821 9549 heartbeater.cc:464] Registering TS with master...
I20260807 04:15:49.614482 9549 heartbeater.cc:511] Master 127.7.200.254:36095 requested a full tablet report, sending...
I20260807 04:15:49.614785 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 9404
I20260807 04:15:49.615007 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance
I20260807 04:15:49.615584 7971 external_mini_cluster.cc:1428] Setting key 99f7657945340d7e227f8be2f6420fc7
I20260807 04:15:49.616005 9176 ts_manager.cc:194] Registered new tserver with Master: 044090eb74d94af397c391808cf14c3a (127.7.200.194:45357)
I20260807 04:15:49.617288 9176 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.194@KRBTEST.COM'} at 127.7.200.194:39405
WARNING: no policy specified for kudu/127.7.200.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
I20260807 04:15:49.670106 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:0
--local_ip_for_outbound_sockets=127.7.200.195
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:36095
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:35585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:15:50.023931 9553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:15:50.024216 9553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:15:50.024315 9553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:15:50.031843 9553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:15:50.031963 9553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:15:50.032051 9553 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 04:15:50.032133 9553 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:15:50.044566 9553 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:35585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.200.254:36095
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:15:50.046205 9553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:15:50.047461 9553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 04:15:50.053203 9400 heartbeater.cc:503] Master 127.7.200.254:36095 was elected leader, sending a full tablet report...
W20260807 04:15:50.061652 9559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:50.061655 9558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:50.061995 9562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:15:50.062641 9553 server_base.cc:1034] running on GCE node
I20260807 04:15:50.063325 9553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:15:50.064429 9553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:15:50.065690 9553 hybrid_clock.cc:648] HybridClock initialized: now 1786076150065629 us; error 34 us; skew 500 ppm
I20260807 04:15:50.066064 9553 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:15:50 dist-test-slave-qg60 krb5kdc[9129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076150, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:15:50.069449 9553 init.cc:377] Logged in from keytab as kudu/127.7.200.195@KRBTEST.COM (short username kudu)
I20260807 04:15:50.070923 9553 webserver.cc:460] Webserver started at http://127.7.200.195:46249/ using document root <none> and password file <none>
I20260807 04:15:50.071599 9553 fs_manager.cc:359] Metadata directory not provided
I20260807 04:15:50.071684 9553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:15:50.071952 9553 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:15:50.075074 9553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-2/data/instance:
uuid: "4d914a49cb2d4a4788f5ff49dcd78508"
format_stamp: "Formatted at 2026-08-07 04:15:50 on dist-test-slave-qg60"
server_key: "c576bcdeaba50f1a43313ba9859bb684"
server_key_iv: "eb5ea3b27ecbcb2c7b165b205265b9a4"
server_key_version: "encryptionkey@0"
I20260807 04:15:50.075855 9553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance:
uuid: "4d914a49cb2d4a4788f5ff49dcd78508"
format_stamp: "Formatted at 2026-08-07 04:15:50 on dist-test-slave-qg60"
server_key: "c576bcdeaba50f1a43313ba9859bb684"
server_key_iv: "eb5ea3b27ecbcb2c7b165b205265b9a4"
server_key_version: "encryptionkey@0"
I20260807 04:15:50.081373 9553 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 04:15:50.085098 9569 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:50.086511 9553 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:15:50.086647 9553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "4d914a49cb2d4a4788f5ff49dcd78508"
format_stamp: "Formatted at 2026-08-07 04:15:50 on dist-test-slave-qg60"
server_key: "c576bcdeaba50f1a43313ba9859bb684"
server_key_iv: "eb5ea3b27ecbcb2c7b165b205265b9a4"
server_key_version: "encryptionkey@0"
I20260807 04:15:50.086833 9553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:15:50.124153 9553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:15:50.128715 9553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:15:50.129004 9553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:15:50.131830 9553 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:15:50.131955 9553 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:50.132102 9553 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:15:50.132179 9553 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 04:15:50 dist-test-slave-qg60 krb5kdc[9129](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076150, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:15:50.158926 9579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:50.132591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:55513 (local address 127.7.200.254:36095)
0807 04:15:50.133373 (+ 782us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:50.133378 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:50.134720 (+ 1342us) server_negotiation.cc:407] Connection header received
0807 04:15:50.136891 (+ 2171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:50.136898 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:50.137000 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:50.137139 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:50.139695 (+ 2556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.141122 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.143860 (+ 2738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.144697 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.144898 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:50.150784 (+ 5886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:50.150789 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:50.150793 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:50.150832 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:50.154541 (+ 3709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:50.155825 (+ 1284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:50.155830 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:50.155832 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:50.155979 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:50.156777 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:50.156783 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:50.156787 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:50.157213 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:50.157432 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:50.158248 (+ 816us) server_negotiation.cc:299] Negotiation successful
0807 04:15:50.158483 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":664,"thread_start_us":565,"threads_started":1}
I20260807 04:15:50.160045 9580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:50.133431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:36095 (local address 127.7.200.195:55513)
0807 04:15:50.134500 (+ 1069us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:50.134577 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:50.136538 (+ 1961us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:50.137446 (+ 908us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:50.137461 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:50.138453 (+ 992us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:15:50.139415 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:50.139451 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.141364 (+ 1913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.141374 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:50.143683 (+ 2309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:50.143697 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.145097 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.145111 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:50.145326 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:50.146297 (+ 971us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:15:50.146326 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:15:50.150401 (+ 4075us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:15:50.154736 (+ 4335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:50.154750 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:50.154777 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:50.155610 (+ 833us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:50.156170 (+ 560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:50.156179 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:50.156185 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:50.156556 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:50.157437 (+ 881us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:15:50.157452 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:15:50.157857 (+ 405us) client_negotiation.cc:769] Sending connection context
0807 04:15:50.158161 (+ 304us) client_negotiation.cc:240] Negotiation successful
0807 04:15:50.158782 (+ 621us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":794,"thread_start_us":508,"threads_started":1}
I20260807 04:15:50.183930 9579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:50.167119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:43245 (local address 127.7.200.254:36095)
0807 04:15:50.167376 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:50.167385 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:50.167982 (+ 597us) server_negotiation.cc:407] Connection header received
0807 04:15:50.168126 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:50.168134 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:50.168249 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:50.168393 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:50.169939 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.171088 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.173260 (+ 2172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.174109 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.174276 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:50.176305 (+ 2029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:50.176315 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:50.176324 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:50.176378 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:50.180548 (+ 4170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:50.181580 (+ 1032us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:50.181588 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:50.181595 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:50.181797 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:50.182249 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:50.182255 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:50.182258 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:50.182704 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:50.182876 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:50.183300 (+ 424us) server_negotiation.cc:299] Negotiation successful
0807 04:15:50.183543 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 04:15:50.184005 9648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:50.166940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:36095 (local address 127.7.200.195:43245)
0807 04:15:50.167857 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:50.167876 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:50.168010 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:50.168492 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:50.168496 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:50.169166 (+ 670us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:15:50.169743 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:50.169759 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.171254 (+ 1495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.171259 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:50.173048 (+ 1789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:50.173068 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.174396 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.174405 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:50.174548 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:50.175258 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:15:50.175277 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:15:50.176066 (+ 789us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:15:50.180717 (+ 4651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:50.180723 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:50.180761 (+ 38us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:50.181407 (+ 646us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:50.181929 (+ 522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:50.181932 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:50.181934 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:50.182109 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:50.182831 (+ 722us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:15:50.182835 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:15:50.183042 (+ 207us) client_negotiation.cc:769] Sending connection context
0807 04:15:50.183189 (+ 147us) client_negotiation.cc:240] Negotiation successful
0807 04:15:50.183528 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":764,"thread_start_us":602,"threads_started":1}
I20260807 04:15:50.193527 9553 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:37487
I20260807 04:15:50.193562 9694 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:37487 every 8 connection(s)
I20260807 04:15:50.194878 9553 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:15:50.195915 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 9553
I20260807 04:15:50.196133 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance
I20260807 04:15:50.196697 7971 external_mini_cluster.cc:1428] Setting key ef5c96f4818f2530691b1183afb19cae
I20260807 04:15:50.197345 9695 heartbeater.cc:347] Connected to a master server at 127.7.200.254:36095
I20260807 04:15:50.197608 9695 heartbeater.cc:464] Registering TS with master...
I20260807 04:15:50.198482 9695 heartbeater.cc:511] Master 127.7.200.254:36095 requested a full tablet report, sending...
I20260807 04:15:50.200064 9176 ts_manager.cc:194] Registered new tserver with Master: 4d914a49cb2d4a4788f5ff49dcd78508 (127.7.200.195:37487)
I20260807 04:15:50.200925 9176 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.195@KRBTEST.COM'} at 127.7.200.195:55513
I20260807 04:15:50.212603 7971 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 04:15:50 dist-test-slave-qg60 krb5kdc[9129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076150, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 04:15:50 dist-test-slave-qg60 krb5kdc[9129](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076150, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:15:50.266971 9579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:50.252033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37970 (local address 127.7.200.254:36095)
0807 04:15:50.252219 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:50.252223 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:50.252598 (+ 375us) server_negotiation.cc:407] Connection header received
0807 04:15:50.252812 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:50.252816 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:50.252911 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:50.253002 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:50.254459 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.255495 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.256946 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.257497 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.257608 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:50.261579 (+ 3971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:50.261583 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:50.261587 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:50.261621 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:50.264378 (+ 2757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:50.265075 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:50.265079 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:50.265081 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:50.265249 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:50.265606 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:50.265610 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:50.265612 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:50.265880 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:50.266090 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:50.266377 (+ 287us) server_negotiation.cc:299] Negotiation successful
0807 04:15:50.266614 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 04:15:50.271292 9176 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37970:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:15:50.278594 9176 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:15:50.309185 9709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:50.291896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:37487 (local address 127.0.0.1:56798)
0807 04:15:50.298947 (+ 7051us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:50.298975 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:50.299115 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:50.300649 (+ 1534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:50.300656 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:50.300688 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:15:50.301186 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:50.301201 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.303336 (+ 2135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.303344 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:50.306010 (+ 2666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:50.306026 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.307961 (+ 1935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.307971 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:50.308228 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:50.308310 (+ 82us) client_negotiation.cc:769] Sending connection context
0807 04:15:50.308438 (+ 128us) client_negotiation.cc:240] Negotiation successful
0807 04:15:50.308652 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6877,"mutex_wait_us":32,"thread_start_us":7312,"threads_started":1}
I20260807 04:15:50.309180 9711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:50.292563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56798 (local address 127.7.200.195:37487)
0807 04:15:50.300125 (+ 7562us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:50.300132 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:50.300161 (+ 29us) server_negotiation.cc:407] Connection header received
0807 04:15:50.300236 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:50.300241 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:50.300425 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:50.300641 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:15:50.301449 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.303196 (+ 1747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.306227 (+ 3031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.307735 (+ 1508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.307880 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:50.308161 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:50.308541 (+ 380us) server_negotiation.cc:299] Negotiation successful
0807 04:15:50.308750 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7380,"thread_start_us":7204,"threads_started":1}
I20260807 04:15:50.309689 9710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:50.291960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46040 (local address 127.7.200.193:40231)
0807 04:15:50.301402 (+ 9442us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:50.301407 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:50.301428 (+ 21us) server_negotiation.cc:407] Connection header received
0807 04:15:50.301540 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:50.301547 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:50.301823 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:50.302741 (+ 918us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:15:50.302931 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.304266 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.306870 (+ 2604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.307865 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.308592 (+ 727us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:50.308831 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:50.308925 (+ 94us) server_negotiation.cc:299] Negotiation successful
0807 04:15:50.309100 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9267,"thread_start_us":9135,"threads_started":1}
I20260807 04:15:50.309895 9713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:50.292500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:45357 (local address 127.0.0.1:38240)
0807 04:15:50.300248 (+ 7748us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:50.300276 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:50.300413 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:50.301555 (+ 1142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:50.301559 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:50.301585 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:15:50.301993 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:50.302009 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.303861 (+ 1852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.303867 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:50.306336 (+ 2469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:50.306349 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.308341 (+ 1992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.308346 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:50.308504 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:50.308545 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 04:15:50.308643 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 04:15:50.308810 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7593,"mutex_wait_us":29,"thread_start_us":7448,"threads_started":1}
I20260807 04:15:50.310322 9708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:50.291728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:40231 (local address 127.0.0.1:46040)
0807 04:15:50.298001 (+ 6273us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:50.298074 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:50.298314 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:50.302057 (+ 3743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:50.302064 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:50.302095 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:15:50.302546 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:50.302559 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.304414 (+ 1855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.304419 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:50.306619 (+ 2200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:50.306633 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.308110 (+ 1477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.308116 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:50.308295 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:50.308319 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 04:15:50.308426 (+ 107us) client_negotiation.cc:240] Negotiation successful
0807 04:15:50.309903 (+ 1477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5831,"mutex_wait_us":872,"thread_start_us":5541,"threads_started":1}
I20260807 04:15:50.311017 9712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:50.293151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38240 (local address 127.7.200.194:45357)
0807 04:15:50.300921 (+ 7770us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:50.300932 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:50.300968 (+ 36us) server_negotiation.cc:407] Connection header received
0807 04:15:50.301101 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:50.301110 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:50.301342 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:50.301552 (+ 210us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:15:50.302193 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.303721 (+ 1528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.306517 (+ 2796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.307874 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.307997 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:50.308191 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:50.310476 (+ 2285us) server_negotiation.cc:299] Negotiation successful
0807 04:15:50.310657 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7609,"thread_start_us":7462,"threads_started":1}
I20260807 04:15:50.313836 9323 tablet_service.cc:1467] Processing CreateTablet for tablet 61ec1f112e584e0cb48c03f462cd7920 (DEFAULT_TABLE table=test-table [id=a755715211be4275907ed9da276d0ec3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:15:50.313862 9622 tablet_service.cc:1467] Processing CreateTablet for tablet 61ec1f112e584e0cb48c03f462cd7920 (DEFAULT_TABLE table=test-table [id=a755715211be4275907ed9da276d0ec3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:15:50.314378 9473 tablet_service.cc:1467] Processing CreateTablet for tablet 61ec1f112e584e0cb48c03f462cd7920 (DEFAULT_TABLE table=test-table [id=a755715211be4275907ed9da276d0ec3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:15:50.315295 9323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61ec1f112e584e0cb48c03f462cd7920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:50.315330 9622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61ec1f112e584e0cb48c03f462cd7920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:50.315619 9473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61ec1f112e584e0cb48c03f462cd7920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:50.326901 9714 tablet_bootstrap.cc:492] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0: Bootstrap starting.
I20260807 04:15:50.330977 9715 tablet_bootstrap.cc:492] T 61ec1f112e584e0cb48c03f462cd7920 P 044090eb74d94af397c391808cf14c3a: Bootstrap starting.
I20260807 04:15:50.331750 9714 tablet_bootstrap.cc:654] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:50.331838 9716 tablet_bootstrap.cc:492] T 61ec1f112e584e0cb48c03f462cd7920 P 4d914a49cb2d4a4788f5ff49dcd78508: Bootstrap starting.
I20260807 04:15:50.333406 9714 log.cc:824] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0: Log is configured to *not* fsync() on all Append() calls
I20260807 04:15:50.335575 9716 tablet_bootstrap.cc:654] T 61ec1f112e584e0cb48c03f462cd7920 P 4d914a49cb2d4a4788f5ff49dcd78508: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:50.336077 9715 tablet_bootstrap.cc:654] T 61ec1f112e584e0cb48c03f462cd7920 P 044090eb74d94af397c391808cf14c3a: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:50.336895 9716 log.cc:824] T 61ec1f112e584e0cb48c03f462cd7920 P 4d914a49cb2d4a4788f5ff49dcd78508: Log is configured to *not* fsync() on all Append() calls
I20260807 04:15:50.336988 9714 tablet_bootstrap.cc:492] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0: No bootstrap required, opened a new log
I20260807 04:15:50.337270 9714 ts_tablet_manager.cc:1397] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260807 04:15:50.337283 9715 log.cc:824] T 61ec1f112e584e0cb48c03f462cd7920 P 044090eb74d94af397c391808cf14c3a: Log is configured to *not* fsync() on all Append() calls
I20260807 04:15:50.341954 9715 tablet_bootstrap.cc:492] T 61ec1f112e584e0cb48c03f462cd7920 P 044090eb74d94af397c391808cf14c3a: No bootstrap required, opened a new log
I20260807 04:15:50.342264 9715 ts_tablet_manager.cc:1397] T 61ec1f112e584e0cb48c03f462cd7920 P 044090eb74d94af397c391808cf14c3a: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.001s
I20260807 04:15:50.343470 9716 tablet_bootstrap.cc:492] T 61ec1f112e584e0cb48c03f462cd7920 P 4d914a49cb2d4a4788f5ff49dcd78508: No bootstrap required, opened a new log
I20260807 04:15:50.343746 9716 ts_tablet_manager.cc:1397] T 61ec1f112e584e0cb48c03f462cd7920 P 4d914a49cb2d4a4788f5ff49dcd78508: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260807 04:15:50.348976 9714 raft_consensus.cc:348] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } }
I20260807 04:15:50.349589 9714 raft_consensus.cc:374] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:50.349740 9714 raft_consensus.cc:729] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ea9c9a2efdb4d76bde192d713e503a0, State: Initialized, Role: FOLLOWER
I20260807 04:15:50.350622 9714 consensus_queue.cc:260] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } }
I20260807 04:15:50.350834 9715 raft_consensus.cc:348] T 61ec1f112e584e0cb48c03f462cd7920 P 044090eb74d94af397c391808cf14c3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } }
I20260807 04:15:50.351432 9715 raft_consensus.cc:374] T 61ec1f112e584e0cb48c03f462cd7920 P 044090eb74d94af397c391808cf14c3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:50.351608 9715 raft_consensus.cc:729] T 61ec1f112e584e0cb48c03f462cd7920 P 044090eb74d94af397c391808cf14c3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 044090eb74d94af397c391808cf14c3a, State: Initialized, Role: FOLLOWER
I20260807 04:15:50.352571 9714 ts_tablet_manager.cc:1428] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0: Time spent starting tablet: real 0.015s user 0.010s sys 0.004s
I20260807 04:15:50.353407 9715 consensus_queue.cc:260] T 61ec1f112e584e0cb48c03f462cd7920 P 044090eb74d94af397c391808cf14c3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } }
I20260807 04:15:50.354521 9716 raft_consensus.cc:348] T 61ec1f112e584e0cb48c03f462cd7920 P 4d914a49cb2d4a4788f5ff49dcd78508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } }
I20260807 04:15:50.354974 9716 raft_consensus.cc:374] T 61ec1f112e584e0cb48c03f462cd7920 P 4d914a49cb2d4a4788f5ff49dcd78508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:50.355084 9716 raft_consensus.cc:729] T 61ec1f112e584e0cb48c03f462cd7920 P 4d914a49cb2d4a4788f5ff49dcd78508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d914a49cb2d4a4788f5ff49dcd78508, State: Initialized, Role: FOLLOWER
I20260807 04:15:50.355268 9715 ts_tablet_manager.cc:1428] T 61ec1f112e584e0cb48c03f462cd7920 P 044090eb74d94af397c391808cf14c3a: Time spent starting tablet: real 0.013s user 0.008s sys 0.004s
I20260807 04:15:50.355818 9549 heartbeater.cc:503] Master 127.7.200.254:36095 was elected leader, sending a full tablet report...
I20260807 04:15:50.355717 9716 consensus_queue.cc:260] T 61ec1f112e584e0cb48c03f462cd7920 P 4d914a49cb2d4a4788f5ff49dcd78508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } }
I20260807 04:15:50.357923 9695 heartbeater.cc:503] Master 127.7.200.254:36095 was elected leader, sending a full tablet report...
I20260807 04:15:50.359494 9716 ts_tablet_manager.cc:1428] T 61ec1f112e584e0cb48c03f462cd7920 P 4d914a49cb2d4a4788f5ff49dcd78508: Time spent starting tablet: real 0.016s user 0.009s sys 0.007s
W20260807 04:15:50.363358 9550 tablet.cc:2369] T 61ec1f112e584e0cb48c03f462cd7920 P 044090eb74d94af397c391808cf14c3a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 04:15:50.446712 9696 tablet.cc:2369] T 61ec1f112e584e0cb48c03f462cd7920 P 4d914a49cb2d4a4788f5ff49dcd78508: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:15:50.524407 9721 raft_consensus.cc:482] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:15:50.524695 9721 raft_consensus.cc:504] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } }
I20260807 04:15:50.526683 9721 leader_election.cc:288] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d914a49cb2d4a4788f5ff49dcd78508 (127.7.200.195:37487), 044090eb74d94af397c391808cf14c3a (127.7.200.194:45357)
I20260807 04:15:50.533998 9712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:50.527189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:52881 (local address 127.7.200.194:45357)
0807 04:15:50.527422 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:50.527432 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:50.528281 (+ 849us) server_negotiation.cc:407] Connection header received
0807 04:15:50.528502 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:50.528506 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:50.528563 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:50.528667 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:15:50.529394 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.530115 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.532066 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.532942 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.533149 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:50.533230 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:50.533575 (+ 345us) server_negotiation.cc:299] Negotiation successful
0807 04:15:50.533711 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 04:15:50.533995 9711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:50.527064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:49725 (local address 127.7.200.195:37487)
0807 04:15:50.527297 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:50.527303 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:50.528182 (+ 879us) server_negotiation.cc:407] Connection header received
0807 04:15:50.528430 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:50.528434 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:50.528499 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:50.528606 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:15:50.529323 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.530087 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.532084 (+ 1997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.532969 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.533166 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:50.533252 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:50.533575 (+ 323us) server_negotiation.cc:299] Negotiation successful
0807 04:15:50.533716 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 04:15:50.534190 9725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:50.527202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:45357 (local address 127.7.200.193:52881)
0807 04:15:50.528160 (+ 958us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:50.528174 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:50.528340 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:50.528679 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:50.528684 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:50.528720 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:15:50.529221 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:50.529230 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.530256 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.530261 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:50.531905 (+ 1644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:50.531917 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.533177 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.533183 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:50.533348 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:50.533429 (+ 81us) client_negotiation.cc:769] Sending connection context
0807 04:15:50.533545 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 04:15:50.533695 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":832,"mutex_wait_us":75,"thread_start_us":533,"threads_started":1}
I20260807 04:15:50.534267 9724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:50.527164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:37487 (local address 127.7.200.193:49725)
0807 04:15:50.528051 (+ 887us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:50.528068 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:50.528266 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:50.528627 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:50.528632 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:50.528655 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:15:50.529160 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:50.529170 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.530232 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.530240 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:50.531917 (+ 1677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:50.531930 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.533224 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.533230 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:50.533401 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:50.533431 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 04:15:50.533545 (+ 114us) client_negotiation.cc:240] Negotiation successful
0807 04:15:50.533695 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":753,"mutex_wait_us":8,"thread_start_us":526,"threads_started":1}
I20260807 04:15:50.535315 9646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61ec1f112e584e0cb48c03f462cd7920" candidate_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" is_pre_election: true
I20260807 04:15:50.535319 9495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61ec1f112e584e0cb48c03f462cd7920" candidate_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "044090eb74d94af397c391808cf14c3a" is_pre_election: true
I20260807 04:15:50.535878 9646 raft_consensus.cc:2454] T 61ec1f112e584e0cb48c03f462cd7920 P 4d914a49cb2d4a4788f5ff49dcd78508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ea9c9a2efdb4d76bde192d713e503a0 in term 0.
I20260807 04:15:50.535877 9495 raft_consensus.cc:2454] T 61ec1f112e584e0cb48c03f462cd7920 P 044090eb74d94af397c391808cf14c3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ea9c9a2efdb4d76bde192d713e503a0 in term 0.
I20260807 04:15:50.536638 9273 leader_election.cc:302] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 044090eb74d94af397c391808cf14c3a, 4ea9c9a2efdb4d76bde192d713e503a0; no voters:
I20260807 04:15:50.537125 9721 raft_consensus.cc:2781] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:15:50.537289 9721 raft_consensus.cc:482] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:15:50.537387 9721 raft_consensus.cc:3037] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:50.539683 9721 raft_consensus.cc:504] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } }
I20260807 04:15:50.540386 9721 leader_election.cc:288] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0 [CANDIDATE]: Term 1 election: Requested vote from peers 4d914a49cb2d4a4788f5ff49dcd78508 (127.7.200.195:37487), 044090eb74d94af397c391808cf14c3a (127.7.200.194:45357)
I20260807 04:15:50.540802 9646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61ec1f112e584e0cb48c03f462cd7920" candidate_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d914a49cb2d4a4788f5ff49dcd78508"
I20260807 04:15:50.540925 9495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61ec1f112e584e0cb48c03f462cd7920" candidate_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "044090eb74d94af397c391808cf14c3a"
I20260807 04:15:50.541024 9646 raft_consensus.cc:3037] T 61ec1f112e584e0cb48c03f462cd7920 P 4d914a49cb2d4a4788f5ff49dcd78508 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:50.541172 9495 raft_consensus.cc:3037] T 61ec1f112e584e0cb48c03f462cd7920 P 044090eb74d94af397c391808cf14c3a [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:50.543330 9646 raft_consensus.cc:2454] T 61ec1f112e584e0cb48c03f462cd7920 P 4d914a49cb2d4a4788f5ff49dcd78508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ea9c9a2efdb4d76bde192d713e503a0 in term 1.
I20260807 04:15:50.543371 9495 raft_consensus.cc:2454] T 61ec1f112e584e0cb48c03f462cd7920 P 044090eb74d94af397c391808cf14c3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ea9c9a2efdb4d76bde192d713e503a0 in term 1.
I20260807 04:15:50.543766 9273 leader_election.cc:302] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 044090eb74d94af397c391808cf14c3a, 4ea9c9a2efdb4d76bde192d713e503a0; no voters:
I20260807 04:15:50.544057 9721 raft_consensus.cc:2781] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:15:50.544548 9721 raft_consensus.cc:686] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0 [term 1 LEADER]: Becoming Leader. State: Replica: 4ea9c9a2efdb4d76bde192d713e503a0, State: Running, Role: LEADER
I20260807 04:15:50.545061 9721 consensus_queue.cc:237] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } }
W20260807 04:15:50.545825 9401 tablet.cc:2369] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:15:50.549918 9175 catalog_manager.cc:5495] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ea9c9a2efdb4d76bde192d713e503a0 (127.7.200.193). New cstate: current_term: 1 leader_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } health_report { overall_health: UNKNOWN } } }
I20260807 04:15:50.614499 9710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:50.607958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46046 (local address 127.7.200.193:40231)
0807 04:15:50.608230 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:50.608236 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:50.608260 (+ 24us) server_negotiation.cc:407] Connection header received
0807 04:15:50.608661 (+ 401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:50.608666 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:50.608828 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:50.609003 (+ 175us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:15:50.609422 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.610164 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.611640 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.612313 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.612457 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:50.613264 (+ 807us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:15:50.613836 (+ 572us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:15:50.613944 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:50.614113 (+ 169us) server_negotiation.cc:299] Negotiation successful
0807 04:15:50.614195 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260807 04:15:50.624027 9495 raft_consensus.cc:1261] T 61ec1f112e584e0cb48c03f462cd7920 P 044090eb74d94af397c391808cf14c3a [term 1 FOLLOWER]: Refusing update from remote peer 4ea9c9a2efdb4d76bde192d713e503a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:15:50.624116 9646 raft_consensus.cc:1261] T 61ec1f112e584e0cb48c03f462cd7920 P 4d914a49cb2d4a4788f5ff49dcd78508 [term 1 FOLLOWER]: Refusing update from remote peer 4ea9c9a2efdb4d76bde192d713e503a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:15:50.625308 9726 consensus_queue.cc:1035] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:15:50.625784 9721 consensus_queue.cc:1035] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:15:50.659312 9175 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37970:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:15:50.659688 9175 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37970:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:15:50.663882 9175 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 14722d342fe146b69606fcfd6c95dbda: Sending DeleteTablet for 3 replicas of tablet 61ec1f112e584e0cb48c03f462cd7920
I20260807 04:15:50.665261 9622 tablet_service.cc:1514] Processing DeleteTablet for tablet 61ec1f112e584e0cb48c03f462cd7920 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:15:50 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:56798
I20260807 04:15:50.665254 9473 tablet_service.cc:1514] Processing DeleteTablet for tablet 61ec1f112e584e0cb48c03f462cd7920 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:15:50 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:38240
I20260807 04:15:50.665239 9323 tablet_service.cc:1514] Processing DeleteTablet for tablet 61ec1f112e584e0cb48c03f462cd7920 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:15:50 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:46040
I20260807 04:15:50.666221 9739 tablet_replica.cc:330] T 61ec1f112e584e0cb48c03f462cd7920 P 4d914a49cb2d4a4788f5ff49dcd78508: stopping tablet replica
I20260807 04:15:50.666810 9739 raft_consensus.cc:2229] T 61ec1f112e584e0cb48c03f462cd7920 P 4d914a49cb2d4a4788f5ff49dcd78508 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:15:50.667379 9739 raft_consensus.cc:2258] T 61ec1f112e584e0cb48c03f462cd7920 P 4d914a49cb2d4a4788f5ff49dcd78508 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:15:50.669840 9175 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37970:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 04:15:50.670418 9739 ts_tablet_manager.cc:1905] T 61ec1f112e584e0cb48c03f462cd7920 P 4d914a49cb2d4a4788f5ff49dcd78508: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:15:50.673014 9741 tablet_replica.cc:330] T 61ec1f112e584e0cb48c03f462cd7920 P 044090eb74d94af397c391808cf14c3a: stopping tablet replica
W20260807 04:15:50.671229 9175 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:15:50.673614 9741 raft_consensus.cc:2229] T 61ec1f112e584e0cb48c03f462cd7920 P 044090eb74d94af397c391808cf14c3a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:15:50.674152 9741 raft_consensus.cc:2258] T 61ec1f112e584e0cb48c03f462cd7920 P 044090eb74d94af397c391808cf14c3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:15:50.678092 9739 ts_tablet_manager.cc:1918] T 61ec1f112e584e0cb48c03f462cd7920 P 4d914a49cb2d4a4788f5ff49dcd78508: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:15:50.678313 9739 log.cc:1196] T 61ec1f112e584e0cb48c03f462cd7920 P 4d914a49cb2d4a4788f5ff49dcd78508: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-2/wal/wals/61ec1f112e584e0cb48c03f462cd7920
I20260807 04:15:50.678920 9739 ts_tablet_manager.cc:1939] T 61ec1f112e584e0cb48c03f462cd7920 P 4d914a49cb2d4a4788f5ff49dcd78508: Deleting consensus metadata
I20260807 04:15:50.681727 9160 catalog_manager.cc:4841] TS 4d914a49cb2d4a4788f5ff49dcd78508 (127.7.200.195:37487): tablet 61ec1f112e584e0cb48c03f462cd7920 (table test-table [id=a755715211be4275907ed9da276d0ec3]) successfully deleted
I20260807 04:15:50.683553 9740 tablet_replica.cc:330] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0: stopping tablet replica
I20260807 04:15:50.684099 9740 raft_consensus.cc:2229] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0 [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:15:50.684937 9740 raft_consensus.cc:2258] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:15:50.685067 9322 tablet_service.cc:1467] Processing CreateTablet for tablet 710ae91073d848ee9204c0b9bf5c578b (DEFAULT_TABLE table=test-table [id=389890ee771140f0a5b97426dd6253c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:15:50.685693 9322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 710ae91073d848ee9204c0b9bf5c578b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:50.685714 9473 tablet_service.cc:1467] Processing CreateTablet for tablet 710ae91073d848ee9204c0b9bf5c578b (DEFAULT_TABLE table=test-table [id=389890ee771140f0a5b97426dd6253c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:15:50.686208 9473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 710ae91073d848ee9204c0b9bf5c578b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:50.686144 9622 tablet_service.cc:1467] Processing CreateTablet for tablet 710ae91073d848ee9204c0b9bf5c578b (DEFAULT_TABLE table=test-table [id=389890ee771140f0a5b97426dd6253c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:15:50.686550 9622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 710ae91073d848ee9204c0b9bf5c578b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:50.687186 9741 ts_tablet_manager.cc:1905] T 61ec1f112e584e0cb48c03f462cd7920 P 044090eb74d94af397c391808cf14c3a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:15:50.693636 9715 tablet_bootstrap.cc:492] T 710ae91073d848ee9204c0b9bf5c578b P 044090eb74d94af397c391808cf14c3a: Bootstrap starting.
I20260807 04:15:50.693933 9716 tablet_bootstrap.cc:492] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508: Bootstrap starting.
I20260807 04:15:50.694512 9740 ts_tablet_manager.cc:1905] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:15:50.695114 9741 ts_tablet_manager.cc:1918] T 61ec1f112e584e0cb48c03f462cd7920 P 044090eb74d94af397c391808cf14c3a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:15:50.695288 9741 log.cc:1196] T 61ec1f112e584e0cb48c03f462cd7920 P 044090eb74d94af397c391808cf14c3a: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-1/wal/wals/61ec1f112e584e0cb48c03f462cd7920
I20260807 04:15:50.695566 9716 tablet_bootstrap.cc:654] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:50.695569 9715 tablet_bootstrap.cc:654] T 710ae91073d848ee9204c0b9bf5c578b P 044090eb74d94af397c391808cf14c3a: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:50.698189 9714 tablet_bootstrap.cc:492] T 710ae91073d848ee9204c0b9bf5c578b P 4ea9c9a2efdb4d76bde192d713e503a0: Bootstrap starting.
I20260807 04:15:50.700341 9714 tablet_bootstrap.cc:654] T 710ae91073d848ee9204c0b9bf5c578b P 4ea9c9a2efdb4d76bde192d713e503a0: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:50.703715 9740 ts_tablet_manager.cc:1918] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:15:50.703991 9740 log.cc:1196] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-0/wal/wals/61ec1f112e584e0cb48c03f462cd7920
I20260807 04:15:50.704452 9741 ts_tablet_manager.cc:1939] T 61ec1f112e584e0cb48c03f462cd7920 P 044090eb74d94af397c391808cf14c3a: Deleting consensus metadata
I20260807 04:15:50.704633 9740 ts_tablet_manager.cc:1939] T 61ec1f112e584e0cb48c03f462cd7920 P 4ea9c9a2efdb4d76bde192d713e503a0: Deleting consensus metadata
I20260807 04:15:50.706743 9159 catalog_manager.cc:4841] TS 4ea9c9a2efdb4d76bde192d713e503a0 (127.7.200.193:40231): tablet 61ec1f112e584e0cb48c03f462cd7920 (table test-table [id=a755715211be4275907ed9da276d0ec3]) successfully deleted
I20260807 04:15:50.706830 9162 catalog_manager.cc:4841] TS 044090eb74d94af397c391808cf14c3a (127.7.200.194:45357): tablet 61ec1f112e584e0cb48c03f462cd7920 (table test-table [id=a755715211be4275907ed9da276d0ec3]) successfully deleted
I20260807 04:15:50.708186 9714 tablet_bootstrap.cc:492] T 710ae91073d848ee9204c0b9bf5c578b P 4ea9c9a2efdb4d76bde192d713e503a0: No bootstrap required, opened a new log
I20260807 04:15:50.708400 9714 ts_tablet_manager.cc:1397] T 710ae91073d848ee9204c0b9bf5c578b P 4ea9c9a2efdb4d76bde192d713e503a0: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260807 04:15:50.709599 9716 tablet_bootstrap.cc:492] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508: No bootstrap required, opened a new log
I20260807 04:15:50.709465 9714 raft_consensus.cc:348] T 710ae91073d848ee9204c0b9bf5c578b P 4ea9c9a2efdb4d76bde192d713e503a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } }
I20260807 04:15:50.709712 9714 raft_consensus.cc:374] T 710ae91073d848ee9204c0b9bf5c578b P 4ea9c9a2efdb4d76bde192d713e503a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:50.710139 9714 raft_consensus.cc:729] T 710ae91073d848ee9204c0b9bf5c578b P 4ea9c9a2efdb4d76bde192d713e503a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ea9c9a2efdb4d76bde192d713e503a0, State: Initialized, Role: FOLLOWER
I20260807 04:15:50.710461 9714 consensus_queue.cc:260] T 710ae91073d848ee9204c0b9bf5c578b P 4ea9c9a2efdb4d76bde192d713e503a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } }
I20260807 04:15:50.711287 9714 ts_tablet_manager.cc:1428] T 710ae91073d848ee9204c0b9bf5c578b P 4ea9c9a2efdb4d76bde192d713e503a0: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260807 04:15:50.709962 9716 ts_tablet_manager.cc:1397] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.010s
I20260807 04:15:50.714335 9716 raft_consensus.cc:348] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } }
I20260807 04:15:50.714762 9716 raft_consensus.cc:374] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:50.714936 9716 raft_consensus.cc:729] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d914a49cb2d4a4788f5ff49dcd78508, State: Initialized, Role: FOLLOWER
I20260807 04:15:50.715384 9716 consensus_queue.cc:260] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } }
I20260807 04:15:50.717499 9716 ts_tablet_manager.cc:1428] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260807 04:15:50.719301 9715 tablet_bootstrap.cc:492] T 710ae91073d848ee9204c0b9bf5c578b P 044090eb74d94af397c391808cf14c3a: No bootstrap required, opened a new log
I20260807 04:15:50.719478 9715 ts_tablet_manager.cc:1397] T 710ae91073d848ee9204c0b9bf5c578b P 044090eb74d94af397c391808cf14c3a: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.020s
I20260807 04:15:50.720343 9715 raft_consensus.cc:348] T 710ae91073d848ee9204c0b9bf5c578b P 044090eb74d94af397c391808cf14c3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } }
I20260807 04:15:50.720594 9715 raft_consensus.cc:374] T 710ae91073d848ee9204c0b9bf5c578b P 044090eb74d94af397c391808cf14c3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:50.720804 9715 raft_consensus.cc:729] T 710ae91073d848ee9204c0b9bf5c578b P 044090eb74d94af397c391808cf14c3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 044090eb74d94af397c391808cf14c3a, State: Initialized, Role: FOLLOWER
I20260807 04:15:50.721091 9715 consensus_queue.cc:260] T 710ae91073d848ee9204c0b9bf5c578b P 044090eb74d94af397c391808cf14c3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } }
I20260807 04:15:50.721743 9715 ts_tablet_manager.cc:1428] T 710ae91073d848ee9204c0b9bf5c578b P 044090eb74d94af397c391808cf14c3a: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 04:15:50.856000 9723 raft_consensus.cc:482] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:15:50.856325 9723 raft_consensus.cc:504] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } }
I20260807 04:15:50.858331 9723 leader_election.cc:288] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ea9c9a2efdb4d76bde192d713e503a0 (127.7.200.193:40231), 044090eb74d94af397c391808cf14c3a (127.7.200.194:45357)
I20260807 04:15:50.867949 9712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:50.859828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:53139 (local address 127.7.200.194:45357)
0807 04:15:50.860162 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:50.860168 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:50.860840 (+ 672us) server_negotiation.cc:407] Connection header received
0807 04:15:50.861018 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:50.861022 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:50.861104 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:50.861189 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:15:50.862027 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.863295 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.865789 (+ 2494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.866805 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.867014 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:50.867099 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:50.867449 (+ 350us) server_negotiation.cc:299] Negotiation successful
0807 04:15:50.867593 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212}
I20260807 04:15:50.868036 9746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:50.858737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:45357 (local address 127.7.200.195:53139)
0807 04:15:50.860709 (+ 1972us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:50.860747 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:50.860880 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:50.861367 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:50.861373 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:50.861401 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:15:50.861765 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:50.861776 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.863461 (+ 1685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.863467 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:50.865600 (+ 2133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:50.865615 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.867026 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.867033 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:50.867261 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:50.867288 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 04:15:50.867414 (+ 126us) client_negotiation.cc:240] Negotiation successful
0807 04:15:50.867563 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1847,"mutex_wait_us":25,"thread_start_us":1679,"threads_started":1}
I20260807 04:15:50.868513 9710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:50.859175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:49473 (local address 127.7.200.193:40231)
0807 04:15:50.859455 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:50.859465 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:50.860418 (+ 953us) server_negotiation.cc:407] Connection header received
0807 04:15:50.860752 (+ 334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:50.860759 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:50.860884 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:50.860995 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:15:50.861525 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.863024 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.865876 (+ 2852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.867213 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.867343 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:50.867427 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:50.868046 (+ 619us) server_negotiation.cc:299] Negotiation successful
0807 04:15:50.868197 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260807 04:15:50.869218 9495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "710ae91073d848ee9204c0b9bf5c578b" candidate_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "044090eb74d94af397c391808cf14c3a" is_pre_election: true
I20260807 04:15:50.869329 9745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:50.858667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:40231 (local address 127.7.200.195:49473)
0807 04:15:50.860310 (+ 1643us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:50.860332 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:50.860561 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:50.861063 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:50.861068 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:50.861093 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:15:50.861346 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:50.861355 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.863197 (+ 1842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.863202 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:50.865655 (+ 2453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:50.865671 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.867640 (+ 1969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.867646 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:50.867842 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:50.867874 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 04:15:50.868707 (+ 833us) client_negotiation.cc:240] Negotiation successful
0807 04:15:50.868918 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1497,"mutex_wait_us":7,"thread_start_us":1354,"threads_started":1}
I20260807 04:15:50.869539 9495 raft_consensus.cc:2454] T 710ae91073d848ee9204c0b9bf5c578b P 044090eb74d94af397c391808cf14c3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d914a49cb2d4a4788f5ff49dcd78508 in term 0.
I20260807 04:15:50.870182 9574 leader_election.cc:302] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 044090eb74d94af397c391808cf14c3a, 4d914a49cb2d4a4788f5ff49dcd78508; no voters:
I20260807 04:15:50.870642 9723 raft_consensus.cc:2781] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:15:50.870767 9723 raft_consensus.cc:482] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:15:50.870853 9723 raft_consensus.cc:3037] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:50.870801 9345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "710ae91073d848ee9204c0b9bf5c578b" candidate_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" is_pre_election: true
I20260807 04:15:50.871338 9345 raft_consensus.cc:2454] T 710ae91073d848ee9204c0b9bf5c578b P 4ea9c9a2efdb4d76bde192d713e503a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d914a49cb2d4a4788f5ff49dcd78508 in term 0.
I20260807 04:15:50.874153 9723 raft_consensus.cc:504] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } }
I20260807 04:15:50.874922 9723 leader_election.cc:288] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508 [CANDIDATE]: Term 1 election: Requested vote from peers 4ea9c9a2efdb4d76bde192d713e503a0 (127.7.200.193:40231), 044090eb74d94af397c391808cf14c3a (127.7.200.194:45357)
I20260807 04:15:50.875442 9345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "710ae91073d848ee9204c0b9bf5c578b" candidate_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ea9c9a2efdb4d76bde192d713e503a0"
I20260807 04:15:50.875521 9495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "710ae91073d848ee9204c0b9bf5c578b" candidate_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "044090eb74d94af397c391808cf14c3a"
I20260807 04:15:50.875658 9345 raft_consensus.cc:3037] T 710ae91073d848ee9204c0b9bf5c578b P 4ea9c9a2efdb4d76bde192d713e503a0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:50.875782 9495 raft_consensus.cc:3037] T 710ae91073d848ee9204c0b9bf5c578b P 044090eb74d94af397c391808cf14c3a [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:50.878041 9495 raft_consensus.cc:2454] T 710ae91073d848ee9204c0b9bf5c578b P 044090eb74d94af397c391808cf14c3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d914a49cb2d4a4788f5ff49dcd78508 in term 1.
I20260807 04:15:50.878490 9574 leader_election.cc:302] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 044090eb74d94af397c391808cf14c3a, 4d914a49cb2d4a4788f5ff49dcd78508; no voters:
I20260807 04:15:50.878839 9723 raft_consensus.cc:2781] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:15:50.878988 9345 raft_consensus.cc:2454] T 710ae91073d848ee9204c0b9bf5c578b P 4ea9c9a2efdb4d76bde192d713e503a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d914a49cb2d4a4788f5ff49dcd78508 in term 1.
I20260807 04:15:50.879403 9723 raft_consensus.cc:686] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508 [term 1 LEADER]: Becoming Leader. State: Replica: 4d914a49cb2d4a4788f5ff49dcd78508, State: Running, Role: LEADER
I20260807 04:15:50.880069 9723 consensus_queue.cc:237] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } }
I20260807 04:15:50.883713 9176 catalog_manager.cc:5495] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d914a49cb2d4a4788f5ff49dcd78508 (127.7.200.195). New cstate: current_term: 1 leader_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } health_report { overall_health: HEALTHY } } }
Aug 07 04:15:50 dist-test-slave-qg60 krb5kdc[9129](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076148, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:15:50.955513 9755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:50.939296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37982 (local address 127.7.200.254:36095)
0807 04:15:50.939981 (+ 685us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:50.939985 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:50.940410 (+ 425us) server_negotiation.cc:407] Connection header received
0807 04:15:50.940634 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:50.940638 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:50.940693 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:50.940834 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:50.942362 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.943112 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.944994 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.945433 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.945537 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:50.949891 (+ 4354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:50.949896 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:50.949899 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:50.949930 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:50.952673 (+ 2743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:50.953440 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:50.953446 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:50.953449 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:50.953573 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:50.953957 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:50.953963 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:50.953966 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:50.954229 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:50.954419 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:50.954819 (+ 400us) server_negotiation.cc:299] Negotiation successful
0807 04:15:50.955077 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":567,"thread_start_us":411,"threads_started":1}
I20260807 04:15:50.955602 9756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:50.939296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:36095 (local address 127.0.0.1:37982)
0807 04:15:50.940294 (+ 998us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:50.940309 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:50.940492 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:50.940911 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:50.940917 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:50.941861 (+ 944us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:15:50.942176 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:50.942192 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.943274 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.943282 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:50.944851 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:50.944868 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:50.945648 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:50.945657 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:50.945827 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:50.946585 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:15:50.946609 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:15:50.949685 (+ 3076us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:15:50.952858 (+ 3173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:50.952872 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:50.952879 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:50.953314 (+ 435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:50.953686 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:50.953692 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:50.953695 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:50.953832 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:50.954367 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:15:50.954376 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:15:50.954568 (+ 192us) client_negotiation.cc:769] Sending connection context
0807 04:15:50.954751 (+ 183us) client_negotiation.cc:240] Negotiation successful
0807 04:15:50.955215 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":901,"mutex_wait_us":166,"thread_start_us":798,"threads_started":1}
I20260807 04:15:50.962486 9176 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:37982:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 04:15:50.963609 9176 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:15:50.971428 9622 tablet_service.cc:1467] Processing CreateTablet for tablet af85f272d64a4e4ea5382fa0071b518a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1b71d292d42e4507846e486eab44cd67]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 04:15:50.971396 9322 tablet_service.cc:1467] Processing CreateTablet for tablet af85f272d64a4e4ea5382fa0071b518a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1b71d292d42e4507846e486eab44cd67]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 04:15:50.972012 9622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af85f272d64a4e4ea5382fa0071b518a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:50.972041 9322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af85f272d64a4e4ea5382fa0071b518a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:50.977902 9716 tablet_bootstrap.cc:492] T af85f272d64a4e4ea5382fa0071b518a P 4d914a49cb2d4a4788f5ff49dcd78508: Bootstrap starting.
I20260807 04:15:50.977893 9473 tablet_service.cc:1467] Processing CreateTablet for tablet af85f272d64a4e4ea5382fa0071b518a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1b71d292d42e4507846e486eab44cd67]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 04:15:50.978490 9473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet af85f272d64a4e4ea5382fa0071b518a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:50.979785 9716 tablet_bootstrap.cc:654] T af85f272d64a4e4ea5382fa0071b518a P 4d914a49cb2d4a4788f5ff49dcd78508: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:50.980423 9714 tablet_bootstrap.cc:492] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0: Bootstrap starting.
I20260807 04:15:50.982494 9714 tablet_bootstrap.cc:654] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:50.991039 9714 tablet_bootstrap.cc:492] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0: No bootstrap required, opened a new log
I20260807 04:15:50.991081 9715 tablet_bootstrap.cc:492] T af85f272d64a4e4ea5382fa0071b518a P 044090eb74d94af397c391808cf14c3a: Bootstrap starting.
I20260807 04:15:50.991291 9714 ts_tablet_manager.cc:1397] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.004s
I20260807 04:15:50.992197 9714 raft_consensus.cc:348] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } }
I20260807 04:15:50.992522 9716 tablet_bootstrap.cc:492] T af85f272d64a4e4ea5382fa0071b518a P 4d914a49cb2d4a4788f5ff49dcd78508: No bootstrap required, opened a new log
I20260807 04:15:50.992491 9714 raft_consensus.cc:374] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:50.992594 9714 raft_consensus.cc:729] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ea9c9a2efdb4d76bde192d713e503a0, State: Initialized, Role: FOLLOWER
I20260807 04:15:50.993011 9715 tablet_bootstrap.cc:654] T af85f272d64a4e4ea5382fa0071b518a P 044090eb74d94af397c391808cf14c3a: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:50.992880 9714 consensus_queue.cc:260] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } }
I20260807 04:15:50.993577 9714 ts_tablet_manager.cc:1428] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 04:15:50.992707 9716 ts_tablet_manager.cc:1397] T af85f272d64a4e4ea5382fa0071b518a P 4d914a49cb2d4a4788f5ff49dcd78508: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.005s
I20260807 04:15:50.994239 9726 tablet_replica.cc:439] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } } }
I20260807 04:15:50.994614 9726 tablet_replica.cc:442] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:15:50.994545 9716 raft_consensus.cc:348] T af85f272d64a4e4ea5382fa0071b518a P 4d914a49cb2d4a4788f5ff49dcd78508 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } }
I20260807 04:15:50.994846 9716 raft_consensus.cc:374] T af85f272d64a4e4ea5382fa0071b518a P 4d914a49cb2d4a4788f5ff49dcd78508 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:50.994963 9716 raft_consensus.cc:729] T af85f272d64a4e4ea5382fa0071b518a P 4d914a49cb2d4a4788f5ff49dcd78508 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d914a49cb2d4a4788f5ff49dcd78508, State: Initialized, Role: FOLLOWER
I20260807 04:15:50.995246 9716 consensus_queue.cc:260] T af85f272d64a4e4ea5382fa0071b518a P 4d914a49cb2d4a4788f5ff49dcd78508 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } }
I20260807 04:15:50.995759 9723 tablet_replica.cc:439] T af85f272d64a4e4ea5382fa0071b518a P 4d914a49cb2d4a4788f5ff49dcd78508: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } } }
I20260807 04:15:50.996054 9723 tablet_replica.cc:442] T af85f272d64a4e4ea5382fa0071b518a P 4d914a49cb2d4a4788f5ff49dcd78508: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:15:50.996572 9716 ts_tablet_manager.cc:1428] T af85f272d64a4e4ea5382fa0071b518a P 4d914a49cb2d4a4788f5ff49dcd78508: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260807 04:15:51.000479 9715 tablet_bootstrap.cc:492] T af85f272d64a4e4ea5382fa0071b518a P 044090eb74d94af397c391808cf14c3a: No bootstrap required, opened a new log
I20260807 04:15:51.000690 9715 ts_tablet_manager.cc:1397] T af85f272d64a4e4ea5382fa0071b518a P 044090eb74d94af397c391808cf14c3a: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.003s
I20260807 04:15:51.001573 9715 raft_consensus.cc:348] T af85f272d64a4e4ea5382fa0071b518a P 044090eb74d94af397c391808cf14c3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } }
I20260807 04:15:51.001857 9715 raft_consensus.cc:374] T af85f272d64a4e4ea5382fa0071b518a P 044090eb74d94af397c391808cf14c3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:51.001962 9715 raft_consensus.cc:729] T af85f272d64a4e4ea5382fa0071b518a P 044090eb74d94af397c391808cf14c3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 044090eb74d94af397c391808cf14c3a, State: Initialized, Role: FOLLOWER
I20260807 04:15:51.002254 9715 consensus_queue.cc:260] T af85f272d64a4e4ea5382fa0071b518a P 044090eb74d94af397c391808cf14c3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } }
I20260807 04:15:51.002859 9722 tablet_replica.cc:439] T af85f272d64a4e4ea5382fa0071b518a P 044090eb74d94af397c391808cf14c3a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } } }
I20260807 04:15:51.003304 9722 tablet_replica.cc:442] T af85f272d64a4e4ea5382fa0071b518a P 044090eb74d94af397c391808cf14c3a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:15:51.004155 9715 ts_tablet_manager.cc:1428] T af85f272d64a4e4ea5382fa0071b518a P 044090eb74d94af397c391808cf14c3a: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 04:15:51.041715 9726 raft_consensus.cc:482] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:15:51.041946 9726 raft_consensus.cc:504] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } }
I20260807 04:15:51.042804 9726 leader_election.cc:288] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 044090eb74d94af397c391808cf14c3a (127.7.200.194:45357), 4d914a49cb2d4a4788f5ff49dcd78508 (127.7.200.195:37487)
I20260807 04:15:51.043318 9495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af85f272d64a4e4ea5382fa0071b518a" candidate_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "044090eb74d94af397c391808cf14c3a" is_pre_election: true
I20260807 04:15:51.043614 9495 raft_consensus.cc:2454] T af85f272d64a4e4ea5382fa0071b518a P 044090eb74d94af397c391808cf14c3a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ea9c9a2efdb4d76bde192d713e503a0 in term 0.
I20260807 04:15:51.043694 9646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af85f272d64a4e4ea5382fa0071b518a" candidate_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" is_pre_election: true
I20260807 04:15:51.043978 9646 raft_consensus.cc:2454] T af85f272d64a4e4ea5382fa0071b518a P 4d914a49cb2d4a4788f5ff49dcd78508 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ea9c9a2efdb4d76bde192d713e503a0 in term 0.
I20260807 04:15:51.044173 9273 leader_election.cc:302] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 044090eb74d94af397c391808cf14c3a, 4ea9c9a2efdb4d76bde192d713e503a0; no voters:
I20260807 04:15:51.044482 9726 raft_consensus.cc:2781] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:15:51.044584 9726 raft_consensus.cc:482] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:15:51.044682 9726 raft_consensus.cc:3037] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:51.047979 9726 raft_consensus.cc:504] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } }
I20260807 04:15:51.048619 9726 leader_election.cc:288] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0 [CANDIDATE]: Term 1 election: Requested vote from peers 044090eb74d94af397c391808cf14c3a (127.7.200.194:45357), 4d914a49cb2d4a4788f5ff49dcd78508 (127.7.200.195:37487)
I20260807 04:15:51.049427 9495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af85f272d64a4e4ea5382fa0071b518a" candidate_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "044090eb74d94af397c391808cf14c3a"
I20260807 04:15:51.049691 9495 raft_consensus.cc:3037] T af85f272d64a4e4ea5382fa0071b518a P 044090eb74d94af397c391808cf14c3a [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:51.050457 9646 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "af85f272d64a4e4ea5382fa0071b518a" candidate_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d914a49cb2d4a4788f5ff49dcd78508"
I20260807 04:15:51.050697 9646 raft_consensus.cc:3037] T af85f272d64a4e4ea5382fa0071b518a P 4d914a49cb2d4a4788f5ff49dcd78508 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:51.053304 9495 raft_consensus.cc:2454] T af85f272d64a4e4ea5382fa0071b518a P 044090eb74d94af397c391808cf14c3a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ea9c9a2efdb4d76bde192d713e503a0 in term 1.
I20260807 04:15:51.053597 9646 raft_consensus.cc:2454] T af85f272d64a4e4ea5382fa0071b518a P 4d914a49cb2d4a4788f5ff49dcd78508 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ea9c9a2efdb4d76bde192d713e503a0 in term 1.
I20260807 04:15:51.053784 9273 leader_election.cc:302] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 044090eb74d94af397c391808cf14c3a, 4ea9c9a2efdb4d76bde192d713e503a0; no voters:
I20260807 04:15:51.054260 9726 raft_consensus.cc:2781] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:15:51.054652 9726 raft_consensus.cc:686] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0 [term 1 LEADER]: Becoming Leader. State: Replica: 4ea9c9a2efdb4d76bde192d713e503a0, State: Running, Role: LEADER
I20260807 04:15:51.054993 9726 consensus_queue.cc:237] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } }
I20260807 04:15:51.057595 9735 tablet_replica.cc:439] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0: TxnStatusTablet state changed. Reason: New leader 4ea9c9a2efdb4d76bde192d713e503a0. Latest consensus state: current_term: 1 leader_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } } }
I20260807 04:15:51.058097 9735 tablet_replica.cc:442] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0: This TxnStatusTablet replica's current role is: LEADER
I20260807 04:15:51.059032 9174 catalog_manager.cc:5495] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ea9c9a2efdb4d76bde192d713e503a0 (127.7.200.193). New cstate: current_term: 1 leader_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } health_report { overall_health: UNKNOWN } } }
I20260807 04:15:51.060072 9761 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 04:15:51.060451 9761 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 04:15:51.081370 9756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:51.075430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:40231 (local address 127.0.0.1:46048)
0807 04:15:51.075679 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:51.075695 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:51.075804 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:51.076196 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:51.076199 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:51.076209 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 04:15:51.076369 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:51.076376 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:51.077956 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:51.077962 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:51.079035 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:51.079050 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:51.080123 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:51.080128 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:51.080295 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:51.080357 (+ 62us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 04:15:51.080846 (+ 489us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 04:15:51.080868 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 04:15:51.080941 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 04:15:51.081124 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260807 04:15:51.081434 9710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:51.075596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46048 (local address 127.7.200.193:40231)
0807 04:15:51.075796 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:51.075802 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:51.075824 (+ 22us) server_negotiation.cc:407] Connection header received
0807 04:15:51.075951 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:51.075956 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:51.076047 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:51.076192 (+ 145us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:15:51.076520 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:51.077717 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:51.079212 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:51.079941 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:51.080084 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:51.080558 (+ 474us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:15:51.080711 (+ 153us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:15:51.080843 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:51.080967 (+ 124us) server_negotiation.cc:299] Negotiation successful
0807 04:15:51.081062 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 04:15:51.085935 9495 raft_consensus.cc:1261] T af85f272d64a4e4ea5382fa0071b518a P 044090eb74d94af397c391808cf14c3a [term 1 FOLLOWER]: Refusing update from remote peer 4ea9c9a2efdb4d76bde192d713e503a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:15:51.086018 9646 raft_consensus.cc:1261] T af85f272d64a4e4ea5382fa0071b518a P 4d914a49cb2d4a4788f5ff49dcd78508 [term 1 FOLLOWER]: Refusing update from remote peer 4ea9c9a2efdb4d76bde192d713e503a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:15:51.086773 9735 consensus_queue.cc:1035] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:15:51.087179 9726 consensus_queue.cc:1035] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:15:51.090790 9723 tablet_replica.cc:439] T af85f272d64a4e4ea5382fa0071b518a P 4d914a49cb2d4a4788f5ff49dcd78508: TxnStatusTablet state changed. Reason: New leader 4ea9c9a2efdb4d76bde192d713e503a0. Latest consensus state: current_term: 1 leader_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } } }
I20260807 04:15:51.091099 9723 tablet_replica.cc:442] T af85f272d64a4e4ea5382fa0071b518a P 4d914a49cb2d4a4788f5ff49dcd78508: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:15:51.092700 9722 tablet_replica.cc:439] T af85f272d64a4e4ea5382fa0071b518a P 044090eb74d94af397c391808cf14c3a: TxnStatusTablet state changed. Reason: New leader 4ea9c9a2efdb4d76bde192d713e503a0. Latest consensus state: current_term: 1 leader_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } } }
I20260807 04:15:51.093047 9722 tablet_replica.cc:442] T af85f272d64a4e4ea5382fa0071b518a P 044090eb74d94af397c391808cf14c3a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:15:51.093598 9735 tablet_replica.cc:439] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } } }
I20260807 04:15:51.093845 9735 tablet_replica.cc:442] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0: This TxnStatusTablet replica's current role is: LEADER
I20260807 04:15:51.094969 9721 tablet_replica.cc:439] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } } }
I20260807 04:15:51.095309 9721 tablet_replica.cc:442] T af85f272d64a4e4ea5382fa0071b518a P 4ea9c9a2efdb4d76bde192d713e503a0: This TxnStatusTablet replica's current role is: LEADER
I20260807 04:15:51.096223 9729 mvcc.cc:205] Tried to move back new op lower bound from 7315767914840948736 to 7315767914724823040. Current Snapshot: MvccSnapshot[applied={T|T < 7315767914840948736 or (T in {7315767914840948736})}]
I20260807 04:15:51.098850 9722 tablet_replica.cc:439] T af85f272d64a4e4ea5382fa0071b518a P 044090eb74d94af397c391808cf14c3a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } } }
I20260807 04:15:51.099104 9722 tablet_replica.cc:442] T af85f272d64a4e4ea5382fa0071b518a P 044090eb74d94af397c391808cf14c3a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:15:51.101195 9730 mvcc.cc:205] Tried to move back new op lower bound from 7315767914840948736 to 7315767914724823040. Current Snapshot: MvccSnapshot[applied={T|T < 7315767914840948736 or (T in {7315767914840948736})}]
I20260807 04:15:51.101930 9723 tablet_replica.cc:439] T af85f272d64a4e4ea5382fa0071b518a P 4d914a49cb2d4a4788f5ff49dcd78508: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 } } peers { permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 } } peers { permanent_uuid: "4d914a49cb2d4a4788f5ff49dcd78508" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37487 } } }
I20260807 04:15:51.102249 9723 tablet_replica.cc:442] T af85f272d64a4e4ea5382fa0071b518a P 4d914a49cb2d4a4788f5ff49dcd78508: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:15:51.112504 9765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:51.104600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56800 (local address 127.7.200.195:37487)
0807 04:15:51.105493 (+ 893us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:51.105499 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:51.105526 (+ 27us) server_negotiation.cc:407] Connection header received
0807 04:15:51.105635 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:51.105639 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:51.105768 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:51.106472 (+ 704us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:15:51.106648 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:51.107878 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:51.109432 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:51.110135 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:51.110309 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:51.110789 (+ 480us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:15:51.111644 (+ 855us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:15:51.111797 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:51.111940 (+ 143us) server_negotiation.cc:299] Negotiation successful
0807 04:15:51.112034 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":751,"thread_start_us":573,"threads_started":1}
I20260807 04:15:51.130462 9710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:51.123671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:50173 (local address 127.7.200.193:40231)
0807 04:15:51.123959 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:51.123969 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:51.124689 (+ 720us) server_negotiation.cc:407] Connection header received
0807 04:15:51.124918 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:51.124922 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:51.124998 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:51.125114 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:15:51.125699 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:51.126465 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:51.128572 (+ 2107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:51.129143 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:51.129259 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:51.129796 (+ 537us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:15:51.129923 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:15:51.129987 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:51.130158 (+ 171us) server_negotiation.cc:299] Negotiation successful
0807 04:15:51.130226 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260807 04:15:51.130700 9769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:51.123487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:40231 (local address 127.7.200.195:50173)
0807 04:15:51.124563 (+ 1076us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:51.124592 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:51.124781 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:51.125164 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:51.125169 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:51.125183 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 04:15:51.125552 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:51.125565 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:51.126605 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:51.126611 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:51.128409 (+ 1798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:51.128429 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:51.129334 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:51.129341 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:51.129543 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:51.129618 (+ 75us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 04:15:51.130023 (+ 405us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 04:15:51.130043 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 04:15:51.130133 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 04:15:51.130280 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":884,"thread_start_us":709,"threads_started":1}
I20260807 04:15:51.141453 9495 raft_consensus.cc:1261] T 710ae91073d848ee9204c0b9bf5c578b P 044090eb74d94af397c391808cf14c3a [term 1 FOLLOWER]: Refusing update from remote peer 4d914a49cb2d4a4788f5ff49dcd78508: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:15:51.141757 9345 raft_consensus.cc:1261] T 710ae91073d848ee9204c0b9bf5c578b P 4ea9c9a2efdb4d76bde192d713e503a0 [term 1 FOLLOWER]: Refusing update from remote peer 4d914a49cb2d4a4788f5ff49dcd78508: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:15:51.142305 9747 consensus_queue.cc:1035] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "044090eb74d94af397c391808cf14c3a" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:15:51.142762 9723 consensus_queue.cc:1035] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ea9c9a2efdb4d76bde192d713e503a0" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:15:51.183743 9765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:51.176516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:60541 (local address 127.7.200.195:37487)
0807 04:15:51.176680 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:51.176687 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:51.178075 (+ 1388us) server_negotiation.cc:407] Connection header received
0807 04:15:51.178153 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:51.178159 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:51.178241 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:51.178348 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:15:51.178989 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:51.179851 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:51.181591 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:51.182139 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:51.182293 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:51.183006 (+ 713us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:15:51.183121 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:15:51.183223 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:51.183380 (+ 157us) server_negotiation.cc:299] Negotiation successful
0807 04:15:51.183457 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 04:15:51.183938 9773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:51.176631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:37487 (local address 127.7.200.193:60541)
0807 04:15:51.177517 (+ 886us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:51.177537 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:51.177693 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:51.178364 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:51.178369 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:51.178381 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 04:15:51.178812 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:51.178827 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:51.179988 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:51.179995 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:51.181439 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:51.181452 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:51.182490 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:51.182496 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:51.182730 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:51.182805 (+ 75us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 04:15:51.183226 (+ 421us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 04:15:51.183256 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 04:15:51.183362 (+ 106us) client_negotiation.cc:240] Negotiation successful
0807 04:15:51.183507 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":671,"thread_start_us":492,"threads_started":1}
I20260807 04:15:51.250239 9174 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37970:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:15:51.250541 9174 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37970:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:15:51.255119 9174 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 14722d342fe146b69606fcfd6c95dbda: Sending DeleteTablet for 3 replicas of tablet 710ae91073d848ee9204c0b9bf5c578b
I20260807 04:15:51.256542 9322 tablet_service.cc:1514] Processing DeleteTablet for tablet 710ae91073d848ee9204c0b9bf5c578b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:15:51 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:46040
I20260807 04:15:51.257735 9777 tablet_replica.cc:330] T 710ae91073d848ee9204c0b9bf5c578b P 4ea9c9a2efdb4d76bde192d713e503a0: stopping tablet replica
I20260807 04:15:51.257815 9622 tablet_service.cc:1514] Processing DeleteTablet for tablet 710ae91073d848ee9204c0b9bf5c578b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:15:51 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:56798
I20260807 04:15:51.257951 9777 raft_consensus.cc:2229] T 710ae91073d848ee9204c0b9bf5c578b P 4ea9c9a2efdb4d76bde192d713e503a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:15:51.258275 9777 raft_consensus.cc:2258] T 710ae91073d848ee9204c0b9bf5c578b P 4ea9c9a2efdb4d76bde192d713e503a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:15:51.258857 9473 tablet_service.cc:1514] Processing DeleteTablet for tablet 710ae91073d848ee9204c0b9bf5c578b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:15:51 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:38240
I20260807 04:15:51.259505 9777 ts_tablet_manager.cc:1905] T 710ae91073d848ee9204c0b9bf5c578b P 4ea9c9a2efdb4d76bde192d713e503a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:15:51.268083 9777 ts_tablet_manager.cc:1918] T 710ae91073d848ee9204c0b9bf5c578b P 4ea9c9a2efdb4d76bde192d713e503a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 04:15:51.268261 9777 log.cc:1196] T 710ae91073d848ee9204c0b9bf5c578b P 4ea9c9a2efdb4d76bde192d713e503a0: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-0/wal/wals/710ae91073d848ee9204c0b9bf5c578b
I20260807 04:15:51.268918 9777 ts_tablet_manager.cc:1939] T 710ae91073d848ee9204c0b9bf5c578b P 4ea9c9a2efdb4d76bde192d713e503a0: Deleting consensus metadata
I20260807 04:15:51.270212 9159 catalog_manager.cc:4841] TS 4ea9c9a2efdb4d76bde192d713e503a0 (127.7.200.193:40231): tablet 710ae91073d848ee9204c0b9bf5c578b (table test-table [id=389890ee771140f0a5b97426dd6253c8]) successfully deleted
I20260807 04:15:51.273792 9778 tablet_replica.cc:330] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508: stopping tablet replica
I20260807 04:15:51.274462 9779 tablet_replica.cc:330] T 710ae91073d848ee9204c0b9bf5c578b P 044090eb74d94af397c391808cf14c3a: stopping tablet replica
I20260807 04:15:51.274665 9779 raft_consensus.cc:2229] T 710ae91073d848ee9204c0b9bf5c578b P 044090eb74d94af397c391808cf14c3a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:15:51.274024 9778 raft_consensus.cc:2229] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508 [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:15:51.275570 9778 raft_consensus.cc:2258] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:15:51.275784 9779 raft_consensus.cc:2258] T 710ae91073d848ee9204c0b9bf5c578b P 044090eb74d94af397c391808cf14c3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:15:51.277112 9779 ts_tablet_manager.cc:1905] T 710ae91073d848ee9204c0b9bf5c578b P 044090eb74d94af397c391808cf14c3a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:15:51.285050 9779 ts_tablet_manager.cc:1918] T 710ae91073d848ee9204c0b9bf5c578b P 044090eb74d94af397c391808cf14c3a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 04:15:51.285219 9779 log.cc:1196] T 710ae91073d848ee9204c0b9bf5c578b P 044090eb74d94af397c391808cf14c3a: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-1/wal/wals/710ae91073d848ee9204c0b9bf5c578b
I20260807 04:15:51.285691 9779 ts_tablet_manager.cc:1939] T 710ae91073d848ee9204c0b9bf5c578b P 044090eb74d94af397c391808cf14c3a: Deleting consensus metadata
I20260807 04:15:51.286952 9162 catalog_manager.cc:4841] TS 044090eb74d94af397c391808cf14c3a (127.7.200.194:45357): tablet 710ae91073d848ee9204c0b9bf5c578b (table test-table [id=389890ee771140f0a5b97426dd6253c8]) successfully deleted
I20260807 04:15:51.288039 9778 ts_tablet_manager.cc:1905] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 07 04:15:51 dist-test-slave-qg60 krb5kdc[9129](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076150, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.200.193@KRBTEST.COM
I20260807 04:15:51.296198 9778 ts_tablet_manager.cc:1918] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 04:15:51.296357 9778 log.cc:1196] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786076137270840-7971-0/minicluster-data/ts-2/wal/wals/710ae91073d848ee9204c0b9bf5c578b
I20260807 04:15:51.296890 9778 ts_tablet_manager.cc:1939] T 710ae91073d848ee9204c0b9bf5c578b P 4d914a49cb2d4a4788f5ff49dcd78508: Deleting consensus metadata
I20260807 04:15:51.298755 9160 catalog_manager.cc:4841] TS 4d914a49cb2d4a4788f5ff49dcd78508 (127.7.200.195:37487): tablet 710ae91073d848ee9204c0b9bf5c578b (table test-table [id=389890ee771140f0a5b97426dd6253c8]) successfully deleted
I20260807 04:15:51.306929 9710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:51.274710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46052 (local address 127.7.200.193:40231)
0807 04:15:51.274902 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:51.274909 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:51.282648 (+ 7739us) server_negotiation.cc:407] Connection header received
0807 04:15:51.283343 (+ 695us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:51.283350 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:51.283555 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:51.283659 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:51.286401 (+ 2742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:51.287633 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:51.289812 (+ 2179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:51.290548 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:51.290656 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:51.297054 (+ 6398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:51.297075 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:51.297094 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:51.297155 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:51.302618 (+ 5463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:51.303646 (+ 1028us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:51.303657 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:51.303661 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:51.303820 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:51.304386 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:51.304391 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:51.304394 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:51.304946 (+ 552us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:51.305431 (+ 485us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:51.306069 (+ 638us) server_negotiation.cc:299] Negotiation successful
0807 04:15:51.306319 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260807 04:15:51.307807 9394 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46052
I20260807 04:15:51.330210 9755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:51.312469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37990 (local address 127.7.200.254:36095)
0807 04:15:51.312673 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:51.312679 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:51.313319 (+ 640us) server_negotiation.cc:407] Connection header received
0807 04:15:51.313510 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:51.313516 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:51.313604 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:51.313715 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:51.315560 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:51.316789 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:51.318678 (+ 1889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:51.319421 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:51.319557 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:51.322788 (+ 3231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:51.322796 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:51.322801 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:51.322848 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:51.326884 (+ 4036us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:51.327812 (+ 928us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:51.327819 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:51.327824 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:51.327988 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:51.328425 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:51.328430 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:51.328433 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:51.328848 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:51.329151 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:51.329572 (+ 421us) server_negotiation.cc:299] Negotiation successful
0807 04:15:51.329836 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260807 04:15:51.330883 9174 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37990
I20260807 04:15:51.333223 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 9253
I20260807 04:15:51.352684 9710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:51.335993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46056 (local address 127.7.200.193:40231)
0807 04:15:51.336197 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:51.336203 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:51.336222 (+ 19us) server_negotiation.cc:407] Connection header received
0807 04:15:51.336290 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:51.336300 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:51.336383 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:51.336500 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:51.338165 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:51.339402 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:51.341373 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:51.342120 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:51.342254 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:51.345294 (+ 3040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:51.345301 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:51.345306 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:51.345356 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:51.349320 (+ 3964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:51.350167 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:51.350172 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:51.350176 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:51.350378 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:51.350809 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:51.350814 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:51.350818 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:51.351159 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:51.351462 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:51.351777 (+ 315us) server_negotiation.cc:299] Negotiation successful
0807 04:15:51.352044 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260807 04:15:51.353344 9394 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46056
W20260807 04:15:51.353991 7971 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 9253: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 04:15:51.354210 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 9253
I20260807 04:15:51.383350 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 9404
Aug 07 04:15:51 dist-test-slave-qg60 krb5kdc[9129](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076150, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.200.194@KRBTEST.COM
I20260807 04:15:51.400563 9785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:51.384244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38248 (local address 127.7.200.194:45357)
0807 04:15:51.384859 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:51.384864 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:51.384880 (+ 16us) server_negotiation.cc:407] Connection header received
0807 04:15:51.384935 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:51.384938 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:51.385007 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:51.385137 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:51.386343 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:51.387140 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:51.388870 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:51.389306 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:51.389466 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:51.394225 (+ 4759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:51.394240 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:51.394257 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:51.394296 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:51.397586 (+ 3290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:51.398339 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:51.398354 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:51.398357 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:51.398496 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:51.398902 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:51.398908 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:51.398913 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:51.399282 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:51.399606 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:51.399943 (+ 337us) server_negotiation.cc:299] Negotiation successful
0807 04:15:51.400189 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":456,"thread_start_us":276,"threads_started":1}
W20260807 04:15:51.401329 9544 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38248
W20260807 04:15:51.402047 7971 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 9404: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 04:15:51.402261 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 9404
I20260807 04:15:51.429564 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 9553
Aug 07 04:15:51 dist-test-slave-qg60 krb5kdc[9129](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076150, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.200.195@KRBTEST.COM
I20260807 04:15:51.447827 9765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:51.430527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56812 (local address 127.7.200.195:37487)
0807 04:15:51.430737 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:51.430744 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:51.430792 (+ 48us) server_negotiation.cc:407] Connection header received
0807 04:15:51.430861 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:51.430866 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:51.430950 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:51.431096 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:51.432417 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:51.433663 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:51.434877 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:51.435557 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:51.435685 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:51.440361 (+ 4676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:51.440379 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:51.440400 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:51.440452 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:51.444609 (+ 4157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:51.445416 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:51.445427 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:51.445432 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:51.445612 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:51.446093 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:51.446099 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:51.446103 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:51.446588 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:51.446936 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:51.447205 (+ 269us) server_negotiation.cc:299] Negotiation successful
0807 04:15:51.447440 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260807 04:15:51.448676 9690 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56812
W20260807 04:15:51.449517 7971 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 9553: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 04:15:51.449690 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 9553
I20260807 04:15:51.472321 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 9142
I20260807 04:15:51.473675 9220 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:15:51.593186 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 9142
2026-08-07T04:15:51Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (5610 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:15:51 dist-test-slave-qg60 krb5kdc[9789](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:15:51 dist-test-slave-qg60 krb5kdc[9789](info): set up 2 sockets
Aug 07 04:15:51 dist-test-slave-qg60 krb5kdc[9789](info): commencing operation
krb5kdc: starting...
W20260807 04:15:52.747756 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.001s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:15:52 dist-test-slave-qg60 krb5kdc[9789](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076152, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:15:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:15:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
I20260807 04:15:52.972945 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:44039
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:41015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:44039
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:15:53.303975 9803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:15:53.304353 9803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:15:53.304525 9803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:15:53.312054 9803 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:15:53.312223 9803 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 04:15:53.312340 9803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:15:53.312459 9803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:15:53.312548 9803 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:15:53.312641 9803 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:15:53.322942 9803 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:41015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:44039
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:44039
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:15:53.324397 9803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:15:53.325856 9803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:15:53.338562 9808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:53.338586 9811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:53.338508 9809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:15:53.339690 9803 server_base.cc:1034] running on GCE node
I20260807 04:15:53.340471 9803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:15:53.342077 9803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:15:53.343406 9803 hybrid_clock.cc:648] HybridClock initialized: now 1786076153343349 us; error 44 us; skew 500 ppm
I20260807 04:15:53.343822 9803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:15:53 dist-test-slave-qg60 krb5kdc[9789](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076153, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:15:53.347223 9803 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:15:53.348822 9803 webserver.cc:460] Webserver started at http://127.7.200.254:43071/ using document root <none> and password file <none>
I20260807 04:15:53.349555 9803 fs_manager.cc:359] Metadata directory not provided
I20260807 04:15:53.349701 9803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:15:53.350036 9803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:15:53.353161 9803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "7eb0ea83d3634f809742abd6525bbda0"
format_stamp: "Formatted at 2026-08-07 04:15:53 on dist-test-slave-qg60"
server_key: "3bfa9abc43922f9a635a6391f5ef7157"
server_key_iv: "5cd9a91c645fbd84b2da0c78ddbe6ba2"
server_key_version: "encryptionkey@0"
I20260807 04:15:53.353956 9803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "7eb0ea83d3634f809742abd6525bbda0"
format_stamp: "Formatted at 2026-08-07 04:15:53 on dist-test-slave-qg60"
server_key: "3bfa9abc43922f9a635a6391f5ef7157"
server_key_iv: "5cd9a91c645fbd84b2da0c78ddbe6ba2"
server_key_version: "encryptionkey@0"
I20260807 04:15:53.359380 9803 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 04:15:53.363036 9818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:53.364487 9803 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 04:15:53.364691 9803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "7eb0ea83d3634f809742abd6525bbda0"
format_stamp: "Formatted at 2026-08-07 04:15:53 on dist-test-slave-qg60"
server_key: "3bfa9abc43922f9a635a6391f5ef7157"
server_key_iv: "5cd9a91c645fbd84b2da0c78ddbe6ba2"
server_key_version: "encryptionkey@0"
I20260807 04:15:53.364972 9803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:15:53.406019 9803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:15:53.410750 9803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:15:53.411049 9803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:15:53.434345 9803 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:44039
I20260807 04:15:53.434376 9882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:44039 every 8 connection(s)
I20260807 04:15:53.435736 9803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:15:53.439500 9883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:53.445765 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 9803
I20260807 04:15:53.446010 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:15:53.446687 7971 external_mini_cluster.cc:1428] Setting key 11d0b09669b805b0497049bbdfc55b7d
I20260807 04:15:53.451124 9883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7eb0ea83d3634f809742abd6525bbda0: Bootstrap starting.
I20260807 04:15:53.455222 9883 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7eb0ea83d3634f809742abd6525bbda0: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:53.456653 9883 log.cc:824] T 00000000000000000000000000000000 P 7eb0ea83d3634f809742abd6525bbda0: Log is configured to *not* fsync() on all Append() calls
I20260807 04:15:53.460184 9883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7eb0ea83d3634f809742abd6525bbda0: No bootstrap required, opened a new log
Aug 07 04:15:53 dist-test-slave-qg60 krb5kdc[9789](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076152, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:15:53.470510 9883 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7eb0ea83d3634f809742abd6525bbda0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7eb0ea83d3634f809742abd6525bbda0" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44039 } }
I20260807 04:15:53.471001 9883 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7eb0ea83d3634f809742abd6525bbda0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:53.471136 9883 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7eb0ea83d3634f809742abd6525bbda0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7eb0ea83d3634f809742abd6525bbda0, State: Initialized, Role: FOLLOWER
I20260807 04:15:53.471931 9883 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7eb0ea83d3634f809742abd6525bbda0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7eb0ea83d3634f809742abd6525bbda0" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44039 } }
I20260807 04:15:53.472236 9883 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7eb0ea83d3634f809742abd6525bbda0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:15:53.472378 9883 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7eb0ea83d3634f809742abd6525bbda0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:15:53.472572 9883 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7eb0ea83d3634f809742abd6525bbda0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:53.473696 9887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:53.449001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36334 (local address 127.7.200.254:44039)
0807 04:15:53.449859 (+ 858us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:53.449875 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:53.449925 (+ 50us) server_negotiation.cc:407] Connection header received
0807 04:15:53.452319 (+ 2394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:53.452349 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:53.452884 (+ 535us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:53.453387 (+ 503us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:53.454917 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:53.457089 (+ 2172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:53.458776 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:53.459823 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:53.460015 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:53.464320 (+ 4305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:53.464334 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:53.464355 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:53.464404 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:53.468563 (+ 4159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:53.469490 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:53.469499 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:53.469509 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:53.469761 (+ 252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:53.470199 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:53.470204 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:53.470207 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:53.470909 (+ 702us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:53.471244 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:53.471730 (+ 486us) server_negotiation.cc:299] Negotiation successful
0807 04:15:53.472206 (+ 476us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":596,"thread_start_us":362,"threads_started":1}
I20260807 04:15:53.475396 9883 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7eb0ea83d3634f809742abd6525bbda0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7eb0ea83d3634f809742abd6525bbda0" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44039 } }
I20260807 04:15:53.475952 9883 leader_election.cc:302] T 00000000000000000000000000000000 P 7eb0ea83d3634f809742abd6525bbda0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7eb0ea83d3634f809742abd6525bbda0; no voters:
I20260807 04:15:53.476647 9883 leader_election.cc:288] T 00000000000000000000000000000000 P 7eb0ea83d3634f809742abd6525bbda0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:15:53.476775 9889 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7eb0ea83d3634f809742abd6525bbda0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:15:53.477495 9889 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7eb0ea83d3634f809742abd6525bbda0 [term 1 LEADER]: Becoming Leader. State: Replica: 7eb0ea83d3634f809742abd6525bbda0, State: Running, Role: LEADER
I20260807 04:15:53.478132 9889 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7eb0ea83d3634f809742abd6525bbda0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7eb0ea83d3634f809742abd6525bbda0" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44039 } }
I20260807 04:15:53.478950 9883 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7eb0ea83d3634f809742abd6525bbda0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:15:53.481468 9891 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7eb0ea83d3634f809742abd6525bbda0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7eb0ea83d3634f809742abd6525bbda0. Latest consensus state: current_term: 1 leader_uuid: "7eb0ea83d3634f809742abd6525bbda0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7eb0ea83d3634f809742abd6525bbda0" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44039 } } }
I20260807 04:15:53.481858 9891 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7eb0ea83d3634f809742abd6525bbda0 [sys.catalog]: This master's current role is: LEADER
I20260807 04:15:53.484967 9890 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7eb0ea83d3634f809742abd6525bbda0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7eb0ea83d3634f809742abd6525bbda0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7eb0ea83d3634f809742abd6525bbda0" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44039 } } }
I20260807 04:15:53.485340 9890 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7eb0ea83d3634f809742abd6525bbda0 [sys.catalog]: This master's current role is: LEADER
I20260807 04:15:53.486148 9896 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:15:53.491672 9896 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:15:53.501168 9896 catalog_manager.cc:1347] Generated new cluster ID: 8ef9e67e197c4d449eb2797f94470cd9
I20260807 04:15:53.501292 9896 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:15:53.528627 9896 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:15:53.530716 9896 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:15:53.538834 9896 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7eb0ea83d3634f809742abd6525bbda0: Generated new TSK 0
I20260807 04:15:53.539894 9896 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.200.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
I20260807 04:15:53.594599 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:0
--local_ip_for_outbound_sockets=127.7.200.193
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:44039
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:41015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:15:53.938503 9913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:15:53.938853 9913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:15:53.939046 9913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:15:53.946892 9913 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:15:53.947073 9913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:15:53.947221 9913 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 04:15:53.947311 9913 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 04:15:53.947450 9913 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:15:53.957854 9913 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:41015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.200.254:44039
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:15:53.959290 9913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:15:53.960649 9913 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:15:53.974812 9921 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:53.974839 9920 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:53.975087 9923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:15:53.975685 9913 server_base.cc:1034] running on GCE node
I20260807 04:15:53.976289 9913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:15:53.977254 9913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:15:53.978479 9913 hybrid_clock.cc:648] HybridClock initialized: now 1786076153978435 us; error 57 us; skew 500 ppm
I20260807 04:15:53.978857 9913 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:15:53 dist-test-slave-qg60 krb5kdc[9789](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076153, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:15:53.987116 9913 init.cc:377] Logged in from keytab as kudu/127.7.200.193@KRBTEST.COM (short username kudu)
I20260807 04:15:53.988682 9913 webserver.cc:460] Webserver started at http://127.7.200.193:35031/ using document root <none> and password file <none>
I20260807 04:15:53.989435 9913 fs_manager.cc:359] Metadata directory not provided
I20260807 04:15:53.989576 9913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:15:53.989912 9913 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:15:53.993103 9913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-0/data/instance:
uuid: "304a5465d44e4dd5a8c7504052cf4adc"
format_stamp: "Formatted at 2026-08-07 04:15:53 on dist-test-slave-qg60"
server_key: "e5b9e2a3e5ca2ca37e338ffb4b7746f3"
server_key_iv: "f2982fa92da5dda4c17a62364a48fafb"
server_key_version: "encryptionkey@0"
I20260807 04:15:53.993916 9913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance:
uuid: "304a5465d44e4dd5a8c7504052cf4adc"
format_stamp: "Formatted at 2026-08-07 04:15:53 on dist-test-slave-qg60"
server_key: "e5b9e2a3e5ca2ca37e338ffb4b7746f3"
server_key_iv: "f2982fa92da5dda4c17a62364a48fafb"
server_key_version: "encryptionkey@0"
I20260807 04:15:53.999289 9913 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260807 04:15:54.002904 9930 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:54.004356 9913 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 04:15:54.004539 9913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "304a5465d44e4dd5a8c7504052cf4adc"
format_stamp: "Formatted at 2026-08-07 04:15:53 on dist-test-slave-qg60"
server_key: "e5b9e2a3e5ca2ca37e338ffb4b7746f3"
server_key_iv: "f2982fa92da5dda4c17a62364a48fafb"
server_key_version: "encryptionkey@0"
I20260807 04:15:54.004783 9913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:15:54.018537 9913 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:15:54.022675 9913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:15:54.022936 9913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:15:54.025844 9913 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:15:54.025992 9913 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:54.026150 9913 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:15:54.026252 9913 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 04:15:54 dist-test-slave-qg60 krb5kdc[9789](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076153, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:15:54.051357 9939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:54.026359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:35329 (local address 127.7.200.254:44039)
0807 04:15:54.027241 (+ 882us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:54.027246 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:54.028148 (+ 902us) server_negotiation.cc:407] Connection header received
0807 04:15:54.030311 (+ 2163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:54.030317 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:54.030420 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:54.030543 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:54.032903 (+ 2360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:54.033999 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:54.036681 (+ 2682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:54.037452 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:54.037626 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:54.043513 (+ 5887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:54.043518 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:54.043522 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:54.043556 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:54.047337 (+ 3781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:54.048550 (+ 1213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:54.048558 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:54.048566 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:54.048731 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:54.049407 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:54.049416 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:54.049422 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:54.049819 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:54.049982 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:54.050736 (+ 754us) server_negotiation.cc:299] Negotiation successful
0807 04:15:54.050970 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":768,"thread_start_us":667,"threads_started":1}
I20260807 04:15:54.052456 9940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:54.027036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:44039 (local address 127.7.200.193:35329)
0807 04:15:54.027954 (+ 918us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:54.027993 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:54.029994 (+ 2001us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:54.030811 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:54.030823 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:54.031617 (+ 794us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:15:54.032641 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:54.032671 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:54.034163 (+ 1492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:54.034169 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:54.036487 (+ 2318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:54.036508 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:54.038093 (+ 1585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:54.038106 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:54.038475 (+ 369us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:54.039494 (+ 1019us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:15:54.039540 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:15:54.043253 (+ 3713us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:15:54.047496 (+ 4243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:54.047510 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:54.047537 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:54.048395 (+ 858us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:54.048908 (+ 513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:54.048913 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:54.048918 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:54.049257 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:54.049982 (+ 725us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:15:54.049991 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:15:54.050352 (+ 361us) client_negotiation.cc:769] Sending connection context
0807 04:15:54.050654 (+ 302us) client_negotiation.cc:240] Negotiation successful
0807 04:15:54.051217 (+ 563us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":663,"thread_start_us":426,"threads_started":1}
I20260807 04:15:54.076014 9939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:54.058980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:47355 (local address 127.7.200.254:44039)
0807 04:15:54.059184 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:54.059189 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:54.059803 (+ 614us) server_negotiation.cc:407] Connection header received
0807 04:15:54.059965 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:54.059973 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:54.060082 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:54.060213 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:54.061688 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:54.062620 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:54.065245 (+ 2625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:54.066092 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:54.066248 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:54.068374 (+ 2126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:54.068384 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:54.068391 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:54.068439 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:54.072835 (+ 4396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:54.073663 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:54.073670 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:54.073675 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:54.073856 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:54.074333 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:54.074341 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:54.074345 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:54.074781 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:54.074945 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:54.075380 (+ 435us) server_negotiation.cc:299] Negotiation successful
0807 04:15:54.075635 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260807 04:15:54.076165 10005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:54.059007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:44039 (local address 127.7.200.193:47355)
0807 04:15:54.059685 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:54.059702 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:54.059839 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:54.060242 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:54.060245 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:54.060800 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:15:54.061425 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:54.061448 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:54.062820 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:54.062824 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:54.064982 (+ 2158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:54.065003 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:54.066312 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:54.066317 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:54.066516 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:54.067285 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:15:54.067303 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:15:54.068106 (+ 803us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:15:54.073021 (+ 4915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:54.073028 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:54.073031 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:54.073528 (+ 497us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:54.074005 (+ 477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:54.074011 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:54.074016 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:54.074198 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:54.074909 (+ 711us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:15:54.074914 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:15:54.075117 (+ 203us) client_negotiation.cc:769] Sending connection context
0807 04:15:54.075282 (+ 165us) client_negotiation.cc:240] Negotiation successful
0807 04:15:54.075680 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":368,"threads_started":1}
I20260807 04:15:54.085183 9913 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:37137
I20260807 04:15:54.085219 10054 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:37137 every 8 connection(s)
I20260807 04:15:54.086580 9913 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:15:54.088696 10055 heartbeater.cc:347] Connected to a master server at 127.7.200.254:44039
I20260807 04:15:54.088984 10055 heartbeater.cc:464] Registering TS with master...
I20260807 04:15:54.089679 10055 heartbeater.cc:511] Master 127.7.200.254:44039 requested a full tablet report, sending...
I20260807 04:15:54.090175 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 9913
I20260807 04:15:54.090387 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance
I20260807 04:15:54.091200 7971 external_mini_cluster.cc:1428] Setting key cf93c889cfe006895419a5d1615d6cd9
I20260807 04:15:54.091964 9838 ts_manager.cc:194] Registered new tserver with Master: 304a5465d44e4dd5a8c7504052cf4adc (127.7.200.193:37137)
I20260807 04:15:54.093873 9838 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.193@KRBTEST.COM'} at 127.7.200.193:35329
WARNING: no policy specified for kudu/127.7.200.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
I20260807 04:15:54.140931 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:0
--local_ip_for_outbound_sockets=127.7.200.194
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:44039
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:41015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:15:54.481545 10060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:15:54.481856 10060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:15:54.482055 10060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:15:54.489588 10060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:15:54.489709 10060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:15:54.489898 10060 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 04:15:54.489976 10060 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 04:15:54.490104 10060 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:15:54.500341 10060 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:41015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.200.254:44039
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:15:54.501837 10060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:15:54.503252 10060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:15:54.517194 10068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:54.517247 10066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:54.517252 10065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:15:54.518512 10060 server_base.cc:1034] running on GCE node
I20260807 04:15:54.519188 10060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:15:54.520177 10060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:15:54.521420 10060 hybrid_clock.cc:648] HybridClock initialized: now 1786076154521375 us; error 45 us; skew 500 ppm
I20260807 04:15:54.521761 10060 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:15:54 dist-test-slave-qg60 krb5kdc[9789](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076154, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:15:54.525197 10060 init.cc:377] Logged in from keytab as kudu/127.7.200.194@KRBTEST.COM (short username kudu)
I20260807 04:15:54.526691 10060 webserver.cc:460] Webserver started at http://127.7.200.194:44439/ using document root <none> and password file <none>
I20260807 04:15:54.527415 10060 fs_manager.cc:359] Metadata directory not provided
I20260807 04:15:54.527570 10060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:15:54.527897 10060 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:15:54.531234 10060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-1/data/instance:
uuid: "8e570fe2440a4942a0ae7672e16c35cd"
format_stamp: "Formatted at 2026-08-07 04:15:54 on dist-test-slave-qg60"
server_key: "eea2e28faa21d71a509f0a69806bc0e5"
server_key_iv: "eb438c0735abbd37d6d8cb4612bf8280"
server_key_version: "encryptionkey@0"
I20260807 04:15:54.532033 10060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance:
uuid: "8e570fe2440a4942a0ae7672e16c35cd"
format_stamp: "Formatted at 2026-08-07 04:15:54 on dist-test-slave-qg60"
server_key: "eea2e28faa21d71a509f0a69806bc0e5"
server_key_iv: "eb438c0735abbd37d6d8cb4612bf8280"
server_key_version: "encryptionkey@0"
I20260807 04:15:54.537513 10060 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 04:15:54.541185 10075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:54.542609 10060 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 04:15:54.542796 10060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "8e570fe2440a4942a0ae7672e16c35cd"
format_stamp: "Formatted at 2026-08-07 04:15:54 on dist-test-slave-qg60"
server_key: "eea2e28faa21d71a509f0a69806bc0e5"
server_key_iv: "eb438c0735abbd37d6d8cb4612bf8280"
server_key_version: "encryptionkey@0"
I20260807 04:15:54.543020 10060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:15:54.575242 10060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:15:54.580202 10060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:15:54.580504 10060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:15:54.583382 10060 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:15:54.583479 10060 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:54.583667 10060 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:15:54.583806 10060 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 04:15:54 dist-test-slave-qg60 krb5kdc[9789](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076154, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:15:54.612440 10084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:54.583994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:54897 (local address 127.7.200.254:44039)
0807 04:15:54.584777 (+ 783us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:54.584783 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:54.585892 (+ 1109us) server_negotiation.cc:407] Connection header received
0807 04:15:54.588310 (+ 2418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:54.588317 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:54.588417 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:54.588506 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:54.591597 (+ 3091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:54.592874 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:54.596182 (+ 3308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:54.597045 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:54.597170 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:54.603836 (+ 6666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:54.603845 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:54.603851 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:54.603903 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:54.607610 (+ 3707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:54.608839 (+ 1229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:54.608846 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:54.608852 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:54.609036 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:54.609761 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:54.609765 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:54.609767 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:54.610193 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:54.610351 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:54.611487 (+ 1136us) server_negotiation.cc:299] Negotiation successful
0807 04:15:54.611844 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":609,"thread_start_us":470,"threads_started":1}
I20260807 04:15:54.613307 10085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:54.584751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:44039 (local address 127.7.200.194:54897)
0807 04:15:54.585688 (+ 937us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:54.585748 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:54.587908 (+ 2160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:54.589200 (+ 1292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:54.589209 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:54.590300 (+ 1091us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:15:54.591382 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:54.591411 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:54.593072 (+ 1661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:54.593083 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:54.595938 (+ 2855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:54.595962 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:54.597664 (+ 1702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:54.597676 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:54.598072 (+ 396us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:54.599099 (+ 1027us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:15:54.599142 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:15:54.603474 (+ 4332us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:15:54.607788 (+ 4314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:54.607800 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:54.607825 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:54.608597 (+ 772us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:54.609169 (+ 572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:54.609174 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:54.609178 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:54.609519 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:54.610333 (+ 814us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:15:54.610341 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:15:54.610953 (+ 612us) client_negotiation.cc:769] Sending connection context
0807 04:15:54.611353 (+ 400us) client_negotiation.cc:240] Negotiation successful
0807 04:15:54.611868 (+ 515us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":632,"thread_start_us":405,"threads_started":1}
I20260807 04:15:54.633977 10060 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:34175
I20260807 04:15:54.634006 10200 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:34175 every 8 connection(s)
I20260807 04:15:54.635308 10060 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:15:54.636108 10084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:54.619298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:40295 (local address 127.7.200.254:44039)
0807 04:15:54.619551 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:54.619561 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:54.620373 (+ 812us) server_negotiation.cc:407] Connection header received
0807 04:15:54.620626 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:54.620635 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:54.620787 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:54.620913 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:54.622973 (+ 2060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:54.624121 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:54.626316 (+ 2195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:54.626800 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:54.626946 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:54.629812 (+ 2866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:54.629816 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:54.629819 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:54.629851 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:54.633000 (+ 3149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:54.634016 (+ 1016us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:54.634024 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:54.634028 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:54.634212 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:54.634609 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:54.634616 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:54.634619 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:54.634953 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:54.635126 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:54.635523 (+ 397us) server_negotiation.cc:299] Negotiation successful
0807 04:15:54.635770 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 04:15:54.636317 10171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:54.619558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:44039 (local address 127.7.200.194:40295)
0807 04:15:54.620247 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:54.620274 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:54.620456 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:54.621166 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:54.621174 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:54.621944 (+ 770us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:15:54.622711 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:54.622739 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:54.624274 (+ 1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:54.624279 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:54.626154 (+ 1875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:54.626168 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:54.627060 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:54.627074 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:54.627342 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:54.628176 (+ 834us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:15:54.628207 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:15:54.629526 (+ 1319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:15:54.633140 (+ 3614us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:54.633147 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:54.633151 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:54.633881 (+ 730us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:54.634337 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:54.634342 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:54.634346 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:54.634483 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:54.635081 (+ 598us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:15:54.635086 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:15:54.635275 (+ 189us) client_negotiation.cc:769] Sending connection context
0807 04:15:54.635427 (+ 152us) client_negotiation.cc:240] Negotiation successful
0807 04:15:54.635825 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":359,"threads_started":1}
I20260807 04:15:54.639292 10201 heartbeater.cc:347] Connected to a master server at 127.7.200.254:44039
I20260807 04:15:54.639573 10201 heartbeater.cc:464] Registering TS with master...
I20260807 04:15:54.640370 10201 heartbeater.cc:511] Master 127.7.200.254:44039 requested a full tablet report, sending...
I20260807 04:15:54.641865 9838 ts_manager.cc:194] Registered new tserver with Master: 8e570fe2440a4942a0ae7672e16c35cd (127.7.200.194:34175)
I20260807 04:15:54.642701 9838 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.194@KRBTEST.COM'} at 127.7.200.194:54897
I20260807 04:15:54.643342 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 10060
I20260807 04:15:54.643533 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance
I20260807 04:15:54.644034 7971 external_mini_cluster.cc:1428] Setting key c488c8a5800bfd307ab52043aa41eacf
WARNING: no policy specified for kudu/127.7.200.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
I20260807 04:15:54.693745 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:0
--local_ip_for_outbound_sockets=127.7.200.195
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:44039
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:41015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:15:55.028331 10205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:15:55.028637 10205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:15:55.028836 10205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:15:55.036299 10205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:15:55.036456 10205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:15:55.036626 10205 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 04:15:55.036710 10205 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 04:15:55.036875 10205 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:15:55.047322 10205 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:41015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.200.254:44039
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:15:55.048710 10205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:15:55.050139 10205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:15:55.063395 10213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:55.063496 10212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:15:55.063442 10215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:15:55.069739 10205 server_base.cc:1034] running on GCE node
I20260807 04:15:55.070516 10205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:15:55.071566 10205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:15:55.072819 10205 hybrid_clock.cc:648] HybridClock initialized: now 1786076155072761 us; error 50 us; skew 500 ppm
I20260807 04:15:55.073176 10205 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:15:55 dist-test-slave-qg60 krb5kdc[9789](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076155, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:15:55.076426 10205 init.cc:377] Logged in from keytab as kudu/127.7.200.195@KRBTEST.COM (short username kudu)
I20260807 04:15:55.078097 10205 webserver.cc:460] Webserver started at http://127.7.200.195:40625/ using document root <none> and password file <none>
I20260807 04:15:55.078811 10205 fs_manager.cc:359] Metadata directory not provided
I20260807 04:15:55.078913 10205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:15:55.079236 10205 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:15:55.082284 10205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-2/data/instance:
uuid: "11f39c73a3f14e60b996f6fe75a13065"
format_stamp: "Formatted at 2026-08-07 04:15:55 on dist-test-slave-qg60"
server_key: "4675590fa5e150c951e545866a151fa1"
server_key_iv: "4a6bafe015c401bae404fd4b14590874"
server_key_version: "encryptionkey@0"
I20260807 04:15:55.083062 10205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance:
uuid: "11f39c73a3f14e60b996f6fe75a13065"
format_stamp: "Formatted at 2026-08-07 04:15:55 on dist-test-slave-qg60"
server_key: "4675590fa5e150c951e545866a151fa1"
server_key_iv: "4a6bafe015c401bae404fd4b14590874"
server_key_version: "encryptionkey@0"
I20260807 04:15:55.088581 10205 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260807 04:15:55.092059 10222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:55.093386 10205 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:15:55.093551 10205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "11f39c73a3f14e60b996f6fe75a13065"
format_stamp: "Formatted at 2026-08-07 04:15:55 on dist-test-slave-qg60"
server_key: "4675590fa5e150c951e545866a151fa1"
server_key_iv: "4a6bafe015c401bae404fd4b14590874"
server_key_version: "encryptionkey@0"
I20260807 04:15:55.093752 10205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:15:55.096522 10055 heartbeater.cc:503] Master 127.7.200.254:44039 was elected leader, sending a full tablet report...
I20260807 04:15:55.123752 10205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:15:55.128360 10205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:15:55.128681 10205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:15:55.131603 10205 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:15:55.131735 10205 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:15:55.131893 10205 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:15:55.131986 10205 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 04:15:55 dist-test-slave-qg60 krb5kdc[9789](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076155, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:15:55.157476 10084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.132093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:38443 (local address 127.7.200.254:44039)
0807 04:15:55.132303 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:55.132313 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:55.134117 (+ 1804us) server_negotiation.cc:407] Connection header received
0807 04:15:55.136406 (+ 2289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:55.136412 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:55.136509 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:55.136647 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:55.139514 (+ 2867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.140278 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.143107 (+ 2829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.143575 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.143722 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.148859 (+ 5137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:55.148867 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:55.148875 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:55.148941 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:55.152879 (+ 3938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:55.154061 (+ 1182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:55.154070 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:55.154077 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:55.154276 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:55.154904 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:55.154908 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:55.154910 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:55.155363 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:55.155532 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:55.156655 (+ 1123us) server_negotiation.cc:299] Negotiation successful
0807 04:15:55.156971 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 04:15:55.159132 10231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.132915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:44039 (local address 127.7.200.195:38443)
0807 04:15:55.133845 (+ 930us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:55.133893 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:55.136125 (+ 2232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:55.137223 (+ 1098us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:55.137239 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:55.138079 (+ 840us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:15:55.139309 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:55.139341 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.140575 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.140580 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:55.142937 (+ 2357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:55.142951 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.143834 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.143842 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:55.144210 (+ 368us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.145122 (+ 912us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:15:55.145164 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:15:55.148579 (+ 3415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:15:55.153042 (+ 4463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:55.153051 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:55.153072 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:55.153884 (+ 812us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:55.154422 (+ 538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:55.154429 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:55.154434 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:55.154747 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:55.155493 (+ 746us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:15:55.155502 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:15:55.156078 (+ 576us) client_negotiation.cc:769] Sending connection context
0807 04:15:55.156479 (+ 401us) client_negotiation.cc:240] Negotiation successful
0807 04:15:55.157236 (+ 757us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":685,"thread_start_us":465,"threads_started":1}
I20260807 04:15:55.178906 10205 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:37009
I20260807 04:15:55.178934 10351 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:37009 every 8 connection(s)
I20260807 04:15:55.180466 10205 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:15:55.182911 10352 heartbeater.cc:347] Connected to a master server at 127.7.200.254:44039
I20260807 04:15:55.183174 10352 heartbeater.cc:464] Registering TS with master...
I20260807 04:15:55.183871 10352 heartbeater.cc:511] Master 127.7.200.254:44039 requested a full tablet report, sending...
I20260807 04:15:55.184759 10326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.168076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:44039 (local address 127.7.200.195:36925)
0807 04:15:55.169441 (+ 1365us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:55.169463 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:55.169649 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:55.170282 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:55.170290 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:55.171097 (+ 807us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:15:55.171772 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:55.171795 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.173242 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.173250 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:55.174932 (+ 1682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:55.174949 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.175756 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.175762 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:55.175972 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.176829 (+ 857us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:15:55.176860 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:15:55.177927 (+ 1067us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:15:55.181858 (+ 3931us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:55.181956 (+ 98us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:55.181963 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:55.182476 (+ 513us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:55.182957 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:55.182962 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:55.182966 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:55.183167 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:55.183708 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:15:55.183717 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:15:55.183918 (+ 201us) client_negotiation.cc:769] Sending connection context
0807 04:15:55.184078 (+ 160us) client_negotiation.cc:240] Negotiation successful
0807 04:15:55.184344 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1215,"thread_start_us":1017,"threads_started":1}
I20260807 04:15:55.185433 10084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.168056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:36925 (local address 127.7.200.254:44039)
0807 04:15:55.168295 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:55.168305 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:55.169593 (+ 1288us) server_negotiation.cc:407] Connection header received
0807 04:15:55.169823 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:55.169830 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:55.169930 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:55.170044 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:55.171963 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.173016 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.175104 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.175553 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.175695 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.178191 (+ 2496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:55.178196 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:55.178200 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:55.178267 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:55.181663 (+ 3396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:55.182604 (+ 941us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:55.182610 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:55.182614 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:55.182852 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:55.183279 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:55.183286 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:55.183289 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:55.183585 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:55.183760 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:55.184948 (+ 1188us) server_negotiation.cc:299] Negotiation successful
0807 04:15:55.185185 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 04:15:55.185457 9838 ts_manager.cc:194] Registered new tserver with Master: 11f39c73a3f14e60b996f6fe75a13065 (127.7.200.195:37009)
I20260807 04:15:55.186357 9838 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.195@KRBTEST.COM'} at 127.7.200.195:38443
I20260807 04:15:55.186496 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 10205
I20260807 04:15:55.186717 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance
I20260807 04:15:55.187304 7971 external_mini_cluster.cc:1428] Setting key 6c5f73258fcb7ae37bcf6fac403f358b
I20260807 04:15:55.190523 7971 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 04:15:55 dist-test-slave-qg60 krb5kdc[9789](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076155, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 04:15:55 dist-test-slave-qg60 krb5kdc[9789](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076155, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:15:55.244978 10084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.230804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36336 (local address 127.7.200.254:44039)
0807 04:15:55.231063 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:55.231070 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:55.231226 (+ 156us) server_negotiation.cc:407] Connection header received
0807 04:15:55.231388 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:55.231392 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:55.231462 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:55.231560 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:55.233085 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.233852 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.235068 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.235472 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.235571 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.239565 (+ 3994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:55.239570 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:55.239573 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:55.239611 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:55.242558 (+ 2947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:55.243205 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:55.243209 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:55.243211 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:55.243340 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:55.243682 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:55.243685 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:55.243687 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:55.243958 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:55.244161 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:55.244428 (+ 267us) server_negotiation.cc:299] Negotiation successful
0807 04:15:55.244600 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260807 04:15:55.249295 9838 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36336:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:15:55.256242 9838 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:15:55.290442 10368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.268967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50922 (local address 127.7.200.195:37009)
0807 04:15:55.281435 (+ 12468us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:55.281445 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:55.281487 (+ 42us) server_negotiation.cc:407] Connection header received
0807 04:15:55.281606 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:55.281615 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:55.281914 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:55.282110 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:15:55.282945 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.284711 (+ 1766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.287811 (+ 3100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.289062 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.289227 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.289499 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:55.289897 (+ 398us) server_negotiation.cc:299] Negotiation successful
0807 04:15:55.290082 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12263,"thread_start_us":13380,"threads_started":1}
I20260807 04:15:55.290489 10366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.268555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:37009 (local address 127.0.0.1:50922)
0807 04:15:55.281050 (+ 12495us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:55.281113 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:55.281333 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:55.282283 (+ 950us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:55.282290 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:55.282321 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:15:55.282711 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:55.282728 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.284887 (+ 2159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.284895 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:55.287627 (+ 2732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:55.287646 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.289284 (+ 1638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.289291 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:55.289618 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.289684 (+ 66us) client_negotiation.cc:769] Sending connection context
0807 04:15:55.289833 (+ 149us) client_negotiation.cc:240] Negotiation successful
0807 04:15:55.290026 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12104,"mutex_wait_us":164,"thread_start_us":13006,"threads_started":1}
I20260807 04:15:55.291354 10369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.269134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54050 (local address 127.7.200.193:37137)
0807 04:15:55.282995 (+ 13861us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:55.283006 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:55.283031 (+ 25us) server_negotiation.cc:407] Connection header received
0807 04:15:55.283136 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:55.283146 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:55.283375 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:55.283580 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:15:55.284460 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.285792 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.288348 (+ 2556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.289859 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.289993 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.290186 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:55.290880 (+ 694us) server_negotiation.cc:299] Negotiation successful
0807 04:15:55.291053 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13689,"thread_start_us":13541,"threads_started":1}
I20260807 04:15:55.292151 10370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.282759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55130 (local address 127.7.200.194:34175)
0807 04:15:55.283652 (+ 893us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:55.283660 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:55.284335 (+ 675us) server_negotiation.cc:407] Connection header received
0807 04:15:55.284475 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:55.284482 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:55.284754 (+ 272us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:55.284947 (+ 193us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:15:55.285724 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.287246 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.289664 (+ 2418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.291133 (+ 1469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.291269 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.291462 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:55.291715 (+ 253us) server_negotiation.cc:299] Negotiation successful
0807 04:15:55.291878 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":735,"thread_start_us":623,"threads_started":1}
I20260807 04:15:55.292174 10371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.283089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:34175 (local address 127.0.0.1:55130)
0807 04:15:55.284194 (+ 1105us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:55.284211 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:55.284334 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:55.284952 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:55.284957 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:55.284984 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:15:55.285542 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:55.285556 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.287381 (+ 1825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.287386 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:55.289488 (+ 2102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:55.289507 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.291330 (+ 1823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.291337 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:55.291515 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.291556 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 04:15:55.291669 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 04:15:55.291800 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":973,"mutex_wait_us":53,"thread_start_us":805,"threads_started":1}
I20260807 04:15:55.293107 10367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.268687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37137 (local address 127.0.0.1:54050)
0807 04:15:55.281635 (+ 12948us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:55.281661 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:55.281782 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:55.283621 (+ 1839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:55.283627 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:55.283654 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:15:55.284209 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:55.284221 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.285966 (+ 1745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.285971 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:55.288166 (+ 2195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:55.288183 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.290341 (+ 2158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.290348 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:55.290561 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.290609 (+ 48us) client_negotiation.cc:769] Sending connection context
0807 04:15:55.290710 (+ 101us) client_negotiation.cc:240] Negotiation successful
0807 04:15:55.292761 (+ 2051us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12804,"mutex_wait_us":4,"thread_start_us":13194,"threads_started":1}
I20260807 04:15:55.294915 10273 tablet_service.cc:1467] Processing CreateTablet for tablet 8cd1feb8cf6a4e109fb440220216db10 (DEFAULT_TABLE table=test-table [id=3e9b5d125dbc491d9c7ef821d6029598]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:15:55.295418 10126 tablet_service.cc:1467] Processing CreateTablet for tablet 8cd1feb8cf6a4e109fb440220216db10 (DEFAULT_TABLE table=test-table [id=3e9b5d125dbc491d9c7ef821d6029598]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:15:55.296468 10273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cd1feb8cf6a4e109fb440220216db10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:55.296572 10126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cd1feb8cf6a4e109fb440220216db10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:55.296514 9982 tablet_service.cc:1467] Processing CreateTablet for tablet 8cd1feb8cf6a4e109fb440220216db10 (DEFAULT_TABLE table=test-table [id=3e9b5d125dbc491d9c7ef821d6029598]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:15:55.297890 9982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cd1feb8cf6a4e109fb440220216db10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:55.308269 10372 tablet_bootstrap.cc:492] T 8cd1feb8cf6a4e109fb440220216db10 P 8e570fe2440a4942a0ae7672e16c35cd: Bootstrap starting.
I20260807 04:15:55.312485 10372 tablet_bootstrap.cc:654] T 8cd1feb8cf6a4e109fb440220216db10 P 8e570fe2440a4942a0ae7672e16c35cd: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:55.313558 10374 tablet_bootstrap.cc:492] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065: Bootstrap starting.
I20260807 04:15:55.313972 10372 log.cc:824] T 8cd1feb8cf6a4e109fb440220216db10 P 8e570fe2440a4942a0ae7672e16c35cd: Log is configured to *not* fsync() on all Append() calls
I20260807 04:15:55.316912 10376 tablet_bootstrap.cc:492] T 8cd1feb8cf6a4e109fb440220216db10 P 304a5465d44e4dd5a8c7504052cf4adc: Bootstrap starting.
I20260807 04:15:55.317783 10372 tablet_bootstrap.cc:492] T 8cd1feb8cf6a4e109fb440220216db10 P 8e570fe2440a4942a0ae7672e16c35cd: No bootstrap required, opened a new log
I20260807 04:15:55.317868 10374 tablet_bootstrap.cc:654] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:55.318082 10372 ts_tablet_manager.cc:1397] T 8cd1feb8cf6a4e109fb440220216db10 P 8e570fe2440a4942a0ae7672e16c35cd: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260807 04:15:55.319245 10374 log.cc:824] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065: Log is configured to *not* fsync() on all Append() calls
I20260807 04:15:55.319824 10376 tablet_bootstrap.cc:654] T 8cd1feb8cf6a4e109fb440220216db10 P 304a5465d44e4dd5a8c7504052cf4adc: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:55.321223 10376 log.cc:824] T 8cd1feb8cf6a4e109fb440220216db10 P 304a5465d44e4dd5a8c7504052cf4adc: Log is configured to *not* fsync() on all Append() calls
I20260807 04:15:55.322525 10374 tablet_bootstrap.cc:492] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065: No bootstrap required, opened a new log
I20260807 04:15:55.322835 10374 ts_tablet_manager.cc:1397] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260807 04:15:55.324321 10376 tablet_bootstrap.cc:492] T 8cd1feb8cf6a4e109fb440220216db10 P 304a5465d44e4dd5a8c7504052cf4adc: No bootstrap required, opened a new log
I20260807 04:15:55.324596 10376 ts_tablet_manager.cc:1397] T 8cd1feb8cf6a4e109fb440220216db10 P 304a5465d44e4dd5a8c7504052cf4adc: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.005s
I20260807 04:15:55.326910 10372 raft_consensus.cc:348] T 8cd1feb8cf6a4e109fb440220216db10 P 8e570fe2440a4942a0ae7672e16c35cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } } peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } }
I20260807 04:15:55.327397 10372 raft_consensus.cc:374] T 8cd1feb8cf6a4e109fb440220216db10 P 8e570fe2440a4942a0ae7672e16c35cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:55.327502 10372 raft_consensus.cc:729] T 8cd1feb8cf6a4e109fb440220216db10 P 8e570fe2440a4942a0ae7672e16c35cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e570fe2440a4942a0ae7672e16c35cd, State: Initialized, Role: FOLLOWER
I20260807 04:15:55.328230 10372 consensus_queue.cc:260] T 8cd1feb8cf6a4e109fb440220216db10 P 8e570fe2440a4942a0ae7672e16c35cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } } peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } }
I20260807 04:15:55.329471 10201 heartbeater.cc:503] Master 127.7.200.254:44039 was elected leader, sending a full tablet report...
I20260807 04:15:55.330176 10372 ts_tablet_manager.cc:1428] T 8cd1feb8cf6a4e109fb440220216db10 P 8e570fe2440a4942a0ae7672e16c35cd: Time spent starting tablet: real 0.012s user 0.011s sys 0.001s
I20260807 04:15:55.333732 10374 raft_consensus.cc:348] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } } peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } }
I20260807 04:15:55.334273 10374 raft_consensus.cc:374] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:55.334412 10374 raft_consensus.cc:729] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11f39c73a3f14e60b996f6fe75a13065, State: Initialized, Role: FOLLOWER
I20260807 04:15:55.335166 10374 consensus_queue.cc:260] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } } peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } }
I20260807 04:15:55.335237 10376 raft_consensus.cc:348] T 8cd1feb8cf6a4e109fb440220216db10 P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } } peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } }
I20260807 04:15:55.335659 10376 raft_consensus.cc:374] T 8cd1feb8cf6a4e109fb440220216db10 P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:55.335783 10376 raft_consensus.cc:729] T 8cd1feb8cf6a4e109fb440220216db10 P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 304a5465d44e4dd5a8c7504052cf4adc, State: Initialized, Role: FOLLOWER
I20260807 04:15:55.336376 10352 heartbeater.cc:503] Master 127.7.200.254:44039 was elected leader, sending a full tablet report...
I20260807 04:15:55.336407 10376 consensus_queue.cc:260] T 8cd1feb8cf6a4e109fb440220216db10 P 304a5465d44e4dd5a8c7504052cf4adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } } peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } }
I20260807 04:15:55.337198 10374 ts_tablet_manager.cc:1428] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065: Time spent starting tablet: real 0.014s user 0.016s sys 0.000s
I20260807 04:15:55.338085 10376 ts_tablet_manager.cc:1428] T 8cd1feb8cf6a4e109fb440220216db10 P 304a5465d44e4dd5a8c7504052cf4adc: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
W20260807 04:15:55.338994 10056 tablet.cc:2369] T 8cd1feb8cf6a4e109fb440220216db10 P 304a5465d44e4dd5a8c7504052cf4adc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:15:55.344195 10381 raft_consensus.cc:482] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:15:55.344398 10381 raft_consensus.cc:504] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } } peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } }
I20260807 04:15:55.345860 10381 leader_election.cc:288] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 304a5465d44e4dd5a8c7504052cf4adc (127.7.200.193:37137), 8e570fe2440a4942a0ae7672e16c35cd (127.7.200.194:34175)
I20260807 04:15:55.352569 10369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.346219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:36511 (local address 127.7.200.193:37137)
0807 04:15:55.346395 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:55.346399 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:55.346475 (+ 76us) server_negotiation.cc:407] Connection header received
0807 04:15:55.346975 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:55.346981 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:55.347057 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:55.347197 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:15:55.347646 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.348610 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.350903 (+ 2293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.351690 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.351862 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.351938 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:55.352206 (+ 268us) server_negotiation.cc:299] Negotiation successful
0807 04:15:55.352337 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 04:15:55.352599 10231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.346195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37137 (local address 127.7.200.195:36511)
0807 04:15:55.346391 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:55.346411 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:55.346536 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:55.347223 (+ 687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:55.347228 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:55.347257 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:15:55.347497 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:55.347511 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.348766 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.348772 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:55.350744 (+ 1972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:55.350757 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.351845 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.351852 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:55.352041 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.352066 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 04:15:55.352179 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 04:15:55.352318 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260807 04:15:55.353060 10370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.346801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:39733 (local address 127.7.200.194:34175)
0807 04:15:55.346988 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:55.347004 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:55.347444 (+ 440us) server_negotiation.cc:407] Connection header received
0807 04:15:55.347571 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:55.347578 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:55.347662 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:55.347753 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:15:55.348304 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.349340 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.351357 (+ 2017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.352124 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.352312 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.352384 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:55.352653 (+ 269us) server_negotiation.cc:299] Negotiation successful
0807 04:15:55.352803 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 04:15:55.353289 10383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.346584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:34175 (local address 127.7.200.195:39733)
0807 04:15:55.347343 (+ 759us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:55.347357 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:55.347466 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:55.347785 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:55.347790 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:55.347815 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:15:55.348162 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:55.348174 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.349492 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.349497 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:55.351208 (+ 1711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:55.351221 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.352340 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.352347 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:55.352498 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.352519 (+ 21us) client_negotiation.cc:769] Sending connection context
0807 04:15:55.352628 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 04:15:55.352948 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"thread_start_us":460,"threads_started":1}
I20260807 04:15:55.353777 10007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd1feb8cf6a4e109fb440220216db10" candidate_uuid: "11f39c73a3f14e60b996f6fe75a13065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "304a5465d44e4dd5a8c7504052cf4adc" is_pre_election: true
I20260807 04:15:55.354380 10007 raft_consensus.cc:2454] T 8cd1feb8cf6a4e109fb440220216db10 P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11f39c73a3f14e60b996f6fe75a13065 in term 0.
I20260807 04:15:55.354388 10148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd1feb8cf6a4e109fb440220216db10" candidate_uuid: "11f39c73a3f14e60b996f6fe75a13065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e570fe2440a4942a0ae7672e16c35cd" is_pre_election: true
I20260807 04:15:55.354825 10148 raft_consensus.cc:2454] T 8cd1feb8cf6a4e109fb440220216db10 P 8e570fe2440a4942a0ae7672e16c35cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11f39c73a3f14e60b996f6fe75a13065 in term 0.
I20260807 04:15:55.355141 10223 leader_election.cc:302] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11f39c73a3f14e60b996f6fe75a13065, 304a5465d44e4dd5a8c7504052cf4adc; no voters:
I20260807 04:15:55.355583 10381 raft_consensus.cc:2781] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:15:55.355746 10381 raft_consensus.cc:482] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:15:55.355857 10381 raft_consensus.cc:3037] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:55.358191 10381 raft_consensus.cc:504] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } } peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } }
I20260807 04:15:55.358772 10381 leader_election.cc:288] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065 [CANDIDATE]: Term 1 election: Requested vote from peers 304a5465d44e4dd5a8c7504052cf4adc (127.7.200.193:37137), 8e570fe2440a4942a0ae7672e16c35cd (127.7.200.194:34175)
I20260807 04:15:55.359304 10007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd1feb8cf6a4e109fb440220216db10" candidate_uuid: "11f39c73a3f14e60b996f6fe75a13065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "304a5465d44e4dd5a8c7504052cf4adc"
I20260807 04:15:55.359359 10148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cd1feb8cf6a4e109fb440220216db10" candidate_uuid: "11f39c73a3f14e60b996f6fe75a13065" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e570fe2440a4942a0ae7672e16c35cd"
I20260807 04:15:55.359524 10007 raft_consensus.cc:3037] T 8cd1feb8cf6a4e109fb440220216db10 P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:55.359563 10148 raft_consensus.cc:3037] T 8cd1feb8cf6a4e109fb440220216db10 P 8e570fe2440a4942a0ae7672e16c35cd [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:55.361893 10148 raft_consensus.cc:2454] T 8cd1feb8cf6a4e109fb440220216db10 P 8e570fe2440a4942a0ae7672e16c35cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11f39c73a3f14e60b996f6fe75a13065 in term 1.
I20260807 04:15:55.362054 10007 raft_consensus.cc:2454] T 8cd1feb8cf6a4e109fb440220216db10 P 304a5465d44e4dd5a8c7504052cf4adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11f39c73a3f14e60b996f6fe75a13065 in term 1.
I20260807 04:15:55.362327 10223 leader_election.cc:302] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11f39c73a3f14e60b996f6fe75a13065, 8e570fe2440a4942a0ae7672e16c35cd; no voters:
I20260807 04:15:55.362610 10381 raft_consensus.cc:2781] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:15:55.363066 10381 raft_consensus.cc:686] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065 [term 1 LEADER]: Becoming Leader. State: Replica: 11f39c73a3f14e60b996f6fe75a13065, State: Running, Role: LEADER
I20260807 04:15:55.363649 10381 consensus_queue.cc:237] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } } peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } }
I20260807 04:15:55.368203 9838 catalog_manager.cc:5495] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11f39c73a3f14e60b996f6fe75a13065 (127.7.200.195). New cstate: current_term: 1 leader_uuid: "11f39c73a3f14e60b996f6fe75a13065" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } health_report { overall_health: UNKNOWN } } }
W20260807 04:15:55.388829 10202 tablet.cc:2369] T 8cd1feb8cf6a4e109fb440220216db10 P 8e570fe2440a4942a0ae7672e16c35cd: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 04:15:55 dist-test-slave-qg60 krb5kdc[9789](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076153, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
W20260807 04:15:55.432581 10353 tablet.cc:2369] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:15:55.437788 10084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.423236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36338 (local address 127.7.200.254:44039)
0807 04:15:55.423439 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:55.423444 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:55.424041 (+ 597us) server_negotiation.cc:407] Connection header received
0807 04:15:55.424252 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:55.424256 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:55.424322 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:55.424425 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:55.425663 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.426381 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.427652 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.428146 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.428288 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.431710 (+ 3422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:55.431716 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:55.431719 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:55.431752 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:55.434790 (+ 3038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:55.435674 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:55.435678 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:55.435680 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:55.435806 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:55.436188 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:55.436192 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:55.436194 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:55.436477 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:55.436627 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:55.437128 (+ 501us) server_negotiation.cc:299] Negotiation successful
0807 04:15:55.437442 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":109,"server-negotiator.queue_time_us":57}
I20260807 04:15:55.437831 10393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.423332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:44039 (local address 127.0.0.1:36338)
0807 04:15:55.423929 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:55.423945 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:55.424117 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:55.424456 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:55.424460 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:55.425243 (+ 783us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:15:55.425510 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:55.425520 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.426509 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.426516 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:55.427504 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:55.427516 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.428330 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.428336 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:55.428506 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.429275 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:15:55.429293 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:15:55.431513 (+ 2220us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:15:55.434931 (+ 3418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:55.434944 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:55.434952 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:55.435555 (+ 603us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:55.435907 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:15:55.435913 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:15:55.435917 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:15:55.436086 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:15:55.436607 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:15:55.436616 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:15:55.436824 (+ 208us) client_negotiation.cc:769] Sending connection context
0807 04:15:55.437005 (+ 181us) client_negotiation.cc:240] Negotiation successful
0807 04:15:55.437311 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":329,"threads_started":1}
I20260807 04:15:55.443749 9838 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:36338:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 04:15:55.444953 9838 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:15:55.452598 9982 tablet_service.cc:1467] Processing CreateTablet for tablet be1d6393984f41baa100c8e6ba53504f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=20800f84ad044fa49582d43050a72ac4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 04:15:55.453038 10273 tablet_service.cc:1467] Processing CreateTablet for tablet be1d6393984f41baa100c8e6ba53504f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=20800f84ad044fa49582d43050a72ac4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 04:15:55.453040 10126 tablet_service.cc:1467] Processing CreateTablet for tablet be1d6393984f41baa100c8e6ba53504f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=20800f84ad044fa49582d43050a72ac4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 04:15:55.453747 9982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be1d6393984f41baa100c8e6ba53504f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:55.453938 10273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be1d6393984f41baa100c8e6ba53504f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:55.453938 10126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet be1d6393984f41baa100c8e6ba53504f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:55.460896 10376 tablet_bootstrap.cc:492] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc: Bootstrap starting.
I20260807 04:15:55.461232 10374 tablet_bootstrap.cc:492] T be1d6393984f41baa100c8e6ba53504f P 11f39c73a3f14e60b996f6fe75a13065: Bootstrap starting.
I20260807 04:15:55.461854 10372 tablet_bootstrap.cc:492] T be1d6393984f41baa100c8e6ba53504f P 8e570fe2440a4942a0ae7672e16c35cd: Bootstrap starting.
I20260807 04:15:55.462723 10376 tablet_bootstrap.cc:654] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:55.463007 10374 tablet_bootstrap.cc:654] T be1d6393984f41baa100c8e6ba53504f P 11f39c73a3f14e60b996f6fe75a13065: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:55.463718 10372 tablet_bootstrap.cc:654] T be1d6393984f41baa100c8e6ba53504f P 8e570fe2440a4942a0ae7672e16c35cd: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:55.465490 10376 tablet_bootstrap.cc:492] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc: No bootstrap required, opened a new log
I20260807 04:15:55.465744 10376 ts_tablet_manager.cc:1397] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 04:15:55.466421 10374 tablet_bootstrap.cc:492] T be1d6393984f41baa100c8e6ba53504f P 11f39c73a3f14e60b996f6fe75a13065: No bootstrap required, opened a new log
I20260807 04:15:55.466616 10374 ts_tablet_manager.cc:1397] T be1d6393984f41baa100c8e6ba53504f P 11f39c73a3f14e60b996f6fe75a13065: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260807 04:15:55.466892 10376 raft_consensus.cc:348] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:55.467134 10376 raft_consensus.cc:374] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:55.467208 10372 tablet_bootstrap.cc:492] T be1d6393984f41baa100c8e6ba53504f P 8e570fe2440a4942a0ae7672e16c35cd: No bootstrap required, opened a new log
I20260807 04:15:55.467247 10376 raft_consensus.cc:729] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 304a5465d44e4dd5a8c7504052cf4adc, State: Initialized, Role: FOLLOWER
I20260807 04:15:55.467360 10372 ts_tablet_manager.cc:1397] T be1d6393984f41baa100c8e6ba53504f P 8e570fe2440a4942a0ae7672e16c35cd: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260807 04:15:55.467509 10376 consensus_queue.cc:260] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:55.467463 10374 raft_consensus.cc:348] T be1d6393984f41baa100c8e6ba53504f P 11f39c73a3f14e60b996f6fe75a13065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:55.467703 10374 raft_consensus.cc:374] T be1d6393984f41baa100c8e6ba53504f P 11f39c73a3f14e60b996f6fe75a13065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:55.467798 10374 raft_consensus.cc:729] T be1d6393984f41baa100c8e6ba53504f P 11f39c73a3f14e60b996f6fe75a13065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11f39c73a3f14e60b996f6fe75a13065, State: Initialized, Role: FOLLOWER
I20260807 04:15:55.468068 10374 consensus_queue.cc:260] T be1d6393984f41baa100c8e6ba53504f P 11f39c73a3f14e60b996f6fe75a13065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:55.467998 10382 tablet_replica.cc:439] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } } }
I20260807 04:15:55.468168 10372 raft_consensus.cc:348] T be1d6393984f41baa100c8e6ba53504f P 8e570fe2440a4942a0ae7672e16c35cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:55.468385 10382 tablet_replica.cc:442] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:15:55.468449 10372 raft_consensus.cc:374] T be1d6393984f41baa100c8e6ba53504f P 8e570fe2440a4942a0ae7672e16c35cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:55.468619 10372 raft_consensus.cc:729] T be1d6393984f41baa100c8e6ba53504f P 8e570fe2440a4942a0ae7672e16c35cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e570fe2440a4942a0ae7672e16c35cd, State: Initialized, Role: FOLLOWER
I20260807 04:15:55.468523 10381 tablet_replica.cc:439] T be1d6393984f41baa100c8e6ba53504f P 11f39c73a3f14e60b996f6fe75a13065: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } } }
I20260807 04:15:55.468827 10381 tablet_replica.cc:442] T be1d6393984f41baa100c8e6ba53504f P 11f39c73a3f14e60b996f6fe75a13065: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:15:55.468945 10372 consensus_queue.cc:260] T be1d6393984f41baa100c8e6ba53504f P 8e570fe2440a4942a0ae7672e16c35cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:55.469383 10374 ts_tablet_manager.cc:1428] T be1d6393984f41baa100c8e6ba53504f P 11f39c73a3f14e60b996f6fe75a13065: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 04:15:55.469399 10380 tablet_replica.cc:439] T be1d6393984f41baa100c8e6ba53504f P 8e570fe2440a4942a0ae7672e16c35cd: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } } }
I20260807 04:15:55.469820 10380 tablet_replica.cc:442] T be1d6393984f41baa100c8e6ba53504f P 8e570fe2440a4942a0ae7672e16c35cd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:15:55.470516 10376 ts_tablet_manager.cc:1428] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260807 04:15:55.470583 10372 ts_tablet_manager.cc:1428] T be1d6393984f41baa100c8e6ba53504f P 8e570fe2440a4942a0ae7672e16c35cd: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 04:15:55.477658 10382 raft_consensus.cc:482] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:15:55.477902 10382 raft_consensus.cc:504] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:55.479669 10382 leader_election.cc:288] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e570fe2440a4942a0ae7672e16c35cd (127.7.200.194:34175), 11f39c73a3f14e60b996f6fe75a13065 (127.7.200.195:37009)
I20260807 04:15:55.487046 10370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.480598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:41355 (local address 127.7.200.194:34175)
0807 04:15:55.480849 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:55.480858 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:55.481144 (+ 286us) server_negotiation.cc:407] Connection header received
0807 04:15:55.481317 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:55.481325 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:55.481418 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:55.481514 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:15:55.482189 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.482940 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.484795 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.485799 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.485953 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.486036 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:55.486597 (+ 561us) server_negotiation.cc:299] Negotiation successful
0807 04:15:55.486744 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 04:15:55.487142 10398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.480078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:34175 (local address 127.7.200.193:41355)
0807 04:15:55.481039 (+ 961us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:55.481056 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:55.481182 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:55.481672 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:55.481676 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:55.481702 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:15:55.482027 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:55.482042 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.483084 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.483090 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:55.484621 (+ 1531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:55.484634 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.486175 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.486181 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:55.486353 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.486389 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 04:15:55.486540 (+ 151us) client_negotiation.cc:240] Negotiation successful
0807 04:15:55.486687 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":815,"mutex_wait_us":47,"thread_start_us":593,"threads_started":1}
I20260807 04:15:55.487792 10148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be1d6393984f41baa100c8e6ba53504f" candidate_uuid: "304a5465d44e4dd5a8c7504052cf4adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e570fe2440a4942a0ae7672e16c35cd" is_pre_election: true
I20260807 04:15:55.488061 10368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.480139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:38611 (local address 127.7.200.195:37009)
0807 04:15:55.480623 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:55.480628 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:55.481775 (+ 1147us) server_negotiation.cc:407] Connection header received
0807 04:15:55.482018 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:55.482023 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:55.482085 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:55.482201 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:15:55.482767 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.483521 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.485566 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.486826 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.487006 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.487095 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:55.487642 (+ 547us) server_negotiation.cc:299] Negotiation successful
0807 04:15:55.487764 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336}
I20260807 04:15:55.488097 10399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.480174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:37009 (local address 127.7.200.193:38611)
0807 04:15:55.481656 (+ 1482us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:55.481670 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:55.481853 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:55.482217 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:55.482222 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:55.482249 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:15:55.482574 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:55.482584 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.483687 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.483694 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:55.485384 (+ 1690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:55.485397 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.487260 (+ 1863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.487269 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:55.487475 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.487510 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 04:15:55.487614 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 04:15:55.487731 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1357,"mutex_wait_us":47,"thread_start_us":1196,"threads_started":1}
I20260807 04:15:55.488087 10148 raft_consensus.cc:2454] T be1d6393984f41baa100c8e6ba53504f P 8e570fe2440a4942a0ae7672e16c35cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 304a5465d44e4dd5a8c7504052cf4adc in term 0.
I20260807 04:15:55.488719 9931 leader_election.cc:302] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 304a5465d44e4dd5a8c7504052cf4adc, 8e570fe2440a4942a0ae7672e16c35cd; no voters:
I20260807 04:15:55.489177 10382 raft_consensus.cc:2781] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:15:55.489068 10295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be1d6393984f41baa100c8e6ba53504f" candidate_uuid: "304a5465d44e4dd5a8c7504052cf4adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11f39c73a3f14e60b996f6fe75a13065" is_pre_election: true
I20260807 04:15:55.489290 10382 raft_consensus.cc:482] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:15:55.489394 10382 raft_consensus.cc:3037] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:55.489547 10295 raft_consensus.cc:2454] T be1d6393984f41baa100c8e6ba53504f P 11f39c73a3f14e60b996f6fe75a13065 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 304a5465d44e4dd5a8c7504052cf4adc in term 0.
I20260807 04:15:55.491910 10382 raft_consensus.cc:504] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:55.492561 10382 leader_election.cc:288] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc [CANDIDATE]: Term 1 election: Requested vote from peers 8e570fe2440a4942a0ae7672e16c35cd (127.7.200.194:34175), 11f39c73a3f14e60b996f6fe75a13065 (127.7.200.195:37009)
I20260807 04:15:55.493083 10148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be1d6393984f41baa100c8e6ba53504f" candidate_uuid: "304a5465d44e4dd5a8c7504052cf4adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e570fe2440a4942a0ae7672e16c35cd"
I20260807 04:15:55.493362 10148 raft_consensus.cc:3037] T be1d6393984f41baa100c8e6ba53504f P 8e570fe2440a4942a0ae7672e16c35cd [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:55.493347 10295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be1d6393984f41baa100c8e6ba53504f" candidate_uuid: "304a5465d44e4dd5a8c7504052cf4adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11f39c73a3f14e60b996f6fe75a13065"
I20260807 04:15:55.493541 10295 raft_consensus.cc:3037] T be1d6393984f41baa100c8e6ba53504f P 11f39c73a3f14e60b996f6fe75a13065 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:55.495713 10148 raft_consensus.cc:2454] T be1d6393984f41baa100c8e6ba53504f P 8e570fe2440a4942a0ae7672e16c35cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 304a5465d44e4dd5a8c7504052cf4adc in term 1.
I20260807 04:15:55.495733 10295 raft_consensus.cc:2454] T be1d6393984f41baa100c8e6ba53504f P 11f39c73a3f14e60b996f6fe75a13065 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 304a5465d44e4dd5a8c7504052cf4adc in term 1.
I20260807 04:15:55.496142 9931 leader_election.cc:302] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 304a5465d44e4dd5a8c7504052cf4adc, 8e570fe2440a4942a0ae7672e16c35cd; no voters:
I20260807 04:15:55.496430 10382 raft_consensus.cc:2781] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:15:55.496977 10382 raft_consensus.cc:686] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc [term 1 LEADER]: Becoming Leader. State: Replica: 304a5465d44e4dd5a8c7504052cf4adc, State: Running, Role: LEADER
I20260807 04:15:55.497568 10382 consensus_queue.cc:237] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:55.501748 10400 tablet_replica.cc:439] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc: TxnStatusTablet state changed. Reason: New leader 304a5465d44e4dd5a8c7504052cf4adc. Latest consensus state: current_term: 1 leader_uuid: "304a5465d44e4dd5a8c7504052cf4adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } } }
I20260807 04:15:55.502208 10400 tablet_replica.cc:442] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc: This TxnStatusTablet replica's current role is: LEADER
I20260807 04:15:55.502482 9838 catalog_manager.cc:5495] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 304a5465d44e4dd5a8c7504052cf4adc (127.7.200.193). New cstate: current_term: 1 leader_uuid: "304a5465d44e4dd5a8c7504052cf4adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } health_report { overall_health: UNKNOWN } } }
I20260807 04:15:55.502972 10402 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 04:15:55.503261 10402 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 04:15:55.529446 10369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.522121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54064 (local address 127.7.200.193:37137)
0807 04:15:55.522307 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:55.522312 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:55.522687 (+ 375us) server_negotiation.cc:407] Connection header received
0807 04:15:55.522985 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:55.522990 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:55.523072 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:55.523230 (+ 158us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:15:55.523729 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.524594 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.526792 (+ 2198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.527373 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.527514 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.528145 (+ 631us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:15:55.528816 (+ 671us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:15:55.528945 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:55.529105 (+ 160us) server_negotiation.cc:299] Negotiation successful
0807 04:15:55.529187 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 04:15:55.529631 10393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.522154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37137 (local address 127.0.0.1:54064)
0807 04:15:55.522582 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:55.522606 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:55.522778 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:55.523294 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:55.523300 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:55.523318 (+ 18us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 04:15:55.523565 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:55.523579 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.524790 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.524797 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:55.526637 (+ 1840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:55.526655 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.527554 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.527562 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:55.527797 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.527883 (+ 86us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 04:15:55.528946 (+ 1063us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 04:15:55.528975 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 04:15:55.529084 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 04:15:55.529271 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233}
I20260807 04:15:55.537550 10148 raft_consensus.cc:1261] T be1d6393984f41baa100c8e6ba53504f P 8e570fe2440a4942a0ae7672e16c35cd [term 1 FOLLOWER]: Refusing update from remote peer 304a5465d44e4dd5a8c7504052cf4adc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:15:55.537583 10295 raft_consensus.cc:1261] T be1d6393984f41baa100c8e6ba53504f P 11f39c73a3f14e60b996f6fe75a13065 [term 1 FOLLOWER]: Refusing update from remote peer 304a5465d44e4dd5a8c7504052cf4adc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:15:55.538583 10400 consensus_queue.cc:1035] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:15:55.538929 10382 consensus_queue.cc:1035] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:15:55.548815 10381 tablet_replica.cc:439] T be1d6393984f41baa100c8e6ba53504f P 11f39c73a3f14e60b996f6fe75a13065: TxnStatusTablet state changed. Reason: New leader 304a5465d44e4dd5a8c7504052cf4adc. Latest consensus state: current_term: 1 leader_uuid: "304a5465d44e4dd5a8c7504052cf4adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } } }
I20260807 04:15:55.549252 10381 tablet_replica.cc:442] T be1d6393984f41baa100c8e6ba53504f P 11f39c73a3f14e60b996f6fe75a13065: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:15:55.551613 10380 tablet_replica.cc:439] T be1d6393984f41baa100c8e6ba53504f P 8e570fe2440a4942a0ae7672e16c35cd: TxnStatusTablet state changed. Reason: New leader 304a5465d44e4dd5a8c7504052cf4adc. Latest consensus state: current_term: 1 leader_uuid: "304a5465d44e4dd5a8c7504052cf4adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } } }
I20260807 04:15:55.551944 10380 tablet_replica.cc:442] T be1d6393984f41baa100c8e6ba53504f P 8e570fe2440a4942a0ae7672e16c35cd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:15:55.562552 10400 tablet_replica.cc:439] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "304a5465d44e4dd5a8c7504052cf4adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } } }
I20260807 04:15:55.562964 10400 tablet_replica.cc:442] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc: This TxnStatusTablet replica's current role is: LEADER
I20260807 04:15:55.563220 10400 tablet_replica.cc:439] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "304a5465d44e4dd5a8c7504052cf4adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } } }
I20260807 04:15:55.563516 10400 tablet_replica.cc:442] T be1d6393984f41baa100c8e6ba53504f P 304a5465d44e4dd5a8c7504052cf4adc: This TxnStatusTablet replica's current role is: LEADER
I20260807 04:15:55.568902 10381 tablet_replica.cc:439] T be1d6393984f41baa100c8e6ba53504f P 11f39c73a3f14e60b996f6fe75a13065: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "304a5465d44e4dd5a8c7504052cf4adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } } }
I20260807 04:15:55.569262 10381 tablet_replica.cc:442] T be1d6393984f41baa100c8e6ba53504f P 11f39c73a3f14e60b996f6fe75a13065: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:15:55.572348 10380 tablet_replica.cc:439] T be1d6393984f41baa100c8e6ba53504f P 8e570fe2440a4942a0ae7672e16c35cd: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "304a5465d44e4dd5a8c7504052cf4adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } } }
I20260807 04:15:55.572642 10380 tablet_replica.cc:442] T be1d6393984f41baa100c8e6ba53504f P 8e570fe2440a4942a0ae7672e16c35cd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:15:55.585671 10368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.579320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50928 (local address 127.7.200.195:37009)
0807 04:15:55.579542 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:55.579549 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:55.579697 (+ 148us) server_negotiation.cc:407] Connection header received
0807 04:15:55.579959 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:55.579965 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:55.580075 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:55.580242 (+ 167us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:15:55.580577 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.581818 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.583121 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.583742 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.583878 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.584290 (+ 412us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:15:55.585043 (+ 753us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:15:55.585190 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:55.585254 (+ 64us) server_negotiation.cc:299] Negotiation successful
0807 04:15:55.585340 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 04:15:55.602586 10326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.596777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37137 (local address 127.7.200.195:48357)
0807 04:15:55.596999 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:55.597020 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:55.597195 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:55.597618 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:55.597624 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:55.597639 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 04:15:55.597825 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:55.597835 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.599063 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.599069 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:55.600317 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:55.600330 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.601196 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.601203 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:55.601353 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.601409 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 04:15:55.601972 (+ 563us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 04:15:55.601984 (+ 12us) client_negotiation.cc:769] Sending connection context
0807 04:15:55.602076 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 04:15:55.602258 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260807 04:15:55.602591 10369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.596788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:48357 (local address 127.7.200.193:37137)
0807 04:15:55.596993 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:55.597000 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:55.597105 (+ 105us) server_negotiation.cc:407] Connection header received
0807 04:15:55.597406 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:55.597410 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:55.597488 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:55.597598 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:15:55.597977 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.598903 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.600464 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.601030 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.601170 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.601658 (+ 488us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:15:55.601763 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:15:55.601979 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:55.602116 (+ 137us) server_negotiation.cc:299] Negotiation successful
0807 04:15:55.602247 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 04:15:55.613194 10148 raft_consensus.cc:1261] T 8cd1feb8cf6a4e109fb440220216db10 P 8e570fe2440a4942a0ae7672e16c35cd [term 1 FOLLOWER]: Refusing update from remote peer 11f39c73a3f14e60b996f6fe75a13065: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:15:55.613300 10007 raft_consensus.cc:1261] T 8cd1feb8cf6a4e109fb440220216db10 P 304a5465d44e4dd5a8c7504052cf4adc [term 1 FOLLOWER]: Refusing update from remote peer 11f39c73a3f14e60b996f6fe75a13065: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:15:55.613945 10384 consensus_queue.cc:1035] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:15:55.614346 10381 consensus_queue.cc:1035] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065 [LEADER]: Connected to new peer: Peer: permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:15:55.638686 10405 mvcc.cc:205] Tried to move back new op lower bound from 7315767933385097216 to 7315767932373680128. Current Snapshot: MvccSnapshot[applied={T|T < 7315767933385097216}]
I20260807 04:15:55.665663 10368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.657430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:42045 (local address 127.7.200.195:37009)
0807 04:15:55.657685 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:55.657691 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:55.657846 (+ 155us) server_negotiation.cc:407] Connection header received
0807 04:15:55.658721 (+ 875us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:55.658728 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:55.658820 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:55.658887 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:15:55.659962 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.661111 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.663388 (+ 2277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.664044 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.664217 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.664825 (+ 608us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:15:55.664974 (+ 149us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:15:55.665042 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:55.665276 (+ 234us) server_negotiation.cc:299] Negotiation successful
0807 04:15:55.665370 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260807 04:15:55.666590 10422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.656918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:37009 (local address 127.7.200.193:42045)
0807 04:15:55.657733 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:55.657754 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:55.657973 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:55.659104 (+ 1131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:55.659111 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:55.659125 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 04:15:55.659739 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:55.659754 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.661308 (+ 1554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.661314 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:55.663225 (+ 1911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:55.663242 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.664279 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.664286 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:55.664493 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.664575 (+ 82us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 04:15:55.665126 (+ 551us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 04:15:55.665136 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 04:15:55.665929 (+ 793us) client_negotiation.cc:240] Negotiation successful
0807 04:15:55.666100 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":780,"threads_started":1}
I20260807 04:15:55.713495 9836 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36336:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:15:55.713863 9836 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36336:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:15:55.718775 9836 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7eb0ea83d3634f809742abd6525bbda0: Sending DeleteTablet for 3 replicas of tablet 8cd1feb8cf6a4e109fb440220216db10
I20260807 04:15:55.720288 10273 tablet_service.cc:1514] Processing DeleteTablet for tablet 8cd1feb8cf6a4e109fb440220216db10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:15:55 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:50922
I20260807 04:15:55.720530 10126 tablet_service.cc:1514] Processing DeleteTablet for tablet 8cd1feb8cf6a4e109fb440220216db10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:15:55 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:55130
I20260807 04:15:55.721231 9982 tablet_service.cc:1514] Processing DeleteTablet for tablet 8cd1feb8cf6a4e109fb440220216db10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:15:55 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:54050
I20260807 04:15:55.727380 9836 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36336:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:15:55.729897 9836 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:15:55.733438 10426 tablet_replica.cc:330] T 8cd1feb8cf6a4e109fb440220216db10 P 8e570fe2440a4942a0ae7672e16c35cd: stopping tablet replica
I20260807 04:15:55.733958 10426 raft_consensus.cc:2229] T 8cd1feb8cf6a4e109fb440220216db10 P 8e570fe2440a4942a0ae7672e16c35cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:15:55.734411 10426 raft_consensus.cc:2258] T 8cd1feb8cf6a4e109fb440220216db10 P 8e570fe2440a4942a0ae7672e16c35cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:15:55.736655 10426 ts_tablet_manager.cc:1905] T 8cd1feb8cf6a4e109fb440220216db10 P 8e570fe2440a4942a0ae7672e16c35cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:15:55.742677 10126 tablet_service.cc:1467] Processing CreateTablet for tablet 22e37366ab9e4c19905ac159709bfe95 (DEFAULT_TABLE table=test-table [id=8aef6e7fe2d24fbc9e61916786f862a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:15:55.743280 10126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22e37366ab9e4c19905ac159709bfe95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:55.743151 9981 tablet_service.cc:1467] Processing CreateTablet for tablet 22e37366ab9e4c19905ac159709bfe95 (DEFAULT_TABLE table=test-table [id=8aef6e7fe2d24fbc9e61916786f862a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:15:55.743362 10272 tablet_service.cc:1467] Processing CreateTablet for tablet 22e37366ab9e4c19905ac159709bfe95 (DEFAULT_TABLE table=test-table [id=8aef6e7fe2d24fbc9e61916786f862a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:15:55.743750 9981 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22e37366ab9e4c19905ac159709bfe95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:55.743961 10272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22e37366ab9e4c19905ac159709bfe95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:55.750591 10376 tablet_bootstrap.cc:492] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc: Bootstrap starting.
I20260807 04:15:55.750658 10372 tablet_bootstrap.cc:492] T 22e37366ab9e4c19905ac159709bfe95 P 8e570fe2440a4942a0ae7672e16c35cd: Bootstrap starting.
I20260807 04:15:55.752363 10376 tablet_bootstrap.cc:654] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:55.752825 10372 tablet_bootstrap.cc:654] T 22e37366ab9e4c19905ac159709bfe95 P 8e570fe2440a4942a0ae7672e16c35cd: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:55.755496 10427 tablet_replica.cc:330] T 8cd1feb8cf6a4e109fb440220216db10 P 304a5465d44e4dd5a8c7504052cf4adc: stopping tablet replica
I20260807 04:15:55.756028 10427 raft_consensus.cc:2229] T 8cd1feb8cf6a4e109fb440220216db10 P 304a5465d44e4dd5a8c7504052cf4adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:15:55.756541 10374 tablet_bootstrap.cc:492] T 22e37366ab9e4c19905ac159709bfe95 P 11f39c73a3f14e60b996f6fe75a13065: Bootstrap starting.
I20260807 04:15:55.758705 10374 tablet_bootstrap.cc:654] T 22e37366ab9e4c19905ac159709bfe95 P 11f39c73a3f14e60b996f6fe75a13065: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:55.759651 10426 ts_tablet_manager.cc:1918] T 8cd1feb8cf6a4e109fb440220216db10 P 8e570fe2440a4942a0ae7672e16c35cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 04:15:55.759822 10426 log.cc:1196] T 8cd1feb8cf6a4e109fb440220216db10 P 8e570fe2440a4942a0ae7672e16c35cd: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-1/wal/wals/8cd1feb8cf6a4e109fb440220216db10
I20260807 04:15:55.760417 10426 ts_tablet_manager.cc:1939] T 8cd1feb8cf6a4e109fb440220216db10 P 8e570fe2440a4942a0ae7672e16c35cd: Deleting consensus metadata
I20260807 04:15:55.763887 9819 catalog_manager.cc:4841] TS 8e570fe2440a4942a0ae7672e16c35cd (127.7.200.194:34175): tablet 8cd1feb8cf6a4e109fb440220216db10 (table test-table [id=3e9b5d125dbc491d9c7ef821d6029598]) successfully deleted
I20260807 04:15:55.767006 10427 raft_consensus.cc:2258] T 8cd1feb8cf6a4e109fb440220216db10 P 304a5465d44e4dd5a8c7504052cf4adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:15:55.768395 10425 tablet_replica.cc:330] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065: stopping tablet replica
I20260807 04:15:55.770920 10427 ts_tablet_manager.cc:1905] T 8cd1feb8cf6a4e109fb440220216db10 P 304a5465d44e4dd5a8c7504052cf4adc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:15:55.772300 10425 raft_consensus.cc:2229] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065 [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:15:55.773191 10374 tablet_bootstrap.cc:492] T 22e37366ab9e4c19905ac159709bfe95 P 11f39c73a3f14e60b996f6fe75a13065: No bootstrap required, opened a new log
I20260807 04:15:55.773656 10374 ts_tablet_manager.cc:1397] T 22e37366ab9e4c19905ac159709bfe95 P 11f39c73a3f14e60b996f6fe75a13065: Time spent bootstrapping tablet: real 0.017s user 0.009s sys 0.000s
I20260807 04:15:55.774686 10374 raft_consensus.cc:348] T 22e37366ab9e4c19905ac159709bfe95 P 11f39c73a3f14e60b996f6fe75a13065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:55.775065 10374 raft_consensus.cc:374] T 22e37366ab9e4c19905ac159709bfe95 P 11f39c73a3f14e60b996f6fe75a13065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:55.775193 10374 raft_consensus.cc:729] T 22e37366ab9e4c19905ac159709bfe95 P 11f39c73a3f14e60b996f6fe75a13065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11f39c73a3f14e60b996f6fe75a13065, State: Initialized, Role: FOLLOWER
I20260807 04:15:55.775552 10374 consensus_queue.cc:260] T 22e37366ab9e4c19905ac159709bfe95 P 11f39c73a3f14e60b996f6fe75a13065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:55.778817 10374 ts_tablet_manager.cc:1428] T 22e37366ab9e4c19905ac159709bfe95 P 11f39c73a3f14e60b996f6fe75a13065: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260807 04:15:55.781728 10425 raft_consensus.cc:2258] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:15:55.785147 10376 tablet_bootstrap.cc:492] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc: No bootstrap required, opened a new log
I20260807 04:15:55.785349 10376 ts_tablet_manager.cc:1397] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc: Time spent bootstrapping tablet: real 0.035s user 0.010s sys 0.008s
I20260807 04:15:55.786186 10376 raft_consensus.cc:348] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:55.786468 10376 raft_consensus.cc:374] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:55.786571 10376 raft_consensus.cc:729] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 304a5465d44e4dd5a8c7504052cf4adc, State: Initialized, Role: FOLLOWER
I20260807 04:15:55.787492 10425 ts_tablet_manager.cc:1905] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:15:55.788374 10372 tablet_bootstrap.cc:492] T 22e37366ab9e4c19905ac159709bfe95 P 8e570fe2440a4942a0ae7672e16c35cd: No bootstrap required, opened a new log
I20260807 04:15:55.788564 10372 ts_tablet_manager.cc:1397] T 22e37366ab9e4c19905ac159709bfe95 P 8e570fe2440a4942a0ae7672e16c35cd: Time spent bootstrapping tablet: real 0.038s user 0.006s sys 0.017s
I20260807 04:15:55.790759 10372 raft_consensus.cc:348] T 22e37366ab9e4c19905ac159709bfe95 P 8e570fe2440a4942a0ae7672e16c35cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:55.791103 10372 raft_consensus.cc:374] T 22e37366ab9e4c19905ac159709bfe95 P 8e570fe2440a4942a0ae7672e16c35cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:55.791195 10372 raft_consensus.cc:729] T 22e37366ab9e4c19905ac159709bfe95 P 8e570fe2440a4942a0ae7672e16c35cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e570fe2440a4942a0ae7672e16c35cd, State: Initialized, Role: FOLLOWER
I20260807 04:15:55.791728 10372 consensus_queue.cc:260] T 22e37366ab9e4c19905ac159709bfe95 P 8e570fe2440a4942a0ae7672e16c35cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:55.786854 10376 consensus_queue.cc:260] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:55.793958 10372 ts_tablet_manager.cc:1428] T 22e37366ab9e4c19905ac159709bfe95 P 8e570fe2440a4942a0ae7672e16c35cd: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260807 04:15:55.794430 10376 ts_tablet_manager.cc:1428] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260807 04:15:55.798622 10427 ts_tablet_manager.cc:1918] T 8cd1feb8cf6a4e109fb440220216db10 P 304a5465d44e4dd5a8c7504052cf4adc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 04:15:55.798882 10427 log.cc:1196] T 8cd1feb8cf6a4e109fb440220216db10 P 304a5465d44e4dd5a8c7504052cf4adc: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-0/wal/wals/8cd1feb8cf6a4e109fb440220216db10
I20260807 04:15:55.799592 10427 ts_tablet_manager.cc:1939] T 8cd1feb8cf6a4e109fb440220216db10 P 304a5465d44e4dd5a8c7504052cf4adc: Deleting consensus metadata
I20260807 04:15:55.801564 9819 catalog_manager.cc:4841] TS 304a5465d44e4dd5a8c7504052cf4adc (127.7.200.193:37137): tablet 8cd1feb8cf6a4e109fb440220216db10 (table test-table [id=3e9b5d125dbc491d9c7ef821d6029598]) successfully deleted
I20260807 04:15:55.804687 10425 ts_tablet_manager.cc:1918] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 04:15:55.804917 10425 log.cc:1196] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-2/wal/wals/8cd1feb8cf6a4e109fb440220216db10
I20260807 04:15:55.805562 10425 ts_tablet_manager.cc:1939] T 8cd1feb8cf6a4e109fb440220216db10 P 11f39c73a3f14e60b996f6fe75a13065: Deleting consensus metadata
I20260807 04:15:55.807610 9821 catalog_manager.cc:4841] TS 11f39c73a3f14e60b996f6fe75a13065 (127.7.200.195:37009): tablet 8cd1feb8cf6a4e109fb440220216db10 (table test-table [id=3e9b5d125dbc491d9c7ef821d6029598]) successfully deleted
I20260807 04:15:55.825493 10414 raft_consensus.cc:482] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:15:55.825732 10414 raft_consensus.cc:504] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:55.826669 10414 leader_election.cc:288] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e570fe2440a4942a0ae7672e16c35cd (127.7.200.194:34175), 11f39c73a3f14e60b996f6fe75a13065 (127.7.200.195:37009)
I20260807 04:15:55.827522 10295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22e37366ab9e4c19905ac159709bfe95" candidate_uuid: "304a5465d44e4dd5a8c7504052cf4adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11f39c73a3f14e60b996f6fe75a13065" is_pre_election: true
I20260807 04:15:55.827531 10148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22e37366ab9e4c19905ac159709bfe95" candidate_uuid: "304a5465d44e4dd5a8c7504052cf4adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e570fe2440a4942a0ae7672e16c35cd" is_pre_election: true
I20260807 04:15:55.827801 10295 raft_consensus.cc:2454] T 22e37366ab9e4c19905ac159709bfe95 P 11f39c73a3f14e60b996f6fe75a13065 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 304a5465d44e4dd5a8c7504052cf4adc in term 0.
I20260807 04:15:55.827847 10148 raft_consensus.cc:2454] T 22e37366ab9e4c19905ac159709bfe95 P 8e570fe2440a4942a0ae7672e16c35cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 304a5465d44e4dd5a8c7504052cf4adc in term 0.
I20260807 04:15:55.828444 9932 leader_election.cc:302] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11f39c73a3f14e60b996f6fe75a13065, 304a5465d44e4dd5a8c7504052cf4adc; no voters:
I20260807 04:15:55.828819 10414 raft_consensus.cc:2781] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:15:55.829007 10414 raft_consensus.cc:482] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:15:55.829407 10414 raft_consensus.cc:3037] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:55.832438 10414 raft_consensus.cc:504] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:55.833772 10148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22e37366ab9e4c19905ac159709bfe95" candidate_uuid: "304a5465d44e4dd5a8c7504052cf4adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e570fe2440a4942a0ae7672e16c35cd"
I20260807 04:15:55.833789 10295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22e37366ab9e4c19905ac159709bfe95" candidate_uuid: "304a5465d44e4dd5a8c7504052cf4adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11f39c73a3f14e60b996f6fe75a13065"
I20260807 04:15:55.834031 10295 raft_consensus.cc:3037] T 22e37366ab9e4c19905ac159709bfe95 P 11f39c73a3f14e60b996f6fe75a13065 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:55.834038 10148 raft_consensus.cc:3037] T 22e37366ab9e4c19905ac159709bfe95 P 8e570fe2440a4942a0ae7672e16c35cd [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:55.837430 10148 raft_consensus.cc:2454] T 22e37366ab9e4c19905ac159709bfe95 P 8e570fe2440a4942a0ae7672e16c35cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 304a5465d44e4dd5a8c7504052cf4adc in term 1.
I20260807 04:15:55.837503 10295 raft_consensus.cc:2454] T 22e37366ab9e4c19905ac159709bfe95 P 11f39c73a3f14e60b996f6fe75a13065 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 304a5465d44e4dd5a8c7504052cf4adc in term 1.
I20260807 04:15:55.837981 9932 leader_election.cc:302] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 11f39c73a3f14e60b996f6fe75a13065, 304a5465d44e4dd5a8c7504052cf4adc, 8e570fe2440a4942a0ae7672e16c35cd; no voters:
I20260807 04:15:55.838390 10400 raft_consensus.cc:2781] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:15:55.838564 10414 leader_election.cc:288] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc [CANDIDATE]: Term 1 election: Requested vote from peers 8e570fe2440a4942a0ae7672e16c35cd (127.7.200.194:34175), 11f39c73a3f14e60b996f6fe75a13065 (127.7.200.195:37009)
I20260807 04:15:55.838620 10400 raft_consensus.cc:686] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc [term 1 LEADER]: Becoming Leader. State: Replica: 304a5465d44e4dd5a8c7504052cf4adc, State: Running, Role: LEADER
I20260807 04:15:55.839375 10400 consensus_queue.cc:237] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:55.842744 9836 catalog_manager.cc:5495] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 304a5465d44e4dd5a8c7504052cf4adc (127.7.200.193). New cstate: current_term: 1 leader_uuid: "304a5465d44e4dd5a8c7504052cf4adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } health_report { overall_health: UNKNOWN } } }
I20260807 04:15:55.875237 10369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.868450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54066 (local address 127.7.200.193:37137)
0807 04:15:55.868659 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:55.868666 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:55.869240 (+ 574us) server_negotiation.cc:407] Connection header received
0807 04:15:55.869306 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:55.869310 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:55.869384 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:55.869503 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:15:55.869974 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.870900 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.872395 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.873173 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.873332 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.874161 (+ 829us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:15:55.874344 (+ 183us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:15:55.874463 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:55.874635 (+ 172us) server_negotiation.cc:299] Negotiation successful
0807 04:15:55.874741 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 04:15:55.891068 10369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.884957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:36661 (local address 127.7.200.193:37137)
0807 04:15:55.885460 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:55.885467 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:55.885485 (+ 18us) server_negotiation.cc:407] Connection header received
0807 04:15:55.885655 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:55.885661 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:55.885741 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:55.885865 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:15:55.886351 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.887465 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.889175 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.889654 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.889802 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.890178 (+ 376us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:15:55.890303 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:15:55.890423 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:55.890567 (+ 144us) server_negotiation.cc:299] Negotiation successful
0807 04:15:55.890642 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":380}
I20260807 04:15:55.891068 10422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:55.885104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37137 (local address 127.7.200.193:36661)
0807 04:15:55.885330 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:55.885354 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:55.885502 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:55.885880 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:55.885885 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:55.885896 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 04:15:55.886173 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:55.886183 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.887625 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.887630 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:55.889013 (+ 1383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:55.889028 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:55.889817 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:55.889823 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:55.889976 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:55.890013 (+ 37us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 04:15:55.890421 (+ 408us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 04:15:55.890432 (+ 11us) client_negotiation.cc:769] Sending connection context
0807 04:15:55.890547 (+ 115us) client_negotiation.cc:240] Negotiation successful
0807 04:15:55.890694 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"mutex_wait_us":36}
I20260807 04:15:55.903044 10148 raft_consensus.cc:1261] T 22e37366ab9e4c19905ac159709bfe95 P 8e570fe2440a4942a0ae7672e16c35cd [term 1 FOLLOWER]: Refusing update from remote peer 304a5465d44e4dd5a8c7504052cf4adc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:15:55.903905 10414 consensus_queue.cc:1035] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:15:55.904124 10295 raft_consensus.cc:1261] T 22e37366ab9e4c19905ac159709bfe95 P 11f39c73a3f14e60b996f6fe75a13065 [term 1 FOLLOWER]: Refusing update from remote peer 304a5465d44e4dd5a8c7504052cf4adc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:15:55.904991 10414 consensus_queue.cc:1035] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:15:55.923216 10406 mvcc.cc:205] Tried to move back new op lower bound from 7315767934570029056 to 7315767934321152000. Current Snapshot: MvccSnapshot[applied={T|T < 7315767934570029056}]
W20260807 04:15:55.952787 10405 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 04:15:57.581244 9836 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36336:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:15:57.581462 9836 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36336:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:15:57.585945 9836 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7eb0ea83d3634f809742abd6525bbda0: Sending DeleteTablet for 3 replicas of tablet 22e37366ab9e4c19905ac159709bfe95
I20260807 04:15:57.586807 9981 tablet_service.cc:1514] Processing DeleteTablet for tablet 22e37366ab9e4c19905ac159709bfe95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:15:57 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:54050
I20260807 04:15:57.586966 10126 tablet_service.cc:1514] Processing DeleteTablet for tablet 22e37366ab9e4c19905ac159709bfe95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:15:57 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:55130
I20260807 04:15:57.587361 10273 tablet_service.cc:1514] Processing DeleteTablet for tablet 22e37366ab9e4c19905ac159709bfe95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:15:57 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:50922
I20260807 04:15:57.598505 10460 tablet_replica.cc:330] T 22e37366ab9e4c19905ac159709bfe95 P 8e570fe2440a4942a0ae7672e16c35cd: stopping tablet replica
I20260807 04:15:57.598984 10460 raft_consensus.cc:2229] T 22e37366ab9e4c19905ac159709bfe95 P 8e570fe2440a4942a0ae7672e16c35cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:15:57.599411 10460 raft_consensus.cc:2258] T 22e37366ab9e4c19905ac159709bfe95 P 8e570fe2440a4942a0ae7672e16c35cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:15:57.600772 10460 ts_tablet_manager.cc:1905] T 22e37366ab9e4c19905ac159709bfe95 P 8e570fe2440a4942a0ae7672e16c35cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:15:57.601312 10461 tablet_replica.cc:330] T 22e37366ab9e4c19905ac159709bfe95 P 11f39c73a3f14e60b996f6fe75a13065: stopping tablet replica
I20260807 04:15:57.601574 10459 tablet_replica.cc:330] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc: stopping tablet replica
I20260807 04:15:57.601591 10461 raft_consensus.cc:2229] T 22e37366ab9e4c19905ac159709bfe95 P 11f39c73a3f14e60b996f6fe75a13065 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:15:57.601805 10459 raft_consensus.cc:2229] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:15:57.601879 10461 raft_consensus.cc:2258] T 22e37366ab9e4c19905ac159709bfe95 P 11f39c73a3f14e60b996f6fe75a13065 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:15:57.602463 10459 raft_consensus.cc:2258] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:15:57.603601 10459 ts_tablet_manager.cc:1905] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:15:57.605437 10461 ts_tablet_manager.cc:1905] T 22e37366ab9e4c19905ac159709bfe95 P 11f39c73a3f14e60b996f6fe75a13065: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:15:57.609979 10460 ts_tablet_manager.cc:1918] T 22e37366ab9e4c19905ac159709bfe95 P 8e570fe2440a4942a0ae7672e16c35cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 04:15:57.610078 10459 ts_tablet_manager.cc:1918] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 04:15:57.610198 10460 log.cc:1196] T 22e37366ab9e4c19905ac159709bfe95 P 8e570fe2440a4942a0ae7672e16c35cd: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-1/wal/wals/22e37366ab9e4c19905ac159709bfe95
I20260807 04:15:57.610302 10459 log.cc:1196] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-0/wal/wals/22e37366ab9e4c19905ac159709bfe95
I20260807 04:15:57.610766 10460 ts_tablet_manager.cc:1939] T 22e37366ab9e4c19905ac159709bfe95 P 8e570fe2440a4942a0ae7672e16c35cd: Deleting consensus metadata
I20260807 04:15:57.610855 10459 ts_tablet_manager.cc:1939] T 22e37366ab9e4c19905ac159709bfe95 P 304a5465d44e4dd5a8c7504052cf4adc: Deleting consensus metadata
I20260807 04:15:57.612159 9819 catalog_manager.cc:4841] TS 8e570fe2440a4942a0ae7672e16c35cd (127.7.200.194:34175): tablet 22e37366ab9e4c19905ac159709bfe95 (table test-table [id=8aef6e7fe2d24fbc9e61916786f862a6]) successfully deleted
I20260807 04:15:57.612489 9819 catalog_manager.cc:4841] TS 304a5465d44e4dd5a8c7504052cf4adc (127.7.200.193:37137): tablet 22e37366ab9e4c19905ac159709bfe95 (table test-table [id=8aef6e7fe2d24fbc9e61916786f862a6]) successfully deleted
I20260807 04:15:57.612612 10461 ts_tablet_manager.cc:1918] T 22e37366ab9e4c19905ac159709bfe95 P 11f39c73a3f14e60b996f6fe75a13065: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 04:15:57.612774 10461 log.cc:1196] T 22e37366ab9e4c19905ac159709bfe95 P 11f39c73a3f14e60b996f6fe75a13065: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-2/wal/wals/22e37366ab9e4c19905ac159709bfe95
I20260807 04:15:57.613163 10461 ts_tablet_manager.cc:1939] T 22e37366ab9e4c19905ac159709bfe95 P 11f39c73a3f14e60b996f6fe75a13065: Deleting consensus metadata
I20260807 04:15:57.614297 9821 catalog_manager.cc:4841] TS 11f39c73a3f14e60b996f6fe75a13065 (127.7.200.195:37009): tablet 22e37366ab9e4c19905ac159709bfe95 (table test-table [id=8aef6e7fe2d24fbc9e61916786f862a6]) successfully deleted
Aug 07 04:15:57 dist-test-slave-qg60 krb5kdc[9789](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076157, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 04:15:57 dist-test-slave-qg60 krb5kdc[9789](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076157, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:15:57.656553 10472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:57.639572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36342 (local address 127.7.200.254:44039)
0807 04:15:57.640449 (+ 877us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:57.640454 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:57.640474 (+ 20us) server_negotiation.cc:407] Connection header received
0807 04:15:57.640531 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:57.640536 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:57.640599 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:57.640693 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:57.642447 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:57.643249 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:57.645215 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:57.645614 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:57.645717 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:57.650762 (+ 5045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:57.650767 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:57.650770 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:57.650806 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:57.653813 (+ 3007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:57.654607 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:57.654612 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:57.654615 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:57.654767 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:57.655106 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:57.655109 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:57.655111 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:57.655482 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:57.655675 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:57.655975 (+ 300us) server_negotiation.cc:299] Negotiation successful
0807 04:15:57.656167 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":763,"thread_start_us":586,"threads_started":1}
I20260807 04:15:57.660022 9836 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36342:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:15:57.660671 9836 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:15:57.667344 9981 tablet_service.cc:1467] Processing CreateTablet for tablet d5e343870c854b4bb61bbc00d0ae6ff6 (DEFAULT_TABLE table=test-table [id=3de80a262f9048e795621cab9553d347]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:15:57.667455 10126 tablet_service.cc:1467] Processing CreateTablet for tablet d5e343870c854b4bb61bbc00d0ae6ff6 (DEFAULT_TABLE table=test-table [id=3de80a262f9048e795621cab9553d347]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:15:57.667708 10273 tablet_service.cc:1467] Processing CreateTablet for tablet d5e343870c854b4bb61bbc00d0ae6ff6 (DEFAULT_TABLE table=test-table [id=3de80a262f9048e795621cab9553d347]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:15:57.667862 9981 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5e343870c854b4bb61bbc00d0ae6ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:57.667922 10126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5e343870c854b4bb61bbc00d0ae6ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:57.668147 10273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5e343870c854b4bb61bbc00d0ae6ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:57.675195 10475 tablet_bootstrap.cc:492] T d5e343870c854b4bb61bbc00d0ae6ff6 P 11f39c73a3f14e60b996f6fe75a13065: Bootstrap starting.
I20260807 04:15:57.675959 10476 tablet_bootstrap.cc:492] T d5e343870c854b4bb61bbc00d0ae6ff6 P 304a5465d44e4dd5a8c7504052cf4adc: Bootstrap starting.
I20260807 04:15:57.677363 10474 tablet_bootstrap.cc:492] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd: Bootstrap starting.
I20260807 04:15:57.678097 10476 tablet_bootstrap.cc:654] T d5e343870c854b4bb61bbc00d0ae6ff6 P 304a5465d44e4dd5a8c7504052cf4adc: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:57.678987 10474 tablet_bootstrap.cc:654] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:57.680686 10475 tablet_bootstrap.cc:654] T d5e343870c854b4bb61bbc00d0ae6ff6 P 11f39c73a3f14e60b996f6fe75a13065: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:57.681193 10474 tablet_bootstrap.cc:492] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd: No bootstrap required, opened a new log
I20260807 04:15:57.681365 10474 ts_tablet_manager.cc:1397] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260807 04:15:57.682319 10474 raft_consensus.cc:348] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:57.682607 10474 raft_consensus.cc:374] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:57.682744 10474 raft_consensus.cc:729] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e570fe2440a4942a0ae7672e16c35cd, State: Initialized, Role: FOLLOWER
I20260807 04:15:57.682875 10476 tablet_bootstrap.cc:492] T d5e343870c854b4bb61bbc00d0ae6ff6 P 304a5465d44e4dd5a8c7504052cf4adc: No bootstrap required, opened a new log
I20260807 04:15:57.682992 10475 tablet_bootstrap.cc:492] T d5e343870c854b4bb61bbc00d0ae6ff6 P 11f39c73a3f14e60b996f6fe75a13065: No bootstrap required, opened a new log
I20260807 04:15:57.683117 10476 ts_tablet_manager.cc:1397] T d5e343870c854b4bb61bbc00d0ae6ff6 P 304a5465d44e4dd5a8c7504052cf4adc: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260807 04:15:57.683130 10475 ts_tablet_manager.cc:1397] T d5e343870c854b4bb61bbc00d0ae6ff6 P 11f39c73a3f14e60b996f6fe75a13065: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260807 04:15:57.683024 10474 consensus_queue.cc:260] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:57.683951 10474 ts_tablet_manager.cc:1428] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 04:15:57.683898 10475 raft_consensus.cc:348] T d5e343870c854b4bb61bbc00d0ae6ff6 P 11f39c73a3f14e60b996f6fe75a13065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:57.683902 10476 raft_consensus.cc:348] T d5e343870c854b4bb61bbc00d0ae6ff6 P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:57.684222 10476 raft_consensus.cc:374] T d5e343870c854b4bb61bbc00d0ae6ff6 P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:57.684214 10475 raft_consensus.cc:374] T d5e343870c854b4bb61bbc00d0ae6ff6 P 11f39c73a3f14e60b996f6fe75a13065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:57.684329 10476 raft_consensus.cc:729] T d5e343870c854b4bb61bbc00d0ae6ff6 P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 304a5465d44e4dd5a8c7504052cf4adc, State: Initialized, Role: FOLLOWER
I20260807 04:15:57.684327 10475 raft_consensus.cc:729] T d5e343870c854b4bb61bbc00d0ae6ff6 P 11f39c73a3f14e60b996f6fe75a13065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11f39c73a3f14e60b996f6fe75a13065, State: Initialized, Role: FOLLOWER
I20260807 04:15:57.684578 10475 consensus_queue.cc:260] T d5e343870c854b4bb61bbc00d0ae6ff6 P 11f39c73a3f14e60b996f6fe75a13065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:57.684623 10476 consensus_queue.cc:260] T d5e343870c854b4bb61bbc00d0ae6ff6 P 304a5465d44e4dd5a8c7504052cf4adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:57.686058 10475 ts_tablet_manager.cc:1428] T d5e343870c854b4bb61bbc00d0ae6ff6 P 11f39c73a3f14e60b996f6fe75a13065: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 04:15:57.687050 10481 raft_consensus.cc:482] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:15:57.687309 10481 raft_consensus.cc:504] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:57.688051 10476 ts_tablet_manager.cc:1428] T d5e343870c854b4bb61bbc00d0ae6ff6 P 304a5465d44e4dd5a8c7504052cf4adc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 04:15:57.693056 10481 leader_election.cc:288] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 304a5465d44e4dd5a8c7504052cf4adc (127.7.200.193:37137), 11f39c73a3f14e60b996f6fe75a13065 (127.7.200.195:37009)
I20260807 04:15:57.701994 10483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:57.689787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37137 (local address 127.7.200.194:40501)
0807 04:15:57.690410 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:57.690438 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:57.690584 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:57.694166 (+ 3582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:57.694176 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:57.694228 (+ 52us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:15:57.694738 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:57.694755 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:57.695984 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:57.695993 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:57.698935 (+ 2942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:57.698961 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:57.700699 (+ 1738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:57.700710 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:57.701006 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:57.701075 (+ 69us) client_negotiation.cc:769] Sending connection context
0807 04:15:57.701197 (+ 122us) client_negotiation.cc:240] Negotiation successful
0807 04:15:57.701405 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"spinlock_wait_cycles":13952,"thread_start_us":554,"threads_started":1}
I20260807 04:15:57.702988 10484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:57.690187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:40501 (local address 127.7.200.193:37137)
0807 04:15:57.693735 (+ 3548us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:57.693743 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:57.693774 (+ 31us) server_negotiation.cc:407] Connection header received
0807 04:15:57.693852 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:57.693858 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:57.693942 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:57.694107 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:15:57.694977 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:57.695826 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:57.699133 (+ 3307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:57.700469 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:57.700684 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:57.700801 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:57.702315 (+ 1514us) server_negotiation.cc:299] Negotiation successful
0807 04:15:57.702532 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3344,"thread_start_us":3196,"threads_started":1}
I20260807 04:15:57.703680 10007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5e343870c854b4bb61bbc00d0ae6ff6" candidate_uuid: "8e570fe2440a4942a0ae7672e16c35cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "304a5465d44e4dd5a8c7504052cf4adc" is_pre_election: true
I20260807 04:15:57.703966 10007 raft_consensus.cc:2454] T d5e343870c854b4bb61bbc00d0ae6ff6 P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e570fe2440a4942a0ae7672e16c35cd in term 0.
I20260807 04:15:57.704574 10076 leader_election.cc:302] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 304a5465d44e4dd5a8c7504052cf4adc, 8e570fe2440a4942a0ae7672e16c35cd; no voters:
I20260807 04:15:57.705144 10481 raft_consensus.cc:2781] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:15:57.705300 10481 raft_consensus.cc:482] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:15:57.705412 10481 raft_consensus.cc:3037] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:57.708595 10481 raft_consensus.cc:504] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:57.709848 10481 leader_election.cc:288] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd [CANDIDATE]: Term 1 election: Requested vote from peers 304a5465d44e4dd5a8c7504052cf4adc (127.7.200.193:37137), 11f39c73a3f14e60b996f6fe75a13065 (127.7.200.195:37009)
I20260807 04:15:57.710294 10007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5e343870c854b4bb61bbc00d0ae6ff6" candidate_uuid: "8e570fe2440a4942a0ae7672e16c35cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "304a5465d44e4dd5a8c7504052cf4adc"
I20260807 04:15:57.710549 10007 raft_consensus.cc:3037] T d5e343870c854b4bb61bbc00d0ae6ff6 P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:57.712167 10485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:57.693450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:37009 (local address 127.7.200.194:42307)
0807 04:15:57.694181 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:57.694202 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:57.694334 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:57.705665 (+ 11331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:57.705669 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:57.705698 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:15:57.706026 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:57.706065 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:57.707649 (+ 1584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:57.707659 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:57.709771 (+ 2112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:57.709789 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:57.711511 (+ 1722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:57.711516 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:57.711649 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:57.711675 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 04:15:57.711759 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 04:15:57.711857 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"spinlock_wait_cycles":768,"thread_start_us":349,"threads_started":1}
I20260807 04:15:57.712307 10486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:57.693714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:42307 (local address 127.7.200.195:37009)
0807 04:15:57.705267 (+ 11553us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:57.705276 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:57.705305 (+ 29us) server_negotiation.cc:407] Connection header received
0807 04:15:57.705412 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:57.705418 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:57.705520 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:57.705640 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:15:57.706251 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:57.707422 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:57.709999 (+ 2577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:57.711301 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:57.711504 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:57.711584 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:57.711818 (+ 234us) server_negotiation.cc:299] Negotiation successful
0807 04:15:57.711978 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11399,"thread_start_us":11238,"threads_started":1}
I20260807 04:15:57.713145 10294 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5e343870c854b4bb61bbc00d0ae6ff6" candidate_uuid: "8e570fe2440a4942a0ae7672e16c35cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11f39c73a3f14e60b996f6fe75a13065" is_pre_election: true
I20260807 04:15:57.713251 10293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5e343870c854b4bb61bbc00d0ae6ff6" candidate_uuid: "8e570fe2440a4942a0ae7672e16c35cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11f39c73a3f14e60b996f6fe75a13065"
I20260807 04:15:57.713447 10294 raft_consensus.cc:2454] T d5e343870c854b4bb61bbc00d0ae6ff6 P 11f39c73a3f14e60b996f6fe75a13065 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e570fe2440a4942a0ae7672e16c35cd in term 0.
I20260807 04:15:57.713661 10007 raft_consensus.cc:2454] T d5e343870c854b4bb61bbc00d0ae6ff6 P 304a5465d44e4dd5a8c7504052cf4adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e570fe2440a4942a0ae7672e16c35cd in term 1.
I20260807 04:15:57.714118 10076 leader_election.cc:302] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 304a5465d44e4dd5a8c7504052cf4adc, 8e570fe2440a4942a0ae7672e16c35cd; no voters:
I20260807 04:15:57.714490 10481 raft_consensus.cc:2781] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:15:57.714963 10481 raft_consensus.cc:686] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd [term 1 LEADER]: Becoming Leader. State: Replica: 8e570fe2440a4942a0ae7672e16c35cd, State: Running, Role: LEADER
I20260807 04:15:57.715404 10481 consensus_queue.cc:237] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:57.719077 9836 catalog_manager.cc:5495] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e570fe2440a4942a0ae7672e16c35cd (127.7.200.194). New cstate: current_term: 1 leader_uuid: "8e570fe2440a4942a0ae7672e16c35cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } health_report { overall_health: UNKNOWN } } }
I20260807 04:15:57.753021 10490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:57.746730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55136 (local address 127.7.200.194:34175)
0807 04:15:57.747367 (+ 637us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:57.747371 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:57.747390 (+ 19us) server_negotiation.cc:407] Connection header received
0807 04:15:57.747473 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:57.747477 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:57.747578 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:57.747761 (+ 183us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:15:57.748270 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:57.749177 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:57.750479 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:57.750942 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:57.751082 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:57.751627 (+ 545us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:15:57.752289 (+ 662us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:15:57.752471 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:57.752553 (+ 82us) server_negotiation.cc:299] Negotiation successful
0807 04:15:57.752648 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":320,"threads_started":1}
I20260807 04:15:57.768364 10484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:57.763098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:60287 (local address 127.7.200.193:37137)
0807 04:15:57.763303 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:57.763307 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:57.763892 (+ 585us) server_negotiation.cc:407] Connection header received
0807 04:15:57.764064 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:57.764068 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:57.764134 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:57.764212 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:15:57.764673 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:57.765422 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:57.766800 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:57.767203 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:57.767295 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:57.767691 (+ 396us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:15:57.767798 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:15:57.767866 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:57.768019 (+ 153us) server_negotiation.cc:299] Negotiation successful
0807 04:15:57.768088 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260807 04:15:57.768424 10494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:57.763046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37137 (local address 127.7.200.194:60287)
0807 04:15:57.763804 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:57.763821 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:57.763943 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:57.764241 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:57.764244 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:57.764253 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 04:15:57.764546 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:57.764553 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:57.765551 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:57.765555 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:57.766670 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:57.766683 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:57.767352 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:57.767356 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:57.767496 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:57.767546 (+ 50us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 04:15:57.767882 (+ 336us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 04:15:57.767909 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 04:15:57.767991 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 04:15:57.768092 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":606,"thread_start_us":424,"threads_started":1}
I20260807 04:15:57.777173 10293 raft_consensus.cc:3037] T d5e343870c854b4bb61bbc00d0ae6ff6 P 11f39c73a3f14e60b996f6fe75a13065 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:57.777393 10007 raft_consensus.cc:1261] T d5e343870c854b4bb61bbc00d0ae6ff6 P 304a5465d44e4dd5a8c7504052cf4adc [term 1 FOLLOWER]: Refusing update from remote peer 8e570fe2440a4942a0ae7672e16c35cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:15:57.778121 10487 consensus_queue.cc:1035] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:15:57.780342 10293 raft_consensus.cc:1261] T d5e343870c854b4bb61bbc00d0ae6ff6 P 11f39c73a3f14e60b996f6fe75a13065 [term 1 FOLLOWER]: Refusing update from remote peer 8e570fe2440a4942a0ae7672e16c35cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:15:57.780942 10487 consensus_queue.cc:1035] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:15:57.805146 10490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:57.799316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:32959 (local address 127.7.200.194:34175)
0807 04:15:57.799500 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:57.799506 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:57.800027 (+ 521us) server_negotiation.cc:407] Connection header received
0807 04:15:57.800170 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:57.800174 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:57.800278 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:57.800361 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:15:57.800834 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:57.801689 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:57.803487 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:57.803931 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:57.804031 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:57.804420 (+ 389us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:15:57.804515 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:15:57.804584 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:57.804790 (+ 206us) server_negotiation.cc:299] Negotiation successful
0807 04:15:57.804859 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 04:15:57.805276 10498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:57.799200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:34175 (local address 127.7.200.193:32959)
0807 04:15:57.799930 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0807 04:15:57.799947 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 04:15:57.800080 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:15:57.800394 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:15:57.800397 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:15:57.800406 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 04:15:57.800653 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:57.800660 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:57.801855 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:57.801859 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:57.803357 (+ 1498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:15:57.803370 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:15:57.804117 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:15:57.804122 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:15:57.804243 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:57.804282 (+ 39us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 04:15:57.804605 (+ 323us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 04:15:57.804614 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 04:15:57.804675 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 04:15:57.804846 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":481,"threads_started":1}
I20260807 04:15:57.841230 9837 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36342:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:15:57.841526 9837 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36342:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:15:57.845207 9837 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7eb0ea83d3634f809742abd6525bbda0: Sending DeleteTablet for 3 replicas of tablet d5e343870c854b4bb61bbc00d0ae6ff6
I20260807 04:15:57.846175 9981 tablet_service.cc:1514] Processing DeleteTablet for tablet d5e343870c854b4bb61bbc00d0ae6ff6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:15:57 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:54050
I20260807 04:15:57.846246 10126 tablet_service.cc:1514] Processing DeleteTablet for tablet d5e343870c854b4bb61bbc00d0ae6ff6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:15:57 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:55130
I20260807 04:15:57.846299 10273 tablet_service.cc:1514] Processing DeleteTablet for tablet d5e343870c854b4bb61bbc00d0ae6ff6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:15:57 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:50922
I20260807 04:15:57.846565 10460 tablet_replica.cc:330] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd: stopping tablet replica
I20260807 04:15:57.846621 10461 tablet_replica.cc:330] T d5e343870c854b4bb61bbc00d0ae6ff6 P 11f39c73a3f14e60b996f6fe75a13065: stopping tablet replica
I20260807 04:15:57.846820 10460 raft_consensus.cc:2229] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:15:57.846895 10461 raft_consensus.cc:2229] T d5e343870c854b4bb61bbc00d0ae6ff6 P 11f39c73a3f14e60b996f6fe75a13065 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:15:57.847116 10461 raft_consensus.cc:2258] T d5e343870c854b4bb61bbc00d0ae6ff6 P 11f39c73a3f14e60b996f6fe75a13065 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:15:57.847385 10460 raft_consensus.cc:2258] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:15:57.848403 10461 ts_tablet_manager.cc:1905] T d5e343870c854b4bb61bbc00d0ae6ff6 P 11f39c73a3f14e60b996f6fe75a13065: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:15:57.848308 9837 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36342:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 04:15:57.848655 10460 ts_tablet_manager.cc:1905] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 04:15:57.849068 9837 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:15:57.853130 10459 tablet_replica.cc:330] T d5e343870c854b4bb61bbc00d0ae6ff6 P 304a5465d44e4dd5a8c7504052cf4adc: stopping tablet replica
I20260807 04:15:57.853371 10459 raft_consensus.cc:2229] T d5e343870c854b4bb61bbc00d0ae6ff6 P 304a5465d44e4dd5a8c7504052cf4adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:15:57.853590 10459 raft_consensus.cc:2258] T d5e343870c854b4bb61bbc00d0ae6ff6 P 304a5465d44e4dd5a8c7504052cf4adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:15:57.854825 10459 ts_tablet_manager.cc:1905] T d5e343870c854b4bb61bbc00d0ae6ff6 P 304a5465d44e4dd5a8c7504052cf4adc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:15:57.855794 10460 ts_tablet_manager.cc:1918] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 04:15:57.855957 10460 log.cc:1196] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-1/wal/wals/d5e343870c854b4bb61bbc00d0ae6ff6
I20260807 04:15:57.856446 10460 ts_tablet_manager.cc:1939] T d5e343870c854b4bb61bbc00d0ae6ff6 P 8e570fe2440a4942a0ae7672e16c35cd: Deleting consensus metadata
I20260807 04:15:57.856436 10461 ts_tablet_manager.cc:1918] T d5e343870c854b4bb61bbc00d0ae6ff6 P 11f39c73a3f14e60b996f6fe75a13065: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 04:15:57.856580 10461 log.cc:1196] T d5e343870c854b4bb61bbc00d0ae6ff6 P 11f39c73a3f14e60b996f6fe75a13065: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-2/wal/wals/d5e343870c854b4bb61bbc00d0ae6ff6
I20260807 04:15:57.857004 10461 ts_tablet_manager.cc:1939] T d5e343870c854b4bb61bbc00d0ae6ff6 P 11f39c73a3f14e60b996f6fe75a13065: Deleting consensus metadata
I20260807 04:15:57.857669 9819 catalog_manager.cc:4841] TS 8e570fe2440a4942a0ae7672e16c35cd (127.7.200.194:34175): tablet d5e343870c854b4bb61bbc00d0ae6ff6 (table test-table [id=3de80a262f9048e795621cab9553d347]) successfully deleted
I20260807 04:15:57.858062 9821 catalog_manager.cc:4841] TS 11f39c73a3f14e60b996f6fe75a13065 (127.7.200.195:37009): tablet d5e343870c854b4bb61bbc00d0ae6ff6 (table test-table [id=3de80a262f9048e795621cab9553d347]) successfully deleted
I20260807 04:15:57.861255 10459 ts_tablet_manager.cc:1918] T d5e343870c854b4bb61bbc00d0ae6ff6 P 304a5465d44e4dd5a8c7504052cf4adc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 04:15:57.861438 10459 log.cc:1196] T d5e343870c854b4bb61bbc00d0ae6ff6 P 304a5465d44e4dd5a8c7504052cf4adc: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-0/wal/wals/d5e343870c854b4bb61bbc00d0ae6ff6
I20260807 04:15:57.861999 10459 ts_tablet_manager.cc:1939] T d5e343870c854b4bb61bbc00d0ae6ff6 P 304a5465d44e4dd5a8c7504052cf4adc: Deleting consensus metadata
I20260807 04:15:57.863412 10126 tablet_service.cc:1467] Processing CreateTablet for tablet e3b7ea34649d4d43b060383c99d5dfaf (DEFAULT_TABLE table=test-table [id=b25e386f40b0407baa12959ffe2f419a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:15:57.863634 9819 catalog_manager.cc:4841] TS 304a5465d44e4dd5a8c7504052cf4adc (127.7.200.193:37137): tablet d5e343870c854b4bb61bbc00d0ae6ff6 (table test-table [id=3de80a262f9048e795621cab9553d347]) successfully deleted
I20260807 04:15:57.863909 10126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3b7ea34649d4d43b060383c99d5dfaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:57.863867 10273 tablet_service.cc:1467] Processing CreateTablet for tablet e3b7ea34649d4d43b060383c99d5dfaf (DEFAULT_TABLE table=test-table [id=b25e386f40b0407baa12959ffe2f419a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:15:57.864097 9981 tablet_service.cc:1467] Processing CreateTablet for tablet e3b7ea34649d4d43b060383c99d5dfaf (DEFAULT_TABLE table=test-table [id=b25e386f40b0407baa12959ffe2f419a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:15:57.864300 10273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3b7ea34649d4d43b060383c99d5dfaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:57.864486 9981 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3b7ea34649d4d43b060383c99d5dfaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:15:57.870998 10475 tablet_bootstrap.cc:492] T e3b7ea34649d4d43b060383c99d5dfaf P 11f39c73a3f14e60b996f6fe75a13065: Bootstrap starting.
I20260807 04:15:57.871311 10476 tablet_bootstrap.cc:492] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc: Bootstrap starting.
I20260807 04:15:57.872586 10474 tablet_bootstrap.cc:492] T e3b7ea34649d4d43b060383c99d5dfaf P 8e570fe2440a4942a0ae7672e16c35cd: Bootstrap starting.
I20260807 04:15:57.872872 10475 tablet_bootstrap.cc:654] T e3b7ea34649d4d43b060383c99d5dfaf P 11f39c73a3f14e60b996f6fe75a13065: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:57.873063 10476 tablet_bootstrap.cc:654] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:57.874758 10474 tablet_bootstrap.cc:654] T e3b7ea34649d4d43b060383c99d5dfaf P 8e570fe2440a4942a0ae7672e16c35cd: Neither blocks nor log segments found. Creating new log.
I20260807 04:15:57.883471 10474 tablet_bootstrap.cc:492] T e3b7ea34649d4d43b060383c99d5dfaf P 8e570fe2440a4942a0ae7672e16c35cd: No bootstrap required, opened a new log
I20260807 04:15:57.883661 10474 ts_tablet_manager.cc:1397] T e3b7ea34649d4d43b060383c99d5dfaf P 8e570fe2440a4942a0ae7672e16c35cd: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.004s
I20260807 04:15:57.883878 10475 tablet_bootstrap.cc:492] T e3b7ea34649d4d43b060383c99d5dfaf P 11f39c73a3f14e60b996f6fe75a13065: No bootstrap required, opened a new log
I20260807 04:15:57.884054 10475 ts_tablet_manager.cc:1397] T e3b7ea34649d4d43b060383c99d5dfaf P 11f39c73a3f14e60b996f6fe75a13065: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.004s
I20260807 04:15:57.884461 10476 tablet_bootstrap.cc:492] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc: No bootstrap required, opened a new log
I20260807 04:15:57.884476 10474 raft_consensus.cc:348] T e3b7ea34649d4d43b060383c99d5dfaf P 8e570fe2440a4942a0ae7672e16c35cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:57.884829 10474 raft_consensus.cc:374] T e3b7ea34649d4d43b060383c99d5dfaf P 8e570fe2440a4942a0ae7672e16c35cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:57.884699 10476 ts_tablet_manager.cc:1397] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.003s
I20260807 04:15:57.884934 10474 raft_consensus.cc:729] T e3b7ea34649d4d43b060383c99d5dfaf P 8e570fe2440a4942a0ae7672e16c35cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e570fe2440a4942a0ae7672e16c35cd, State: Initialized, Role: FOLLOWER
I20260807 04:15:57.884886 10475 raft_consensus.cc:348] T e3b7ea34649d4d43b060383c99d5dfaf P 11f39c73a3f14e60b996f6fe75a13065 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:57.885165 10475 raft_consensus.cc:374] T e3b7ea34649d4d43b060383c99d5dfaf P 11f39c73a3f14e60b996f6fe75a13065 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:57.885262 10475 raft_consensus.cc:729] T e3b7ea34649d4d43b060383c99d5dfaf P 11f39c73a3f14e60b996f6fe75a13065 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11f39c73a3f14e60b996f6fe75a13065, State: Initialized, Role: FOLLOWER
I20260807 04:15:57.885215 10474 consensus_queue.cc:260] T e3b7ea34649d4d43b060383c99d5dfaf P 8e570fe2440a4942a0ae7672e16c35cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:57.885552 10475 consensus_queue.cc:260] T e3b7ea34649d4d43b060383c99d5dfaf P 11f39c73a3f14e60b996f6fe75a13065 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:57.885795 10474 ts_tablet_manager.cc:1428] T e3b7ea34649d4d43b060383c99d5dfaf P 8e570fe2440a4942a0ae7672e16c35cd: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 04:15:57.886140 10476 raft_consensus.cc:348] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:57.886466 10476 raft_consensus.cc:374] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:15:57.886668 10476 raft_consensus.cc:729] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 304a5465d44e4dd5a8c7504052cf4adc, State: Initialized, Role: FOLLOWER
I20260807 04:15:57.886984 10476 consensus_queue.cc:260] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:57.887686 10476 ts_tablet_manager.cc:1428] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260807 04:15:57.888278 10475 ts_tablet_manager.cc:1428] T e3b7ea34649d4d43b060383c99d5dfaf P 11f39c73a3f14e60b996f6fe75a13065: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260807 04:15:58.145181 10438 raft_consensus.cc:482] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:15:58.145432 10438 raft_consensus.cc:504] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:58.146216 10438 leader_election.cc:288] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e570fe2440a4942a0ae7672e16c35cd (127.7.200.194:34175), 11f39c73a3f14e60b996f6fe75a13065 (127.7.200.195:37009)
I20260807 04:15:58.146932 10148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3b7ea34649d4d43b060383c99d5dfaf" candidate_uuid: "304a5465d44e4dd5a8c7504052cf4adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e570fe2440a4942a0ae7672e16c35cd" is_pre_election: true
I20260807 04:15:58.146970 10293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3b7ea34649d4d43b060383c99d5dfaf" candidate_uuid: "304a5465d44e4dd5a8c7504052cf4adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11f39c73a3f14e60b996f6fe75a13065" is_pre_election: true
I20260807 04:15:58.147223 10148 raft_consensus.cc:2454] T e3b7ea34649d4d43b060383c99d5dfaf P 8e570fe2440a4942a0ae7672e16c35cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 304a5465d44e4dd5a8c7504052cf4adc in term 0.
I20260807 04:15:58.147372 10293 raft_consensus.cc:2454] T e3b7ea34649d4d43b060383c99d5dfaf P 11f39c73a3f14e60b996f6fe75a13065 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 304a5465d44e4dd5a8c7504052cf4adc in term 0.
I20260807 04:15:58.147876 9931 leader_election.cc:302] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 304a5465d44e4dd5a8c7504052cf4adc, 8e570fe2440a4942a0ae7672e16c35cd; no voters:
I20260807 04:15:58.148370 10438 raft_consensus.cc:2781] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:15:58.148527 10438 raft_consensus.cc:482] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:15:58.148653 10438 raft_consensus.cc:3037] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:58.152328 10438 raft_consensus.cc:504] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:58.153117 10438 leader_election.cc:288] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc [CANDIDATE]: Term 1 election: Requested vote from peers 8e570fe2440a4942a0ae7672e16c35cd (127.7.200.194:34175), 11f39c73a3f14e60b996f6fe75a13065 (127.7.200.195:37009)
I20260807 04:15:58.153744 10293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3b7ea34649d4d43b060383c99d5dfaf" candidate_uuid: "304a5465d44e4dd5a8c7504052cf4adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11f39c73a3f14e60b996f6fe75a13065"
I20260807 04:15:58.153774 10148 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3b7ea34649d4d43b060383c99d5dfaf" candidate_uuid: "304a5465d44e4dd5a8c7504052cf4adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e570fe2440a4942a0ae7672e16c35cd"
I20260807 04:15:58.154048 10293 raft_consensus.cc:3037] T e3b7ea34649d4d43b060383c99d5dfaf P 11f39c73a3f14e60b996f6fe75a13065 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:58.154121 10148 raft_consensus.cc:3037] T e3b7ea34649d4d43b060383c99d5dfaf P 8e570fe2440a4942a0ae7672e16c35cd [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:15:58.157070 10293 raft_consensus.cc:2454] T e3b7ea34649d4d43b060383c99d5dfaf P 11f39c73a3f14e60b996f6fe75a13065 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 304a5465d44e4dd5a8c7504052cf4adc in term 1.
I20260807 04:15:58.157666 9932 leader_election.cc:302] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11f39c73a3f14e60b996f6fe75a13065, 304a5465d44e4dd5a8c7504052cf4adc; no voters:
I20260807 04:15:58.157807 10148 raft_consensus.cc:2454] T e3b7ea34649d4d43b060383c99d5dfaf P 8e570fe2440a4942a0ae7672e16c35cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 304a5465d44e4dd5a8c7504052cf4adc in term 1.
I20260807 04:15:58.158051 10438 raft_consensus.cc:2781] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:15:58.158262 10438 raft_consensus.cc:686] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc [term 1 LEADER]: Becoming Leader. State: Replica: 304a5465d44e4dd5a8c7504052cf4adc, State: Running, Role: LEADER
I20260807 04:15:58.158608 10438 consensus_queue.cc:237] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } }
I20260807 04:15:58.162192 9837 catalog_manager.cc:5495] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 304a5465d44e4dd5a8c7504052cf4adc (127.7.200.193). New cstate: current_term: 1 leader_uuid: "304a5465d44e4dd5a8c7504052cf4adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "304a5465d44e4dd5a8c7504052cf4adc" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 } health_report { overall_health: UNKNOWN } } }
I20260807 04:15:58.206717 10484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:58.199754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54074 (local address 127.7.200.193:37137)
0807 04:15:58.199955 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:58.199962 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:58.199982 (+ 20us) server_negotiation.cc:407] Connection header received
0807 04:15:58.200072 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:58.200078 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:58.200171 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:58.200274 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:15:58.200995 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:58.202274 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:58.204509 (+ 2235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:58.205177 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:58.205303 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:58.205905 (+ 602us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:15:58.206040 (+ 135us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:15:58.206122 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:58.206314 (+ 192us) server_negotiation.cc:299] Negotiation successful
0807 04:15:58.206406 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 04:15:58.222079 10293 raft_consensus.cc:1261] T e3b7ea34649d4d43b060383c99d5dfaf P 11f39c73a3f14e60b996f6fe75a13065 [term 1 FOLLOWER]: Refusing update from remote peer 304a5465d44e4dd5a8c7504052cf4adc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:15:58.222996 10148 raft_consensus.cc:1261] T e3b7ea34649d4d43b060383c99d5dfaf P 8e570fe2440a4942a0ae7672e16c35cd [term 1 FOLLOWER]: Refusing update from remote peer 304a5465d44e4dd5a8c7504052cf4adc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:15:58.222820 10447 consensus_queue.cc:1035] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "11f39c73a3f14e60b996f6fe75a13065" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 37009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:15:58.223470 10438 consensus_queue.cc:1035] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e570fe2440a4942a0ae7672e16c35cd" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 04:15:58.248144 10439 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 04:15:59.845774 9836 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36342:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:15:59.846072 9836 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36342:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:15:59.850642 9836 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7eb0ea83d3634f809742abd6525bbda0: Sending DeleteTablet for 3 replicas of tablet e3b7ea34649d4d43b060383c99d5dfaf
I20260807 04:15:59.851650 9982 tablet_service.cc:1514] Processing DeleteTablet for tablet e3b7ea34649d4d43b060383c99d5dfaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:15:59 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:54050
I20260807 04:15:59.851657 10126 tablet_service.cc:1514] Processing DeleteTablet for tablet e3b7ea34649d4d43b060383c99d5dfaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:15:59 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:55130
I20260807 04:15:59.851794 10273 tablet_service.cc:1514] Processing DeleteTablet for tablet e3b7ea34649d4d43b060383c99d5dfaf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:15:59 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:50922
I20260807 04:15:59.852439 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 9913
I20260807 04:15:59.864264 10535 tablet_replica.cc:330] T e3b7ea34649d4d43b060383c99d5dfaf P 11f39c73a3f14e60b996f6fe75a13065: stopping tablet replica
I20260807 04:15:59.864640 10535 raft_consensus.cc:2229] T e3b7ea34649d4d43b060383c99d5dfaf P 11f39c73a3f14e60b996f6fe75a13065 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:15:59.864988 10535 raft_consensus.cc:2258] T e3b7ea34649d4d43b060383c99d5dfaf P 11f39c73a3f14e60b996f6fe75a13065 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:15:59.866919 10535 ts_tablet_manager.cc:1905] T e3b7ea34649d4d43b060383c99d5dfaf P 11f39c73a3f14e60b996f6fe75a13065: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:15:59.867031 10533 tablet_replica.cc:330] T e3b7ea34649d4d43b060383c99d5dfaf P 8e570fe2440a4942a0ae7672e16c35cd: stopping tablet replica
I20260807 04:15:59.867324 10533 raft_consensus.cc:2229] T e3b7ea34649d4d43b060383c99d5dfaf P 8e570fe2440a4942a0ae7672e16c35cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:15:59.867622 10533 raft_consensus.cc:2258] T e3b7ea34649d4d43b060383c99d5dfaf P 8e570fe2440a4942a0ae7672e16c35cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:15:59.869555 10533 ts_tablet_manager.cc:1905] T e3b7ea34649d4d43b060383c99d5dfaf P 8e570fe2440a4942a0ae7672e16c35cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:15:59.872242 10535 ts_tablet_manager.cc:1918] T e3b7ea34649d4d43b060383c99d5dfaf P 11f39c73a3f14e60b996f6fe75a13065: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 04:15:59.872395 10535 log.cc:1196] T e3b7ea34649d4d43b060383c99d5dfaf P 11f39c73a3f14e60b996f6fe75a13065: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-2/wal/wals/e3b7ea34649d4d43b060383c99d5dfaf
I20260807 04:15:59.872560 10534 tablet_replica.cc:330] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc: stopping tablet replica
I20260807 04:15:59.872910 10534 raft_consensus.cc:2229] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:15:59.873005 10535 ts_tablet_manager.cc:1939] T e3b7ea34649d4d43b060383c99d5dfaf P 11f39c73a3f14e60b996f6fe75a13065: Deleting consensus metadata
I20260807 04:15:59.873456 10534 raft_consensus.cc:2258] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:15:59.874218 9821 catalog_manager.cc:4841] TS 11f39c73a3f14e60b996f6fe75a13065 (127.7.200.195:37009): tablet e3b7ea34649d4d43b060383c99d5dfaf (table test-table [id=b25e386f40b0407baa12959ffe2f419a]) successfully deleted
I20260807 04:15:59.874612 10534 ts_tablet_manager.cc:1905] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:15:59.876682 10533 ts_tablet_manager.cc:1918] T e3b7ea34649d4d43b060383c99d5dfaf P 8e570fe2440a4942a0ae7672e16c35cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 04:15:59.876857 10533 log.cc:1196] T e3b7ea34649d4d43b060383c99d5dfaf P 8e570fe2440a4942a0ae7672e16c35cd: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-1/wal/wals/e3b7ea34649d4d43b060383c99d5dfaf
I20260807 04:15:59.877317 10533 ts_tablet_manager.cc:1939] T e3b7ea34649d4d43b060383c99d5dfaf P 8e570fe2440a4942a0ae7672e16c35cd: Deleting consensus metadata
I20260807 04:15:59.878540 9819 catalog_manager.cc:4841] TS 8e570fe2440a4942a0ae7672e16c35cd (127.7.200.194:34175): tablet e3b7ea34649d4d43b060383c99d5dfaf (table test-table [id=b25e386f40b0407baa12959ffe2f419a]) successfully deleted
I20260807 04:15:59.880880 10534 ts_tablet_manager.cc:1918] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 04:15:59.880999 10534 log.cc:1196] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786076137270840-7971-0/minicluster-data/ts-0/wal/wals/e3b7ea34649d4d43b060383c99d5dfaf
I20260807 04:15:59.881393 10534 ts_tablet_manager.cc:1939] T e3b7ea34649d4d43b060383c99d5dfaf P 304a5465d44e4dd5a8c7504052cf4adc: Deleting consensus metadata
I20260807 04:15:59.882395 9819 catalog_manager.cc:4841] TS 304a5465d44e4dd5a8c7504052cf4adc (127.7.200.193:37137): tablet e3b7ea34649d4d43b060383c99d5dfaf (table test-table [id=b25e386f40b0407baa12959ffe2f419a]) successfully deleted
Aug 07 04:15:59 dist-test-slave-qg60 krb5kdc[9789](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076157, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.200.193@KRBTEST.COM
I20260807 04:15:59.896375 10537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:59.854946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54090 (local address 127.7.200.193:37137)
0807 04:15:59.872936 (+ 17990us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:59.872943 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:59.872972 (+ 29us) server_negotiation.cc:407] Connection header received
0807 04:15:59.873050 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:59.873056 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:59.873155 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:59.873275 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:59.875329 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:59.876561 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:59.878516 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:59.879210 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:59.879369 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:59.890542 (+ 11173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:59.890558 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:59.890575 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:59.890611 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:59.893534 (+ 2923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:59.894238 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:59.894245 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:59.894247 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:59.894372 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:59.894779 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:59.894784 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:59.894786 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:59.895141 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:59.895491 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:59.895778 (+ 287us) server_negotiation.cc:299] Negotiation successful
0807 04:15:59.896020 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17760,"thread_start_us":17514,"threads_started":1}
W20260807 04:15:59.897161 10050 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54090
W20260807 04:15:59.897913 7971 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 9913: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 04:15:59.898145 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 9913
I20260807 04:15:59.929875 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 10060
Aug 07 04:15:59 dist-test-slave-qg60 krb5kdc[9789](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076157, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.200.194@KRBTEST.COM
I20260807 04:15:59.946115 10538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:59.930626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55150 (local address 127.7.200.194:34175)
0807 04:15:59.931227 (+ 601us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:59.931232 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:59.931248 (+ 16us) server_negotiation.cc:407] Connection header received
0807 04:15:59.931306 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:59.931310 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:59.931370 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:59.931469 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:59.932990 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:59.933795 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:59.935179 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:59.935581 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:59.935680 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:59.940359 (+ 4679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:59.940375 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:59.940391 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:59.940432 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:59.943510 (+ 3078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:59.944195 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:59.944203 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:59.944205 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:59.944340 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:59.944680 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:59.944683 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:59.944685 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:59.945102 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:59.945354 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:59.945632 (+ 278us) server_negotiation.cc:299] Negotiation successful
0807 04:15:59.945809 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":325,"threads_started":1}
W20260807 04:15:59.946841 10196 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55150
W20260807 04:15:59.947522 7971 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 10060: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 04:15:59.947693 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 10060
I20260807 04:15:59.974783 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 10205
Aug 07 04:15:59 dist-test-slave-qg60 krb5kdc[9789](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076157, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.7.200.195@KRBTEST.COM
I20260807 04:15:59.991528 10539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:15:59.975628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50930 (local address 127.7.200.195:37009)
0807 04:15:59.976203 (+ 575us) server_negotiation.cc:206] Beginning negotiation
0807 04:15:59.976207 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:15:59.976222 (+ 15us) server_negotiation.cc:407] Connection header received
0807 04:15:59.976275 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:15:59.976279 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:15:59.976340 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:15:59.976468 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:15:59.977870 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:59.978736 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:59.980098 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:15:59.980528 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:15:59.980688 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:15:59.985460 (+ 4772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:15:59.985477 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:15:59.985494 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:15:59.985533 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:15:59.988565 (+ 3032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:59.989332 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:59.989340 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:59.989342 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:59.989490 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:15:59.989899 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:15:59.989904 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:15:59.989907 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:15:59.990263 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:15:59.990596 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0807 04:15:59.990912 (+ 316us) server_negotiation.cc:299] Negotiation successful
0807 04:15:59.991154 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":306,"threads_started":1}
W20260807 04:15:59.992291 10347 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50930
W20260807 04:15:59.992951 7971 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 10205: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 04:15:59.993106 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 10205
I20260807 04:16:00.019776 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 9803
I20260807 04:16:00.021205 9878 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:00.144589 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 9803
2026-08-07T04:16:00Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (8549 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:16:00 dist-test-slave-qg60 krb5kdc[10543](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:16:00 dist-test-slave-qg60 krb5kdc[10543](info): set up 2 sockets
Aug 07 04:16:00 dist-test-slave-qg60 krb5kdc[10543](info): commencing operation
krb5kdc: starting...
W20260807 04:16:01.298653 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.106s user 0.002s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:16:01 dist-test-slave-qg60 krb5kdc[10543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076161, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:16:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:16:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
I20260807 04:16:01.549201 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:43499
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:40077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:43499
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:01.887763 10557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:01.888055 10557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:01.888146 10557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:01.895176 10557 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:16:01.895282 10557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:01.895328 10557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:01.895380 10557 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:16:01.895427 10557 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:16:01.905215 10557 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:40077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:43499
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:43499
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:01.906512 10557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:01.907775 10557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:01.920282 10562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:01.920311 10567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:01.920352 10564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:01.921142 10557 server_base.cc:1034] running on GCE node
I20260807 04:16:01.922022 10557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:01.923523 10557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:01.924821 10557 hybrid_clock.cc:648] HybridClock initialized: now 1786076161924771 us; error 52 us; skew 500 ppm
I20260807 04:16:01.925197 10557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:01 dist-test-slave-qg60 krb5kdc[10543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076161, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:01.928458 10557 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:16:01.930230 10557 webserver.cc:460] Webserver started at http://127.7.200.254:33575/ using document root <none> and password file <none>
I20260807 04:16:01.930976 10557 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:01.931130 10557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:01.931473 10557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:01.934885 10557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "0242b4d62a1044a593af423ed0ff2722"
format_stamp: "Formatted at 2026-08-07 04:16:01 on dist-test-slave-qg60"
server_key: "052f49859c642c2e4c3b122fbbfc3d9f"
server_key_iv: "6d3cff84a8417eeb68985db6a319516f"
server_key_version: "encryptionkey@0"
I20260807 04:16:01.935760 10557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "0242b4d62a1044a593af423ed0ff2722"
format_stamp: "Formatted at 2026-08-07 04:16:01 on dist-test-slave-qg60"
server_key: "052f49859c642c2e4c3b122fbbfc3d9f"
server_key_iv: "6d3cff84a8417eeb68985db6a319516f"
server_key_version: "encryptionkey@0"
I20260807 04:16:01.941573 10557 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 04:16:01.945606 10574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:01.947202 10557 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:16:01.947419 10557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "0242b4d62a1044a593af423ed0ff2722"
format_stamp: "Formatted at 2026-08-07 04:16:01 on dist-test-slave-qg60"
server_key: "052f49859c642c2e4c3b122fbbfc3d9f"
server_key_iv: "6d3cff84a8417eeb68985db6a319516f"
server_key_version: "encryptionkey@0"
I20260807 04:16:01.947647 10557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:01.965613 10557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:01.970345 10557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:01.970715 10557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:01.994107 10557 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:43499
I20260807 04:16:01.994135 10631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:43499 every 8 connection(s)
I20260807 04:16:01.995693 10557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:16:01.999643 10632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:02.006068 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 10557
I20260807 04:16:02.006335 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:16:02.006989 7971 external_mini_cluster.cc:1428] Setting key 2f0563afb64e06046611380591d617b5
I20260807 04:16:02.011243 10632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0242b4d62a1044a593af423ed0ff2722: Bootstrap starting.
I20260807 04:16:02.015256 10632 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0242b4d62a1044a593af423ed0ff2722: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:02.016384 10632 log.cc:824] T 00000000000000000000000000000000 P 0242b4d62a1044a593af423ed0ff2722: Log is configured to *not* fsync() on all Append() calls
I20260807 04:16:02.019347 10632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0242b4d62a1044a593af423ed0ff2722: No bootstrap required, opened a new log
Aug 07 04:16:02 dist-test-slave-qg60 krb5kdc[10543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076161, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:16:02.029865 10632 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0242b4d62a1044a593af423ed0ff2722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0242b4d62a1044a593af423ed0ff2722" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43499 } }
I20260807 04:16:02.030377 10632 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0242b4d62a1044a593af423ed0ff2722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:02.030498 10632 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0242b4d62a1044a593af423ed0ff2722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0242b4d62a1044a593af423ed0ff2722, State: Initialized, Role: FOLLOWER
I20260807 04:16:02.031265 10632 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0242b4d62a1044a593af423ed0ff2722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0242b4d62a1044a593af423ed0ff2722" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43499 } }
I20260807 04:16:02.031544 10632 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0242b4d62a1044a593af423ed0ff2722 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:16:02.031699 10632 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0242b4d62a1044a593af423ed0ff2722 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:16:02.031891 10632 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0242b4d62a1044a593af423ed0ff2722 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:02.032943 10635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:02.009308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59538 (local address 127.7.200.254:43499)
0807 04:16:02.010165 (+ 857us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:02.010177 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:02.010222 (+ 45us) server_negotiation.cc:407] Connection header received
0807 04:16:02.012098 (+ 1876us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:02.012123 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:02.012529 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:02.012951 (+ 422us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:02.014907 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:02.016418 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:02.017834 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:02.018513 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:02.018713 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:02.023141 (+ 4428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:02.023153 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:02.023175 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:02.023238 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:02.027678 (+ 4440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:02.028473 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:02.028483 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:02.028493 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:02.028783 (+ 290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:02.029252 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:02.029256 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:02.029259 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:02.030033 (+ 774us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:02.030319 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:02.030877 (+ 558us) server_negotiation.cc:299] Negotiation successful
0807 04:16:02.031354 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":642,"thread_start_us":399,"threads_started":1}
I20260807 04:16:02.034703 10632 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0242b4d62a1044a593af423ed0ff2722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0242b4d62a1044a593af423ed0ff2722" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43499 } }
I20260807 04:16:02.035225 10632 leader_election.cc:302] T 00000000000000000000000000000000 P 0242b4d62a1044a593af423ed0ff2722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0242b4d62a1044a593af423ed0ff2722; no voters:
I20260807 04:16:02.035948 10632 leader_election.cc:288] T 00000000000000000000000000000000 P 0242b4d62a1044a593af423ed0ff2722 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:16:02.036096 10637 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0242b4d62a1044a593af423ed0ff2722 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:16:02.036896 10637 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0242b4d62a1044a593af423ed0ff2722 [term 1 LEADER]: Becoming Leader. State: Replica: 0242b4d62a1044a593af423ed0ff2722, State: Running, Role: LEADER
I20260807 04:16:02.037457 10637 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0242b4d62a1044a593af423ed0ff2722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0242b4d62a1044a593af423ed0ff2722" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43499 } }
I20260807 04:16:02.038213 10632 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0242b4d62a1044a593af423ed0ff2722 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:16:02.040885 10639 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0242b4d62a1044a593af423ed0ff2722 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0242b4d62a1044a593af423ed0ff2722. Latest consensus state: current_term: 1 leader_uuid: "0242b4d62a1044a593af423ed0ff2722" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0242b4d62a1044a593af423ed0ff2722" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43499 } } }
I20260807 04:16:02.041376 10639 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0242b4d62a1044a593af423ed0ff2722 [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:02.041216 10638 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0242b4d62a1044a593af423ed0ff2722 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0242b4d62a1044a593af423ed0ff2722" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0242b4d62a1044a593af423ed0ff2722" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43499 } } }
I20260807 04:16:02.042707 10644 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:16:02.042762 10638 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0242b4d62a1044a593af423ed0ff2722 [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:02.050154 10644 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:16:02.059746 10644 catalog_manager.cc:1347] Generated new cluster ID: b5f8a115ba7c49d4b854a517a2c1d94b
I20260807 04:16:02.059890 10644 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:16:02.075196 10644 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:16:02.076575 10644 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:16:02.084870 10644 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0242b4d62a1044a593af423ed0ff2722: Generated new TSK 0
I20260807 04:16:02.085887 10644 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.200.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
I20260807 04:16:02.161002 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:0
--local_ip_for_outbound_sockets=127.7.200.193
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:43499
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:40077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:02.503484 10661 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:02.503786 10661 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:02.503957 10661 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:02.511344 10661 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:02.511463 10661 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:02.511646 10661 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:16:02.521718 10661 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:40077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:43499
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:02.523062 10661 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:02.524379 10661 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:02.538395 10669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:02.538524 10667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:02.538560 10666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:02.539528 10661 server_base.cc:1034] running on GCE node
I20260807 04:16:02.540189 10661 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:02.541144 10661 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:02.542394 10661 hybrid_clock.cc:648] HybridClock initialized: now 1786076162542331 us; error 50 us; skew 500 ppm
I20260807 04:16:02.542719 10661 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:02 dist-test-slave-qg60 krb5kdc[10543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076162, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:02.546284 10661 init.cc:377] Logged in from keytab as kudu/127.7.200.193@KRBTEST.COM (short username kudu)
I20260807 04:16:02.547865 10661 webserver.cc:460] Webserver started at http://127.7.200.193:33797/ using document root <none> and password file <none>
I20260807 04:16:02.548597 10661 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:02.548799 10661 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:02.549151 10661 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:02.552606 10661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/data/instance:
uuid: "704d60c4b4074a7c962112d5ec943358"
format_stamp: "Formatted at 2026-08-07 04:16:02 on dist-test-slave-qg60"
server_key: "e0ab5b56195a8da7b69668e65e52141d"
server_key_iv: "3f8497b9b5246449809698c414f094d6"
server_key_version: "encryptionkey@0"
I20260807 04:16:02.553515 10661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance:
uuid: "704d60c4b4074a7c962112d5ec943358"
format_stamp: "Formatted at 2026-08-07 04:16:02 on dist-test-slave-qg60"
server_key: "e0ab5b56195a8da7b69668e65e52141d"
server_key_iv: "3f8497b9b5246449809698c414f094d6"
server_key_version: "encryptionkey@0"
I20260807 04:16:02.558760 10661 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 04:16:02.562494 10676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:02.563882 10661 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 04:16:02.564131 10661 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "704d60c4b4074a7c962112d5ec943358"
format_stamp: "Formatted at 2026-08-07 04:16:02 on dist-test-slave-qg60"
server_key: "e0ab5b56195a8da7b69668e65e52141d"
server_key_iv: "3f8497b9b5246449809698c414f094d6"
server_key_version: "encryptionkey@0"
I20260807 04:16:02.564368 10661 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:02.591194 10661 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:02.595825 10661 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:02.596138 10661 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:02.597222 10661 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:16:02.598621 10661 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:02.598729 10661 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:02.598877 10661 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:02.598953 10661 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:02.633455 10661 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:42907
I20260807 04:16:02.633513 10795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:42907 every 8 connection(s)
I20260807 04:16:02.634800 10661 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:16:02.637843 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 10661
I20260807 04:16:02.638103 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance
I20260807 04:16:02.639039 7971 external_mini_cluster.cc:1428] Setting key ca81717c3370a78d9cbc42cc74783e37
Aug 07 04:16:02 dist-test-slave-qg60 krb5kdc[10543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076162, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:16:02.659889 10799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:02.637473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:39839 (local address 127.7.200.254:43499)
0807 04:16:02.637989 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:02.637996 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:02.639213 (+ 1217us) server_negotiation.cc:407] Connection header received
0807 04:16:02.641711 (+ 2498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:02.641715 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:02.641784 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:02.641884 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:02.644265 (+ 2381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:02.645087 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:02.647716 (+ 2629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:02.648202 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:02.648320 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:02.653216 (+ 4896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:02.653221 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:02.653224 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:02.653261 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:02.656064 (+ 2803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:02.657145 (+ 1081us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:02.657149 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:02.657151 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:02.657292 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:02.657891 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:02.657894 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:02.657897 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:02.658218 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:02.658333 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:02.659339 (+ 1006us) server_negotiation.cc:299] Negotiation successful
0807 04:16:02.659550 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":232,"threads_started":1}
I20260807 04:16:02.661587 10800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:02.638072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:43499 (local address 127.7.200.193:39839)
0807 04:16:02.639015 (+ 943us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:02.639080 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:02.641366 (+ 2286us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:02.642192 (+ 826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:02.642206 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:02.643124 (+ 918us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:02.644043 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:02.644074 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:02.645252 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:02.645260 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:02.647520 (+ 2260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:02.647547 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:02.648467 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:02.648477 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:02.648864 (+ 387us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:02.649809 (+ 945us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:02.649844 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:02.652896 (+ 3052us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:02.656233 (+ 3337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:02.656245 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:02.656267 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:02.656997 (+ 730us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:02.657439 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:02.657448 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:02.657454 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:02.657765 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:02.658357 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:02.658369 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:02.658896 (+ 527us) client_negotiation.cc:769] Sending connection context
0807 04:16:02.659237 (+ 341us) client_negotiation.cc:240] Negotiation successful
0807 04:16:02.659901 (+ 664us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":633,"thread_start_us":360,"threads_started":1}
I20260807 04:16:02.663328 10796 heartbeater.cc:347] Connected to a master server at 127.7.200.254:43499
I20260807 04:16:02.663650 10796 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.7.200.194@KRBTEST.COM; defaulting to no policy
I20260807 04:16:02.664387 10796 heartbeater.cc:511] Master 127.7.200.254:43499 requested a full tablet report, sending...
I20260807 04:16:02.666796 10592 ts_manager.cc:194] Registered new tserver with Master: 704d60c4b4074a7c962112d5ec943358 (127.7.200.193:42907)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.194@KRBTEST.COM" created.
I20260807 04:16:02.668809 10592 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.193@KRBTEST.COM'} at 127.7.200.193:39839
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
I20260807 04:16:02.696280 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:0
--local_ip_for_outbound_sockets=127.7.200.194
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:43499
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:40077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:03.058941 10803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:03.059239 10803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:03.059335 10803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:03.066615 10803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:03.066738 10803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:03.066855 10803 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:16:03.077236 10803 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:40077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:43499
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:03.078699 10803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:03.080108 10803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:03.093912 10808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:03.093941 10809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:03.093886 10811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:03.094698 10803 server_base.cc:1034] running on GCE node
I20260807 04:16:03.095346 10803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:03.096355 10803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:03.097589 10803 hybrid_clock.cc:648] HybridClock initialized: now 1786076163097592 us; error 104 us; skew 500 ppm
I20260807 04:16:03.097913 10803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:03 dist-test-slave-qg60 krb5kdc[10543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076163, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:03.101267 10803 init.cc:377] Logged in from keytab as kudu/127.7.200.194@KRBTEST.COM (short username kudu)
I20260807 04:16:03.102793 10803 webserver.cc:460] Webserver started at http://127.7.200.194:44343/ using document root <none> and password file <none>
I20260807 04:16:03.103498 10803 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:03.103631 10803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:03.103976 10803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:03.107002 10803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/data/instance:
uuid: "3c2e289ab25e4becb8aaceab4bebf57f"
format_stamp: "Formatted at 2026-08-07 04:16:03 on dist-test-slave-qg60"
server_key: "e550e86ee51c65208f8a05b1b1ab26d6"
server_key_iv: "f5e8b3294c704250aca41d070605708d"
server_key_version: "encryptionkey@0"
I20260807 04:16:03.107818 10803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance:
uuid: "3c2e289ab25e4becb8aaceab4bebf57f"
format_stamp: "Formatted at 2026-08-07 04:16:03 on dist-test-slave-qg60"
server_key: "e550e86ee51c65208f8a05b1b1ab26d6"
server_key_iv: "f5e8b3294c704250aca41d070605708d"
server_key_version: "encryptionkey@0"
I20260807 04:16:03.113058 10803 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260807 04:16:03.116667 10819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:03.118075 10803 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:16:03.118258 10803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "3c2e289ab25e4becb8aaceab4bebf57f"
format_stamp: "Formatted at 2026-08-07 04:16:03 on dist-test-slave-qg60"
server_key: "e550e86ee51c65208f8a05b1b1ab26d6"
server_key_iv: "f5e8b3294c704250aca41d070605708d"
server_key_version: "encryptionkey@0"
I20260807 04:16:03.118468 10803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:03.140866 10803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:03.145341 10803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:03.145665 10803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:03.146726 10803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:16:03.148089 10803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:03.148197 10803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:03.148352 10803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:03.148430 10803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:03.184381 10803 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:43383
I20260807 04:16:03.184485 10937 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:43383 every 8 connection(s)
I20260807 04:16:03.185783 10803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:16:03.190960 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 10803
I20260807 04:16:03.191212 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance
I20260807 04:16:03.191790 7971 external_mini_cluster.cc:1428] Setting key cf7ac244cf364f0aa5a02f9b9b810cfc
Aug 07 04:16:03 dist-test-slave-qg60 krb5kdc[10543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076163, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:16:03.208971 10940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:03.188535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:56013 (local address 127.7.200.254:43499)
0807 04:16:03.189073 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:03.189077 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:03.189981 (+ 904us) server_negotiation.cc:407] Connection header received
0807 04:16:03.192764 (+ 2783us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:03.192771 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:03.192867 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:03.192991 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:03.194807 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:03.195555 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:03.198112 (+ 2557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:03.198523 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:03.198621 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:03.202924 (+ 4303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:03.202929 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:03.202932 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:03.203004 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:03.205799 (+ 2795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:03.206544 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:03.206556 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:03.206559 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:03.206680 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:03.207131 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:03.207136 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:03.207139 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:03.207401 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:03.207565 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:03.208282 (+ 717us) server_negotiation.cc:299] Negotiation successful
0807 04:16:03.208516 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":294,"threads_started":1}
I20260807 04:16:03.210168 10941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:03.189078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:43499 (local address 127.7.200.194:56013)
0807 04:16:03.189810 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:03.189855 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:03.192454 (+ 2599us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:03.193238 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:03.193247 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:03.193763 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:03.194602 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:03.194637 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:03.195732 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:03.195740 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:03.197947 (+ 2207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:03.197967 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:03.198761 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:03.198770 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:03.199117 (+ 347us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:03.199892 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:03.199928 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:03.202681 (+ 2753us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:03.205947 (+ 3266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:03.205956 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:03.205973 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:03.206406 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:03.206802 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:03.206807 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:03.206811 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:03.207009 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:03.207540 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:03.207548 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:03.207892 (+ 344us) client_negotiation.cc:769] Sending connection context
0807 04:16:03.208168 (+ 276us) client_negotiation.cc:240] Negotiation successful
0807 04:16:03.208719 (+ 551us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":288,"threads_started":1}
I20260807 04:16:03.211755 10938 heartbeater.cc:347] Connected to a master server at 127.7.200.254:43499
I20260807 04:16:03.212141 10938 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:03.213210 10938 heartbeater.cc:511] Master 127.7.200.254:43499 requested a full tablet report, sending...
I20260807 04:16:03.214903 10592 ts_manager.cc:194] Registered new tserver with Master: 3c2e289ab25e4becb8aaceab4bebf57f (127.7.200.194:43383)
WARNING: no policy specified for kudu/127.7.200.195@KRBTEST.COM; defaulting to no policy
I20260807 04:16:03.215819 10592 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.194@KRBTEST.COM'} at 127.7.200.194:56013
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
I20260807 04:16:03.248286 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:0
--local_ip_for_outbound_sockets=127.7.200.195
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:43499
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:40077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:03.589694 10944 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:03.590023 10944 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:03.590133 10944 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:03.598376 10944 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:03.598516 10944 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:03.598646 10944 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:16:03.609562 10944 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:40077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:43499
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:03.610986 10944 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:03.612356 10944 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:03.626546 10952 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:03.626652 10949 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:03.626869 10950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:03.627640 10944 server_base.cc:1034] running on GCE node
I20260807 04:16:03.628336 10944 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:03.629432 10944 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:03.630673 10944 hybrid_clock.cc:648] HybridClock initialized: now 1786076163630605 us; error 62 us; skew 500 ppm
I20260807 04:16:03.631098 10944 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:03 dist-test-slave-qg60 krb5kdc[10543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076163, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:03.634410 10944 init.cc:377] Logged in from keytab as kudu/127.7.200.195@KRBTEST.COM (short username kudu)
I20260807 04:16:03.637130 10944 webserver.cc:460] Webserver started at http://127.7.200.195:37587/ using document root <none> and password file <none>
I20260807 04:16:03.637830 10944 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:03.638002 10944 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:03.638336 10944 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:03.641397 10944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/data/instance:
uuid: "1ba518cb562644a0b40a24aea5772c3d"
format_stamp: "Formatted at 2026-08-07 04:16:03 on dist-test-slave-qg60"
server_key: "05ee441ef63cdd07f4e5fd2f627a14f6"
server_key_iv: "aeb0964b462534d4a444e405a2ebd844"
server_key_version: "encryptionkey@0"
I20260807 04:16:03.642177 10944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance:
uuid: "1ba518cb562644a0b40a24aea5772c3d"
format_stamp: "Formatted at 2026-08-07 04:16:03 on dist-test-slave-qg60"
server_key: "05ee441ef63cdd07f4e5fd2f627a14f6"
server_key_iv: "aeb0964b462534d4a444e405a2ebd844"
server_key_version: "encryptionkey@0"
I20260807 04:16:03.647645 10944 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 04:16:03.651260 10959 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:03.652864 10944 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 04:16:03.653039 10944 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "1ba518cb562644a0b40a24aea5772c3d"
format_stamp: "Formatted at 2026-08-07 04:16:03 on dist-test-slave-qg60"
server_key: "05ee441ef63cdd07f4e5fd2f627a14f6"
server_key_iv: "aeb0964b462534d4a444e405a2ebd844"
server_key_version: "encryptionkey@0"
I20260807 04:16:03.653214 10944 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:03.672253 10796 heartbeater.cc:503] Master 127.7.200.254:43499 was elected leader, sending a full tablet report...
I20260807 04:16:03.672999 10944 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:03.677697 10944 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:03.678026 10944 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:03.679060 10944 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:16:03.680485 10944 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:03.680563 10944 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:03.680716 10944 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:03.680809 10944 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260807 04:16:03.715938 10944 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:46389
I20260807 04:16:03.716056 11081 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:46389 every 8 connection(s)
I20260807 04:16:03.717387 10944 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:16:03.722450 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 10944
I20260807 04:16:03.722684 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance
I20260807 04:16:03.723219 7971 external_mini_cluster.cc:1428] Setting key 2fc46e34dc16f72ddecfd70548503edc
Aug 07 04:16:03 dist-test-slave-qg60 krb5kdc[10543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076163, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:16:03.740870 11085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:03.720440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:59247 (local address 127.7.200.254:43499)
0807 04:16:03.721165 (+ 725us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:03.721171 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:03.722196 (+ 1025us) server_negotiation.cc:407] Connection header received
0807 04:16:03.724796 (+ 2600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:03.724801 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:03.724903 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:03.725033 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:03.727397 (+ 2364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:03.728181 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:03.729836 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:03.730250 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:03.730386 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:03.734052 (+ 3666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:03.734058 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:03.734063 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:03.734108 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:03.736878 (+ 2770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:03.737630 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:03.737636 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:03.737640 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:03.737977 (+ 337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:03.738653 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:03.738658 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:03.738664 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:03.739000 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:03.739199 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:03.740129 (+ 930us) server_negotiation.cc:299] Negotiation successful
0807 04:16:03.740394 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":396,"threads_started":1}
I20260807 04:16:03.742002 11086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:03.721045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:43499 (local address 127.7.200.195:59247)
0807 04:16:03.721987 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:03.722052 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:03.724473 (+ 2421us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:03.725304 (+ 831us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:03.725316 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:03.726204 (+ 888us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:03.727230 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:03.727247 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:03.728341 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:03.728346 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:03.729688 (+ 1342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:03.729700 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:03.730482 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:03.730490 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:03.730729 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:03.731470 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:03.731498 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:03.733816 (+ 2318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:03.737027 (+ 3211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:03.737036 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:03.737054 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:03.737492 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:03.738170 (+ 678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:03.738178 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:03.738182 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:03.738503 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:03.739161 (+ 658us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:03.739171 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:03.739701 (+ 530us) client_negotiation.cc:769] Sending connection context
0807 04:16:03.740018 (+ 317us) client_negotiation.cc:240] Negotiation successful
0807 04:16:03.740679 (+ 661us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":602,"thread_start_us":338,"threads_started":1}
I20260807 04:16:03.743760 11083 heartbeater.cc:347] Connected to a master server at 127.7.200.254:43499
I20260807 04:16:03.744107 11083 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:03.744959 11083 heartbeater.cc:511] Master 127.7.200.254:43499 requested a full tablet report, sending...
I20260807 04:16:03.746722 10592 ts_manager.cc:194] Registered new tserver with Master: 1ba518cb562644a0b40a24aea5772c3d (127.7.200.195:46389)
I20260807 04:16:03.747563 10592 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.195@KRBTEST.COM'} at 127.7.200.195:59247
I20260807 04:16:03.752164 7971 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 04:16:03.791848 11085 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:16:03.789057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37000 (local address 127.7.200.254:43499)
0807 04:16:03.789237 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:03.789241 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:03.789715 (+ 474us) server_negotiation.cc:407] Connection header received
0807 04:16:03.789878 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:03.789882 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:03.790001 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:03.790101 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:03.791644 (+ 1543us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37000: BlockingRecv error: recv got EOF from 127.0.0.1:37000 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 04:16:03.794946 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 10661
W20260807 04:16:03.798180 7971 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 10661: Not authorized: Client connection negotiation failed: client connection to 127.7.200.193:42907: server requires authentication, but client does not have Kerberos credentials available
I20260807 04:16:03.798409 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 10661
I20260807 04:16:03.817243 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 10803
W20260807 04:16:03.820384 7971 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 10803: Not authorized: Client connection negotiation failed: client connection to 127.7.200.194:43383: server requires authentication, but client does not have Kerberos credentials available
I20260807 04:16:03.820554 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 10803
I20260807 04:16:03.839346 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 10944
W20260807 04:16:03.842777 7971 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 10944: Not authorized: Client connection negotiation failed: client connection to 127.7.200.195:46389: server requires authentication, but client does not have Kerberos credentials available
I20260807 04:16:03.842922 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 10944
I20260807 04:16:03.862655 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 10557
I20260807 04:16:03.864039 10626 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:03.970799 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 10557
2026-08-07T04:16:03Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3824 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:16:04 dist-test-slave-qg60 krb5kdc[11102](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:16:04 dist-test-slave-qg60 krb5kdc[11102](info): set up 2 sockets
Aug 07 04:16:04 dist-test-slave-qg60 krb5kdc[11102](info): commencing operation
krb5kdc: starting...
W20260807 04:16:05.134714 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.005s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:16:05 dist-test-slave-qg60 krb5kdc[11102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076165, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:16:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:16:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
I20260807 04:16:05.381170 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:38545
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:33419
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:38545
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:05.716410 11117 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:05.716728 11117 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:05.716938 11117 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:05.724187 11117 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:16:05.724291 11117 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:05.724424 11117 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:05.724524 11117 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:16:05.724615 11117 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:16:05.735945 11117 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:33419
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:38545
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:38545
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:05.737371 11117 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:05.738704 11117 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:05.750085 11122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:05.751579 11123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:05.752060 11125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:05.753345 11117 server_base.cc:1034] running on GCE node
I20260807 04:16:05.754182 11117 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:05.755651 11117 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:05.756845 11117 hybrid_clock.cc:648] HybridClock initialized: now 1786076165756774 us; error 64 us; skew 500 ppm
I20260807 04:16:05.757253 11117 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:05 dist-test-slave-qg60 krb5kdc[11102](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076165, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:05.767313 11117 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:16:05.769098 11117 webserver.cc:460] Webserver started at http://127.7.200.254:38377/ using document root <none> and password file <none>
I20260807 04:16:05.769847 11117 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:05.769991 11117 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:05.770324 11117 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:05.773550 11117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "5d58283525a2451692897de124669c40"
format_stamp: "Formatted at 2026-08-07 04:16:05 on dist-test-slave-qg60"
server_key: "c895c1d7c3acda04311e26a8de54b930"
server_key_iv: "8d59eee6bbcc77bb7e30a6d4dc84b25c"
server_key_version: "encryptionkey@0"
I20260807 04:16:05.774390 11117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "5d58283525a2451692897de124669c40"
format_stamp: "Formatted at 2026-08-07 04:16:05 on dist-test-slave-qg60"
server_key: "c895c1d7c3acda04311e26a8de54b930"
server_key_iv: "8d59eee6bbcc77bb7e30a6d4dc84b25c"
server_key_version: "encryptionkey@0"
I20260807 04:16:05.779814 11117 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260807 04:16:05.783615 11133 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:05.785113 11117 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 04:16:05.785297 11117 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "5d58283525a2451692897de124669c40"
format_stamp: "Formatted at 2026-08-07 04:16:05 on dist-test-slave-qg60"
server_key: "c895c1d7c3acda04311e26a8de54b930"
server_key_iv: "8d59eee6bbcc77bb7e30a6d4dc84b25c"
server_key_version: "encryptionkey@0"
I20260807 04:16:05.785501 11117 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:05.807582 11117 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:05.812449 11117 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:05.812804 11117 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:05.832211 11117 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:38545
I20260807 04:16:05.832242 11187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:38545 every 8 connection(s)
I20260807 04:16:05.833700 11117 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:16:05.834352 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 11117
I20260807 04:16:05.834609 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:16:05.835410 7971 external_mini_cluster.cc:1428] Setting key e2bfebfde986f02e1b340c82f47e931a
I20260807 04:16:05.838431 11188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 04:16:05 dist-test-slave-qg60 krb5kdc[11102](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076165, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:16:05.852438 11188 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d58283525a2451692897de124669c40: Bootstrap starting.
I20260807 04:16:05.856971 11188 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d58283525a2451692897de124669c40: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:05.858307 11188 log.cc:824] T 00000000000000000000000000000000 P 5d58283525a2451692897de124669c40: Log is configured to *not* fsync() on all Append() calls
I20260807 04:16:05.861472 11188 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d58283525a2451692897de124669c40: No bootstrap required, opened a new log
I20260807 04:16:05.862001 11192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:05.837621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42858 (local address 127.7.200.254:38545)
0807 04:16:05.838527 (+ 906us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:05.838543 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:05.838595 (+ 52us) server_negotiation.cc:407] Connection header received
0807 04:16:05.841047 (+ 2452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:05.841077 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:05.841623 (+ 546us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:05.842173 (+ 550us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:05.843742 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:05.845880 (+ 2138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:05.847312 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:05.848374 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:05.848613 (+ 239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:05.853179 (+ 4566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:05.853191 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:05.853211 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:05.853258 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:05.857446 (+ 4188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:05.858224 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:05.858234 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:05.858247 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:05.858502 (+ 255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:05.858904 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:05.858910 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:05.858913 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:05.859527 (+ 614us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:05.859832 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:05.860379 (+ 547us) server_negotiation.cc:299] Negotiation successful
0807 04:16:05.860861 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":612,"thread_start_us":380,"threads_started":1}
I20260807 04:16:05.866128 7971 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 04:16:05.870165 11188 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5d58283525a2451692897de124669c40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d58283525a2451692897de124669c40" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 38545 } }
I20260807 04:16:05.870630 11188 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5d58283525a2451692897de124669c40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:05.870741 11188 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5d58283525a2451692897de124669c40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d58283525a2451692897de124669c40, State: Initialized, Role: FOLLOWER
I20260807 04:16:05.871390 11188 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d58283525a2451692897de124669c40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d58283525a2451692897de124669c40" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 38545 } }
I20260807 04:16:05.871652 11188 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5d58283525a2451692897de124669c40 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:16:05.871809 11188 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d58283525a2451692897de124669c40 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:16:05.872007 11188 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d58283525a2451692897de124669c40 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:05.874404 11188 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d58283525a2451692897de124669c40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d58283525a2451692897de124669c40" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 38545 } }
I20260807 04:16:05.875061 11188 leader_election.cc:302] T 00000000000000000000000000000000 P 5d58283525a2451692897de124669c40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5d58283525a2451692897de124669c40; no voters:
I20260807 04:16:05.875782 11188 leader_election.cc:288] T 00000000000000000000000000000000 P 5d58283525a2451692897de124669c40 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:16:05.875902 11195 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5d58283525a2451692897de124669c40 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:16:05.877457 11195 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5d58283525a2451692897de124669c40 [term 1 LEADER]: Becoming Leader. State: Replica: 5d58283525a2451692897de124669c40, State: Running, Role: LEADER
I20260807 04:16:05.878190 11195 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d58283525a2451692897de124669c40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d58283525a2451692897de124669c40" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 38545 } }
I20260807 04:16:05.878290 11188 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5d58283525a2451692897de124669c40 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:16:05.881551 11196 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d58283525a2451692897de124669c40 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5d58283525a2451692897de124669c40" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d58283525a2451692897de124669c40" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 38545 } } }
I20260807 04:16:05.881529 11197 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d58283525a2451692897de124669c40 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d58283525a2451692897de124669c40. Latest consensus state: current_term: 1 leader_uuid: "5d58283525a2451692897de124669c40" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d58283525a2451692897de124669c40" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 38545 } } }
I20260807 04:16:05.881969 11196 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d58283525a2451692897de124669c40 [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:05.882107 11197 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d58283525a2451692897de124669c40 [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:05.893981 11204 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:16:05.900890 11204 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:16:05.912716 11204 catalog_manager.cc:1347] Generated new cluster ID: 71bef0bd80a942e5867190aca0755795
I20260807 04:16:05.912879 11204 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:16:05.930240 11192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:05.917555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42868 (local address 127.7.200.254:38545)
0807 04:16:05.917720 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:05.917725 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:05.921399 (+ 3674us) server_negotiation.cc:407] Connection header received
0807 04:16:05.921595 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:05.921601 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:05.921699 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:05.921831 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:05.923087 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:05.924331 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:05.926166 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:05.926810 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:05.926966 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:05.928135 (+ 1169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:05.928142 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:05.928149 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:16:05.929189 (+ 1040us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:05.929259 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:16:05.929288 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:05.929399 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:05.929634 (+ 235us) server_negotiation.cc:299] Negotiation successful
0807 04:16:05.929745 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":57}
I20260807 04:16:05.936143 11204 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:16:05.937623 11204 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:16:05.950893 11204 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5d58283525a2451692897de124669c40: Generated new TSK 0
I20260807 04:16:05.952013 11204 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:16:05.965845 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 11117
I20260807 04:16:05.967069 11183 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:06.063169 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 11117
2026-08-07T04:16:06Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2087 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:16:06 dist-test-slave-qg60 krb5kdc[11226](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:16:06 dist-test-slave-qg60 krb5kdc[11226](info): set up 2 sockets
Aug 07 04:16:06 dist-test-slave-qg60 krb5kdc[11226](info): commencing operation
krb5kdc: starting...
W20260807 04:16:07.213912 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.110s user 0.001s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:16:07 dist-test-slave-qg60 krb5kdc[11226](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076167, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:16:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:16:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
I20260807 04:16:07.452661 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:36353
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:42999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:36353
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:07.798501 11243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:07.798828 11243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:07.799014 11243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:07.806586 11243 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:16:07.806705 11243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:07.806795 11243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:07.806907 11243 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:16:07.807005 11243 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:16:07.817180 11243 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:42999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:36353
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:36353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:07.818557 11243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:07.819903 11243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:07.832406 11248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:07.832334 11249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:07.832379 11251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:07.833727 11243 server_base.cc:1034] running on GCE node
I20260807 04:16:07.834556 11243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:07.836041 11243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:07.837396 11243 hybrid_clock.cc:648] HybridClock initialized: now 1786076167837311 us; error 55 us; skew 500 ppm
I20260807 04:16:07.837788 11243 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:07 dist-test-slave-qg60 krb5kdc[11226](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076167, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:07.841259 11243 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:16:07.842885 11243 webserver.cc:460] Webserver started at http://127.7.200.254:35017/ using document root <none> and password file <none>
I20260807 04:16:07.843623 11243 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:07.843782 11243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:07.844121 11243 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:07.847303 11243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "57eb5a85e45d4b3cb6c5d23d4c759dcc"
format_stamp: "Formatted at 2026-08-07 04:16:07 on dist-test-slave-qg60"
server_key: "84b400ef880e41d8d36cc4c02d3c6e1a"
server_key_iv: "13ba21f5993a770cfd27b53856459f5d"
server_key_version: "encryptionkey@0"
I20260807 04:16:07.848150 11243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "57eb5a85e45d4b3cb6c5d23d4c759dcc"
format_stamp: "Formatted at 2026-08-07 04:16:07 on dist-test-slave-qg60"
server_key: "84b400ef880e41d8d36cc4c02d3c6e1a"
server_key_iv: "13ba21f5993a770cfd27b53856459f5d"
server_key_version: "encryptionkey@0"
I20260807 04:16:07.853843 11243 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260807 04:16:07.857640 11258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:07.859102 11243 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:16:07.859304 11243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "57eb5a85e45d4b3cb6c5d23d4c759dcc"
format_stamp: "Formatted at 2026-08-07 04:16:07 on dist-test-slave-qg60"
server_key: "84b400ef880e41d8d36cc4c02d3c6e1a"
server_key_iv: "13ba21f5993a770cfd27b53856459f5d"
server_key_version: "encryptionkey@0"
I20260807 04:16:07.859542 11243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:07.883919 11243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:07.888365 11243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:07.888701 11243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:07.908366 11243 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:36353
I20260807 04:16:07.908448 11314 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:36353 every 8 connection(s)
I20260807 04:16:07.909858 11243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:16:07.913754 11315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:07.919482 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 11243
I20260807 04:16:07.919699 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:16:07.920393 7971 external_mini_cluster.cc:1428] Setting key ae9e2ac5a2246bf2f946eeea07164430
I20260807 04:16:07.924842 11315 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57eb5a85e45d4b3cb6c5d23d4c759dcc: Bootstrap starting.
I20260807 04:16:07.928700 11315 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57eb5a85e45d4b3cb6c5d23d4c759dcc: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:07.930006 11315 log.cc:824] T 00000000000000000000000000000000 P 57eb5a85e45d4b3cb6c5d23d4c759dcc: Log is configured to *not* fsync() on all Append() calls
I20260807 04:16:07.933535 11315 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57eb5a85e45d4b3cb6c5d23d4c759dcc: No bootstrap required, opened a new log
Aug 07 04:16:07 dist-test-slave-qg60 krb5kdc[11226](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076167, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:16:07.941939 11315 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57eb5a85e45d4b3cb6c5d23d4c759dcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57eb5a85e45d4b3cb6c5d23d4c759dcc" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 36353 } }
I20260807 04:16:07.942328 11315 raft_consensus.cc:374] T 00000000000000000000000000000000 P 57eb5a85e45d4b3cb6c5d23d4c759dcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:07.942433 11315 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57eb5a85e45d4b3cb6c5d23d4c759dcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57eb5a85e45d4b3cb6c5d23d4c759dcc, State: Initialized, Role: FOLLOWER
I20260807 04:16:07.943142 11315 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57eb5a85e45d4b3cb6c5d23d4c759dcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57eb5a85e45d4b3cb6c5d23d4c759dcc" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 36353 } }
I20260807 04:16:07.943403 11315 raft_consensus.cc:388] T 00000000000000000000000000000000 P 57eb5a85e45d4b3cb6c5d23d4c759dcc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:16:07.943588 11315 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57eb5a85e45d4b3cb6c5d23d4c759dcc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:16:07.943816 11315 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57eb5a85e45d4b3cb6c5d23d4c759dcc [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:07.944983 11320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:07.922554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46060 (local address 127.7.200.254:36353)
0807 04:16:07.923391 (+ 837us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:07.923403 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:07.923446 (+ 43us) server_negotiation.cc:407] Connection header received
0807 04:16:07.925226 (+ 1780us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:07.925250 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:07.925641 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:07.925974 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:07.927917 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:07.929383 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:07.931130 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:07.931895 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:07.932053 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:07.937052 (+ 4999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:07.937065 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:07.937081 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:07.937123 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:07.940486 (+ 3363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:07.941278 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:07.941294 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:07.941303 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:07.941470 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:07.941867 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:07.941872 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:07.941876 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:07.942575 (+ 699us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:07.942956 (+ 381us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:07.943293 (+ 337us) server_negotiation.cc:299] Negotiation successful
0807 04:16:07.943768 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":623,"thread_start_us":402,"threads_started":1}
I20260807 04:16:07.946424 11315 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57eb5a85e45d4b3cb6c5d23d4c759dcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57eb5a85e45d4b3cb6c5d23d4c759dcc" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 36353 } }
I20260807 04:16:07.946933 11315 leader_election.cc:302] T 00000000000000000000000000000000 P 57eb5a85e45d4b3cb6c5d23d4c759dcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57eb5a85e45d4b3cb6c5d23d4c759dcc; no voters:
I20260807 04:16:07.947636 11315 leader_election.cc:288] T 00000000000000000000000000000000 P 57eb5a85e45d4b3cb6c5d23d4c759dcc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:16:07.947738 11322 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57eb5a85e45d4b3cb6c5d23d4c759dcc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:16:07.948500 11322 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57eb5a85e45d4b3cb6c5d23d4c759dcc [term 1 LEADER]: Becoming Leader. State: Replica: 57eb5a85e45d4b3cb6c5d23d4c759dcc, State: Running, Role: LEADER
I20260807 04:16:07.949179 11322 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57eb5a85e45d4b3cb6c5d23d4c759dcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57eb5a85e45d4b3cb6c5d23d4c759dcc" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 36353 } }
I20260807 04:16:07.950096 11315 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57eb5a85e45d4b3cb6c5d23d4c759dcc [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:16:07.952188 11325 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57eb5a85e45d4b3cb6c5d23d4c759dcc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57eb5a85e45d4b3cb6c5d23d4c759dcc. Latest consensus state: current_term: 1 leader_uuid: "57eb5a85e45d4b3cb6c5d23d4c759dcc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57eb5a85e45d4b3cb6c5d23d4c759dcc" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 36353 } } }
I20260807 04:16:07.952670 11325 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57eb5a85e45d4b3cb6c5d23d4c759dcc [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:07.952668 11324 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57eb5a85e45d4b3cb6c5d23d4c759dcc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "57eb5a85e45d4b3cb6c5d23d4c759dcc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57eb5a85e45d4b3cb6c5d23d4c759dcc" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 36353 } } }
I20260807 04:16:07.953202 11324 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57eb5a85e45d4b3cb6c5d23d4c759dcc [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:07.955375 11332 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:16:07.959539 11332 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:16:07.968526 11332 catalog_manager.cc:1347] Generated new cluster ID: 3b83f070223b443cafd9d70dde8ca79c
I20260807 04:16:07.968652 11332 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:16:07.982667 11332 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:16:07.984684 11332 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:16:07.994882 11332 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 57eb5a85e45d4b3cb6c5d23d4c759dcc: Generated new TSK 0
I20260807 04:16:07.996024 11332 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.200.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
I20260807 04:16:08.058044 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:0
--local_ip_for_outbound_sockets=127.7.200.193
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:36353
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:42999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:08.401257 11346 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:08.401612 11346 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:08.401787 11346 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:08.409147 11346 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:08.409256 11346 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:08.409462 11346 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:16:08.419380 11346 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:42999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:36353
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:08.420857 11346 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:08.422230 11346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:08.436096 11352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:08.436143 11354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:08.436290 11351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:08.437062 11346 server_base.cc:1034] running on GCE node
I20260807 04:16:08.437719 11346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:08.438727 11346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:08.439939 11346 hybrid_clock.cc:648] HybridClock initialized: now 1786076168439890 us; error 38 us; skew 500 ppm
I20260807 04:16:08.440304 11346 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:08 dist-test-slave-qg60 krb5kdc[11226](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076168, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:08.443660 11346 init.cc:377] Logged in from keytab as kudu/127.7.200.193@KRBTEST.COM (short username kudu)
I20260807 04:16:08.445396 11346 webserver.cc:460] Webserver started at http://127.7.200.193:37563/ using document root <none> and password file <none>
I20260807 04:16:08.446208 11346 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:08.446316 11346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:08.446560 11346 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:08.449584 11346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/data/instance:
uuid: "baa77b79b011427dbc09466a6ca6df4d"
format_stamp: "Formatted at 2026-08-07 04:16:08 on dist-test-slave-qg60"
server_key: "04d0da9524727bbcc7df2084ddff4580"
server_key_iv: "763cbd85680b1e5653cc416b70ffa502"
server_key_version: "encryptionkey@0"
I20260807 04:16:08.450429 11346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance:
uuid: "baa77b79b011427dbc09466a6ca6df4d"
format_stamp: "Formatted at 2026-08-07 04:16:08 on dist-test-slave-qg60"
server_key: "04d0da9524727bbcc7df2084ddff4580"
server_key_iv: "763cbd85680b1e5653cc416b70ffa502"
server_key_version: "encryptionkey@0"
I20260807 04:16:08.456112 11346 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 04:16:08.459798 11362 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:08.461252 11346 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:16:08.461436 11346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "baa77b79b011427dbc09466a6ca6df4d"
format_stamp: "Formatted at 2026-08-07 04:16:08 on dist-test-slave-qg60"
server_key: "04d0da9524727bbcc7df2084ddff4580"
server_key_iv: "763cbd85680b1e5653cc416b70ffa502"
server_key_version: "encryptionkey@0"
I20260807 04:16:08.461644 11346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:08.482580 11346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:08.486697 11346 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:08.487027 11346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:08.488034 11346 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:16:08.489581 11346 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:08.489692 11346 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:08.489850 11346 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:08.489934 11346 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:08.525566 11346 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:40925
I20260807 04:16:08.525614 11485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:40925 every 8 connection(s)
I20260807 04:16:08.526912 11346 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:16:08.533715 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 11346
I20260807 04:16:08.533937 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance
I20260807 04:16:08.534610 7971 external_mini_cluster.cc:1428] Setting key 2efaf0bf0e585196edf50aaef7d56faa
Aug 07 04:16:08 dist-test-slave-qg60 krb5kdc[11226](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076168, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:16:08.548143 11488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:08.529684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:43739 (local address 127.7.200.254:36353)
0807 04:16:08.530144 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:08.530149 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:08.531149 (+ 1000us) server_negotiation.cc:407] Connection header received
0807 04:16:08.533115 (+ 1966us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:08.533122 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:08.533217 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:08.533380 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:08.535045 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:08.535927 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:08.537729 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:08.538138 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:08.538279 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:08.542142 (+ 3863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:08.542147 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:08.542150 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:08.542184 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:08.544971 (+ 2787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:08.545743 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:08.545753 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:08.545755 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:08.545876 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:08.546331 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:08.546336 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:08.546341 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:08.546620 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:08.546779 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:08.547499 (+ 720us) server_negotiation.cc:299] Negotiation successful
0807 04:16:08.547749 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":223,"threads_started":1}
I20260807 04:16:08.549225 11489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:08.530239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:36353 (local address 127.7.200.193:43739)
0807 04:16:08.530956 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:08.531022 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:08.532834 (+ 1812us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:08.533631 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:08.533639 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:08.534254 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:08.534873 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:08.534893 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:08.536106 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:08.536119 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:08.537573 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:08.537586 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:08.538406 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:08.538414 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:08.538642 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:08.539373 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:08.539401 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:08.541893 (+ 2492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:08.545128 (+ 3235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:08.545138 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:08.545156 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:08.545603 (+ 447us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:08.545993 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:08.546001 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:08.546004 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:08.546205 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:08.546754 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:08.546763 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:08.547117 (+ 354us) client_negotiation.cc:769] Sending connection context
0807 04:16:08.547392 (+ 275us) client_negotiation.cc:240] Negotiation successful
0807 04:16:08.547955 (+ 563us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":284,"threads_started":1}
I20260807 04:16:08.550951 11486 heartbeater.cc:347] Connected to a master server at 127.7.200.254:36353
I20260807 04:16:08.551311 11486 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:08.552090 11486 heartbeater.cc:511] Master 127.7.200.254:36353 requested a full tablet report, sending...
I20260807 04:16:08.554617 11275 ts_manager.cc:194] Registered new tserver with Master: baa77b79b011427dbc09466a6ca6df4d (127.7.200.193:40925)
I20260807 04:16:08.556948 11275 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.193@KRBTEST.COM'} at 127.7.200.193:43739
WARNING: no policy specified for kudu/127.7.200.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
I20260807 04:16:08.590152 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:0
--local_ip_for_outbound_sockets=127.7.200.194
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:36353
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:42999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:08.934660 11492 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:08.935027 11492 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:08.935210 11492 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:08.942873 11492 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:08.943056 11492 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:08.943238 11492 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:16:08.953873 11492 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:42999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:36353
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:08.955396 11492 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:08.956885 11492 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:08.971102 11497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:08.971902 11498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:08.971872 11501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:08.972581 11492 server_base.cc:1034] running on GCE node
I20260807 04:16:08.973536 11492 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:08.975111 11492 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:08.976323 11492 hybrid_clock.cc:648] HybridClock initialized: now 1786076168976246 us; error 61 us; skew 500 ppm
I20260807 04:16:08.976699 11492 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:08 dist-test-slave-qg60 krb5kdc[11226](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076168, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:08.980705 11492 init.cc:377] Logged in from keytab as kudu/127.7.200.194@KRBTEST.COM (short username kudu)
I20260807 04:16:08.982758 11492 webserver.cc:460] Webserver started at http://127.7.200.194:37679/ using document root <none> and password file <none>
I20260807 04:16:08.983875 11492 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:08.984051 11492 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:08.984498 11492 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:08.989125 11492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/data/instance:
uuid: "f44e739ca6a540aab5ae8e178d18bb5e"
format_stamp: "Formatted at 2026-08-07 04:16:08 on dist-test-slave-qg60"
server_key: "4a651f7956797797ac015d112890b97a"
server_key_iv: "a858a8a374bd75ce4f6f47b0f3638a5c"
server_key_version: "encryptionkey@0"
I20260807 04:16:08.990270 11492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance:
uuid: "f44e739ca6a540aab5ae8e178d18bb5e"
format_stamp: "Formatted at 2026-08-07 04:16:08 on dist-test-slave-qg60"
server_key: "4a651f7956797797ac015d112890b97a"
server_key_iv: "a858a8a374bd75ce4f6f47b0f3638a5c"
server_key_version: "encryptionkey@0"
I20260807 04:16:08.998420 11492 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.007s sys 0.001s
I20260807 04:16:09.003883 11508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:09.006229 11492 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260807 04:16:09.006464 11492 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "f44e739ca6a540aab5ae8e178d18bb5e"
format_stamp: "Formatted at 2026-08-07 04:16:08 on dist-test-slave-qg60"
server_key: "4a651f7956797797ac015d112890b97a"
server_key_iv: "a858a8a374bd75ce4f6f47b0f3638a5c"
server_key_version: "encryptionkey@0"
I20260807 04:16:09.006705 11492 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:09.043174 11492 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:09.047624 11492 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:09.047940 11492 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:09.049077 11492 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:16:09.050590 11492 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:09.050695 11492 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:09.050844 11492 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:09.050928 11492 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:09.087420 11492 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:42125
I20260807 04:16:09.087466 11628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:42125 every 8 connection(s)
I20260807 04:16:09.088810 11492 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:16:09.095674 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 11492
I20260807 04:16:09.095855 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance
I20260807 04:16:09.096326 7971 external_mini_cluster.cc:1428] Setting key 604f35537c535dbd862b773b02ba9350
Aug 07 04:16:09 dist-test-slave-qg60 krb5kdc[11226](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076168, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:16:09.111558 11631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:09.091643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:39629 (local address 127.7.200.254:36353)
0807 04:16:09.092151 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:09.092158 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:09.093096 (+ 938us) server_negotiation.cc:407] Connection header received
0807 04:16:09.094949 (+ 1853us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:09.094954 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:09.095029 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:09.095135 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:09.096969 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:09.097846 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:09.099614 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:09.100059 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:09.100200 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:09.104526 (+ 4326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:09.104533 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:09.104541 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:09.104587 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:09.107735 (+ 3148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:09.108521 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:09.108530 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:09.108536 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:09.108712 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:09.109269 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:09.109277 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:09.109283 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:09.109693 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:09.109857 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:09.110722 (+ 865us) server_negotiation.cc:299] Negotiation successful
0807 04:16:09.110991 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":238,"threads_started":1}
I20260807 04:16:09.112442 11632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:09.092046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:36353 (local address 127.7.200.194:39629)
0807 04:16:09.092929 (+ 883us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:09.092979 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:09.094683 (+ 1704us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:09.095336 (+ 653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:09.095344 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:09.096062 (+ 718us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:09.096751 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:09.096770 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:09.098039 (+ 1269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:09.098043 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:09.099459 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:09.099472 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:09.100299 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:09.100307 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:09.100586 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:09.101360 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:09.101383 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:09.104258 (+ 2875us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:09.107890 (+ 3632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:09.107899 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:09.107918 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:09.108376 (+ 458us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:09.108870 (+ 494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:09.108874 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:09.108887 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:09.109134 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:09.109854 (+ 720us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:09.109861 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:09.110222 (+ 361us) client_negotiation.cc:769] Sending connection context
0807 04:16:09.110585 (+ 363us) client_negotiation.cc:240] Negotiation successful
0807 04:16:09.111058 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":345,"threads_started":1}
I20260807 04:16:09.114123 11629 heartbeater.cc:347] Connected to a master server at 127.7.200.254:36353
I20260807 04:16:09.114483 11629 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:09.115451 11629 heartbeater.cc:511] Master 127.7.200.254:36353 requested a full tablet report, sending...
I20260807 04:16:09.117162 11275 ts_manager.cc:194] Registered new tserver with Master: f44e739ca6a540aab5ae8e178d18bb5e (127.7.200.194:42125)
I20260807 04:16:09.118106 11275 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.194@KRBTEST.COM'} at 127.7.200.194:39629
WARNING: no policy specified for kudu/127.7.200.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
I20260807 04:16:09.153131 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:0
--local_ip_for_outbound_sockets=127.7.200.195
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:36353
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:42999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:09.494515 11635 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:09.494812 11635 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:09.494977 11635 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:09.502421 11635 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:09.502542 11635 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:09.502732 11635 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:16:09.513108 11635 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:42999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:36353
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:09.514489 11635 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:09.515815 11635 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:09.529881 11640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:09.529856 11641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:09.531435 11643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:09.531719 11635 server_base.cc:1034] running on GCE node
I20260807 04:16:09.532331 11635 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:09.533408 11635 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:09.534657 11635 hybrid_clock.cc:648] HybridClock initialized: now 1786076169534630 us; error 40 us; skew 500 ppm
I20260807 04:16:09.535097 11635 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:09 dist-test-slave-qg60 krb5kdc[11226](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076169, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:09.538693 11635 init.cc:377] Logged in from keytab as kudu/127.7.200.195@KRBTEST.COM (short username kudu)
I20260807 04:16:09.540223 11635 webserver.cc:460] Webserver started at http://127.7.200.195:46143/ using document root <none> and password file <none>
I20260807 04:16:09.541026 11635 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:09.541182 11635 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:09.541519 11635 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:09.544621 11635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/data/instance:
uuid: "ff81b377aa4d4a82a253d7ce5338f349"
format_stamp: "Formatted at 2026-08-07 04:16:09 on dist-test-slave-qg60"
server_key: "b6786feefc86f8f4c46364df85afd611"
server_key_iv: "451dc08080699b3ad6df0837890cdc23"
server_key_version: "encryptionkey@0"
I20260807 04:16:09.545531 11635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance:
uuid: "ff81b377aa4d4a82a253d7ce5338f349"
format_stamp: "Formatted at 2026-08-07 04:16:09 on dist-test-slave-qg60"
server_key: "b6786feefc86f8f4c46364df85afd611"
server_key_iv: "451dc08080699b3ad6df0837890cdc23"
server_key_version: "encryptionkey@0"
I20260807 04:16:09.551326 11635 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 04:16:09.555161 11651 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:09.556797 11635 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:16:09.557000 11635 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "ff81b377aa4d4a82a253d7ce5338f349"
format_stamp: "Formatted at 2026-08-07 04:16:09 on dist-test-slave-qg60"
server_key: "b6786feefc86f8f4c46364df85afd611"
server_key_iv: "451dc08080699b3ad6df0837890cdc23"
server_key_version: "encryptionkey@0"
I20260807 04:16:09.557219 11635 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:09.560122 11486 heartbeater.cc:503] Master 127.7.200.254:36353 was elected leader, sending a full tablet report...
I20260807 04:16:09.579989 11635 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:09.584753 11635 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:09.585079 11635 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:09.586166 11635 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:16:09.587648 11635 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:09.587762 11635 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:09.587921 11635 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:09.587996 11635 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:09.626596 11635 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:35937
I20260807 04:16:09.626688 11772 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:35937 every 8 connection(s)
I20260807 04:16:09.627974 11635 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:16:09.638413 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 11635
I20260807 04:16:09.638636 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance
I20260807 04:16:09.639187 7971 external_mini_cluster.cc:1428] Setting key 9c5245c4d6acd2deee494ef5af85fc3b
Aug 07 04:16:09 dist-test-slave-qg60 krb5kdc[11226](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076169, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:16:09.649835 11777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:09.630859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:46615 (local address 127.7.200.254:36353)
0807 04:16:09.631341 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:09.631346 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:09.632387 (+ 1041us) server_negotiation.cc:407] Connection header received
0807 04:16:09.634422 (+ 2035us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:09.634429 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:09.634546 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:09.634672 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:09.636268 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:09.637260 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:09.638998 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:09.639480 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:09.639622 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:09.643779 (+ 4157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:09.643784 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:09.643787 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:09.643841 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:09.646601 (+ 2760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:09.647368 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:09.647380 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:09.647383 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:09.647513 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:09.647944 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:09.647951 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:09.647954 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:09.648227 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:09.648396 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:09.649188 (+ 792us) server_negotiation.cc:299] Negotiation successful
0807 04:16:09.649413 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":248,"threads_started":1}
I20260807 04:16:09.650946 11778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:09.631331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:36353 (local address 127.7.200.195:46615)
0807 04:16:09.632202 (+ 871us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:09.632241 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:09.634132 (+ 1891us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:09.634918 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:09.634926 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:09.635479 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:09.636075 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:09.636094 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:09.637436 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:09.637440 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:09.638843 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:09.638857 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:09.639726 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:09.639734 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:09.640027 (+ 293us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:09.641010 (+ 983us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:09.641041 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:09.643561 (+ 2520us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:09.646746 (+ 3185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:09.646756 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:09.646774 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:09.647234 (+ 460us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:09.647627 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:09.647632 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:09.647636 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:09.647827 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:09.648359 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:09.648367 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:09.648787 (+ 420us) client_negotiation.cc:769] Sending connection context
0807 04:16:09.649107 (+ 320us) client_negotiation.cc:240] Negotiation successful
0807 04:16:09.649682 (+ 575us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":619,"thread_start_us":350,"threads_started":1}
I20260807 04:16:09.652604 11774 heartbeater.cc:347] Connected to a master server at 127.7.200.254:36353
I20260807 04:16:09.652979 11774 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:09.653963 11774 heartbeater.cc:511] Master 127.7.200.254:36353 requested a full tablet report, sending...
I20260807 04:16:09.655748 11275 ts_manager.cc:194] Registered new tserver with Master: ff81b377aa4d4a82a253d7ce5338f349 (127.7.200.195:35937)
I20260807 04:16:09.656594 11275 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.195@KRBTEST.COM'} at 127.7.200.195:46615
I20260807 04:16:09.668167 7971 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 04:16:09 dist-test-slave-qg60 krb5kdc[11226](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076169, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 07 04:16:09 dist-test-slave-qg60 krb5kdc[11226](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076169, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:16:09.725880 11777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:09.711639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46074 (local address 127.7.200.254:36353)
0807 04:16:09.711900 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:09.711907 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:09.712220 (+ 313us) server_negotiation.cc:407] Connection header received
0807 04:16:09.712379 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:09.712383 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:09.712493 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:09.712589 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:09.714150 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:09.714910 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:09.716140 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:09.716573 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:09.716673 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:09.720543 (+ 3870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:09.720548 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:09.720551 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:09.720586 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:09.723199 (+ 2613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:09.723921 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:09.723927 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:09.723931 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:09.724070 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:09.724430 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:09.724435 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:09.724437 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:09.724879 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:09.725081 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:09.725337 (+ 256us) server_negotiation.cc:299] Negotiation successful
0807 04:16:09.725533 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
W20260807 04:16:09.726440 11275 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:46074
I20260807 04:16:09.728678 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 11346
Aug 07 04:16:09 dist-test-slave-qg60 krb5kdc[11226](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076169, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.7.200.193@KRBTEST.COM
I20260807 04:16:09.746325 11788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:09.729819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56450 (local address 127.7.200.193:40925)
0807 04:16:09.730471 (+ 652us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:09.730478 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:09.730503 (+ 25us) server_negotiation.cc:407] Connection header received
0807 04:16:09.730559 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:09.730565 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:09.730762 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:09.730883 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:09.732201 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:09.733326 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:09.734587 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:09.735154 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:09.735257 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:09.739518 (+ 4261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:09.739533 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:09.739548 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:09.739583 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:09.742734 (+ 3151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:09.743663 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:09.743673 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:09.743676 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:09.743843 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:09.744324 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:09.744332 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:09.744338 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:09.744900 (+ 562us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:09.745241 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:09.745674 (+ 433us) server_negotiation.cc:299] Negotiation successful
0807 04:16:09.745981 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":496,"thread_start_us":353,"threads_started":1}
W20260807 04:16:09.747731 11480 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:56450
W20260807 04:16:09.748837 7971 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 11346: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 04:16:09.749121 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 11346
I20260807 04:16:09.769528 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 11492
Aug 07 04:16:09 dist-test-slave-qg60 krb5kdc[11226](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076169, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.7.200.194@KRBTEST.COM
I20260807 04:16:09.786749 11789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:09.770513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59398 (local address 127.7.200.194:42125)
0807 04:16:09.771147 (+ 634us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:09.771155 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:09.771180 (+ 25us) server_negotiation.cc:407] Connection header received
0807 04:16:09.771251 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:09.771258 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:09.771465 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:09.771607 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:09.773008 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:09.774037 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:09.775376 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:09.775969 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:09.776084 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:09.780268 (+ 4184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:09.780281 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:09.780295 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:09.780328 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:09.783752 (+ 3424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:09.784426 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:09.784436 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:09.784438 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:09.784565 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:09.784997 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:09.785001 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:09.785007 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:09.785371 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:09.785714 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:09.786092 (+ 378us) server_negotiation.cc:299] Negotiation successful
0807 04:16:09.786367 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":486,"thread_start_us":329,"threads_started":1}
W20260807 04:16:09.788122 11623 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:59398
W20260807 04:16:09.789670 7971 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 11492: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 04:16:09.789822 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 11492
I20260807 04:16:09.809617 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 11635
Aug 07 04:16:09 dist-test-slave-qg60 krb5kdc[11226](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076169, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.7.200.195@KRBTEST.COM
I20260807 04:16:09.826202 11790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:09.810594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47102 (local address 127.7.200.195:35937)
0807 04:16:09.811262 (+ 668us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:09.811269 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:09.811300 (+ 31us) server_negotiation.cc:407] Connection header received
0807 04:16:09.811367 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:09.811374 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:09.811599 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:09.811736 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:09.813144 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:09.814238 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:09.815446 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:09.816051 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:09.816151 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:09.820586 (+ 4435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:09.820599 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:09.820613 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:09.820648 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:09.823547 (+ 2899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:09.824191 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:09.824198 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:09.824201 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:09.824332 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:09.824673 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:09.824677 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:09.824679 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:09.825097 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:09.825330 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:09.825580 (+ 250us) server_negotiation.cc:299] Negotiation successful
0807 04:16:09.825784 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":520,"thread_start_us":347,"threads_started":1}
W20260807 04:16:09.827545 11768 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:47102
W20260807 04:16:09.828660 7971 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 11635: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 04:16:09.828967 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 11635
I20260807 04:16:09.847837 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 11243
I20260807 04:16:09.849287 11309 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:09.955765 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 11243
2026-08-07T04:16:09Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3893 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:16:10 dist-test-slave-qg60 krb5kdc[11795](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:16:10 dist-test-slave-qg60 krb5kdc[11795](info): set up 2 sockets
Aug 07 04:16:10 dist-test-slave-qg60 krb5kdc[11795](info): commencing operation
krb5kdc: starting...
W20260807 04:16:11.093811 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.096s user 0.000s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:16:11 dist-test-slave-qg60 krb5kdc[11795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076171, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:16:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:16:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
I20260807 04:16:11.336534 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:37369
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:44227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:37369
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:11.674144 11811 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:11.674471 11811 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:11.674636 11811 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:11.682122 11811 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:16:11.682247 11811 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:11.682345 11811 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:11.682443 11811 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:16:11.682518 11811 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:16:11.692785 11811 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:44227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:37369
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:37369
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:11.694213 11811 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:11.695555 11811 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:11.708137 11819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:11.708277 11817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:11.708535 11816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:11.709427 11811 server_base.cc:1034] running on GCE node
I20260807 04:16:11.710213 11811 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:11.711699 11811 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:11.712937 11811 hybrid_clock.cc:648] HybridClock initialized: now 1786076171712855 us; error 60 us; skew 500 ppm
I20260807 04:16:11.713337 11811 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:11 dist-test-slave-qg60 krb5kdc[11795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076171, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:11.723616 11811 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:16:11.725445 11811 webserver.cc:460] Webserver started at http://127.7.200.254:44547/ using document root <none> and password file <none>
I20260807 04:16:11.726197 11811 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:11.726342 11811 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:11.726709 11811 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:11.729997 11811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "d40db5802340420fbc4d8a695d1048e5"
format_stamp: "Formatted at 2026-08-07 04:16:11 on dist-test-slave-qg60"
server_key: "1a0d846ddad8812d54b7bc17cf1c87e4"
server_key_iv: "f805193353f37c8d7d5b10d98cf7fc4d"
server_key_version: "encryptionkey@0"
I20260807 04:16:11.730823 11811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "d40db5802340420fbc4d8a695d1048e5"
format_stamp: "Formatted at 2026-08-07 04:16:11 on dist-test-slave-qg60"
server_key: "1a0d846ddad8812d54b7bc17cf1c87e4"
server_key_iv: "f805193353f37c8d7d5b10d98cf7fc4d"
server_key_version: "encryptionkey@0"
I20260807 04:16:11.736205 11811 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 04:16:11.739897 11827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:11.741820 11811 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:16:11.742136 11811 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "d40db5802340420fbc4d8a695d1048e5"
format_stamp: "Formatted at 2026-08-07 04:16:11 on dist-test-slave-qg60"
server_key: "1a0d846ddad8812d54b7bc17cf1c87e4"
server_key_iv: "f805193353f37c8d7d5b10d98cf7fc4d"
server_key_version: "encryptionkey@0"
I20260807 04:16:11.742609 11811 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:11.785281 11811 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:11.789803 11811 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:11.790125 11811 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:11.809746 11811 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:37369
I20260807 04:16:11.809806 11886 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:37369 every 8 connection(s)
I20260807 04:16:11.811249 11811 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:16:11.815047 11887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:11.821552 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 11811
I20260807 04:16:11.821803 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:16:11.822430 7971 external_mini_cluster.cc:1428] Setting key 3027ae47f0f2ab077e9d963de536adce
I20260807 04:16:11.826416 11887 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d40db5802340420fbc4d8a695d1048e5: Bootstrap starting.
I20260807 04:16:11.830302 11887 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d40db5802340420fbc4d8a695d1048e5: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:11.831398 11887 log.cc:824] T 00000000000000000000000000000000 P d40db5802340420fbc4d8a695d1048e5: Log is configured to *not* fsync() on all Append() calls
I20260807 04:16:11.834208 11887 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d40db5802340420fbc4d8a695d1048e5: No bootstrap required, opened a new log
Aug 07 04:16:11 dist-test-slave-qg60 krb5kdc[11795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076171, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:16:11.842475 11887 raft_consensus.cc:348] T 00000000000000000000000000000000 P d40db5802340420fbc4d8a695d1048e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d40db5802340420fbc4d8a695d1048e5" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 37369 } }
I20260807 04:16:11.842919 11887 raft_consensus.cc:374] T 00000000000000000000000000000000 P d40db5802340420fbc4d8a695d1048e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:11.843050 11887 raft_consensus.cc:729] T 00000000000000000000000000000000 P d40db5802340420fbc4d8a695d1048e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d40db5802340420fbc4d8a695d1048e5, State: Initialized, Role: FOLLOWER
I20260807 04:16:11.843734 11887 consensus_queue.cc:260] T 00000000000000000000000000000000 P d40db5802340420fbc4d8a695d1048e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d40db5802340420fbc4d8a695d1048e5" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 37369 } }
I20260807 04:16:11.844010 11887 raft_consensus.cc:388] T 00000000000000000000000000000000 P d40db5802340420fbc4d8a695d1048e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:16:11.844184 11887 raft_consensus.cc:482] T 00000000000000000000000000000000 P d40db5802340420fbc4d8a695d1048e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:16:11.844374 11887 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d40db5802340420fbc4d8a695d1048e5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:11.846814 11891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:11.824610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33626 (local address 127.7.200.254:37369)
0807 04:16:11.825511 (+ 901us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:11.825527 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:11.825576 (+ 49us) server_negotiation.cc:407] Connection header received
0807 04:16:11.828115 (+ 2539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:11.828152 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:11.828690 (+ 538us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:11.829171 (+ 481us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:11.830626 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:11.832094 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:11.833411 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:11.834068 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:11.834270 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:11.838437 (+ 4167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:11.838445 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:11.838460 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:11.838500 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:11.841952 (+ 3452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:11.842730 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:11.842737 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:11.842743 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:11.843010 (+ 267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:11.843502 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:11.843507 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:11.843509 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:11.844282 (+ 773us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:11.844585 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:11.845125 (+ 540us) server_negotiation.cc:299] Negotiation successful
0807 04:16:11.845594 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":654,"thread_start_us":381,"threads_started":1}
I20260807 04:16:11.847268 11887 raft_consensus.cc:504] T 00000000000000000000000000000000 P d40db5802340420fbc4d8a695d1048e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d40db5802340420fbc4d8a695d1048e5" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 37369 } }
I20260807 04:16:11.847819 11887 leader_election.cc:302] T 00000000000000000000000000000000 P d40db5802340420fbc4d8a695d1048e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d40db5802340420fbc4d8a695d1048e5; no voters:
I20260807 04:16:11.848518 11887 leader_election.cc:288] T 00000000000000000000000000000000 P d40db5802340420fbc4d8a695d1048e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:16:11.848640 11894 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d40db5802340420fbc4d8a695d1048e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:16:11.850869 11887 sys_catalog.cc:564] T 00000000000000000000000000000000 P d40db5802340420fbc4d8a695d1048e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:16:11.855468 11894 raft_consensus.cc:686] T 00000000000000000000000000000000 P d40db5802340420fbc4d8a695d1048e5 [term 1 LEADER]: Becoming Leader. State: Replica: d40db5802340420fbc4d8a695d1048e5, State: Running, Role: LEADER
I20260807 04:16:11.855994 11894 consensus_queue.cc:237] T 00000000000000000000000000000000 P d40db5802340420fbc4d8a695d1048e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d40db5802340420fbc4d8a695d1048e5" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 37369 } }
I20260807 04:16:11.859344 11895 sys_catalog.cc:455] T 00000000000000000000000000000000 P d40db5802340420fbc4d8a695d1048e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d40db5802340420fbc4d8a695d1048e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d40db5802340420fbc4d8a695d1048e5" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 37369 } } }
I20260807 04:16:11.859835 11895 sys_catalog.cc:458] T 00000000000000000000000000000000 P d40db5802340420fbc4d8a695d1048e5 [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:11.859316 11896 sys_catalog.cc:455] T 00000000000000000000000000000000 P d40db5802340420fbc4d8a695d1048e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d40db5802340420fbc4d8a695d1048e5. Latest consensus state: current_term: 1 leader_uuid: "d40db5802340420fbc4d8a695d1048e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d40db5802340420fbc4d8a695d1048e5" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 37369 } } }
I20260807 04:16:11.861320 11896 sys_catalog.cc:458] T 00000000000000000000000000000000 P d40db5802340420fbc4d8a695d1048e5 [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:11.862972 11912 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:16:11.867476 11912 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:16:11.876299 11912 catalog_manager.cc:1347] Generated new cluster ID: 5a31189407754315a3fa42478f4fcaba
I20260807 04:16:11.876442 11912 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:16:11.902534 11912 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:16:11.903944 11912 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:16:11.910723 11912 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d40db5802340420fbc4d8a695d1048e5: Generated new TSK 0
I20260807 04:16:11.911595 11912 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.200.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
I20260807 04:16:11.970186 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:0
--local_ip_for_outbound_sockets=127.7.200.193
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:37369
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:44227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:12.310639 11919 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:12.310966 11919 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:12.311151 11919 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:12.318572 11919 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:12.318682 11919 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:12.318794 11919 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:16:12.328495 11919 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:44227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:37369
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:12.329799 11919 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:12.331085 11919 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:12.344744 11924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:12.344676 11927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:12.344794 11925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:12.345732 11919 server_base.cc:1034] running on GCE node
I20260807 04:16:12.346499 11919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:12.347500 11919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:12.348703 11919 hybrid_clock.cc:648] HybridClock initialized: now 1786076172348644 us; error 50 us; skew 500 ppm
I20260807 04:16:12.349121 11919 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:12 dist-test-slave-qg60 krb5kdc[11795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076172, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:12.352483 11919 init.cc:377] Logged in from keytab as kudu/127.7.200.193@KRBTEST.COM (short username kudu)
I20260807 04:16:12.353940 11919 webserver.cc:460] Webserver started at http://127.7.200.193:46781/ using document root <none> and password file <none>
I20260807 04:16:12.354581 11919 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:12.354681 11919 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:12.354981 11919 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:12.358141 11919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-0/data/instance:
uuid: "6c41053a6fd14282b9f636b70aaccbf5"
format_stamp: "Formatted at 2026-08-07 04:16:12 on dist-test-slave-qg60"
server_key: "a2a069345719e0045396b43b263939db"
server_key_iv: "aadc4e79ac2d18aa3ecb675fc34a56d7"
server_key_version: "encryptionkey@0"
I20260807 04:16:12.358951 11919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance:
uuid: "6c41053a6fd14282b9f636b70aaccbf5"
format_stamp: "Formatted at 2026-08-07 04:16:12 on dist-test-slave-qg60"
server_key: "a2a069345719e0045396b43b263939db"
server_key_iv: "aadc4e79ac2d18aa3ecb675fc34a56d7"
server_key_version: "encryptionkey@0"
I20260807 04:16:12.364121 11919 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 04:16:12.367631 11935 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:12.369163 11919 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 04:16:12.369338 11919 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "6c41053a6fd14282b9f636b70aaccbf5"
format_stamp: "Formatted at 2026-08-07 04:16:12 on dist-test-slave-qg60"
server_key: "a2a069345719e0045396b43b263939db"
server_key_iv: "aadc4e79ac2d18aa3ecb675fc34a56d7"
server_key_version: "encryptionkey@0"
I20260807 04:16:12.369549 11919 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:12.385985 11919 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:12.390416 11919 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:12.390739 11919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:12.391747 11919 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:16:12.393323 11919 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:12.393431 11919 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:12.393589 11919 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:12.393671 11919 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:12.429435 11919 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:42769
I20260807 04:16:12.429527 12053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:42769 every 8 connection(s)
I20260807 04:16:12.430768 11919 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:16:12.435567 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 11919
I20260807 04:16:12.435811 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance
I20260807 04:16:12.436455 7971 external_mini_cluster.cc:1428] Setting key 888a431e7d33ca2e79bc9e110c1313f1
Aug 07 04:16:12 dist-test-slave-qg60 krb5kdc[11795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076172, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:16:12.454547 12056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:12.433543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:55233 (local address 127.7.200.254:37369)
0807 04:16:12.434047 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:12.434053 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:12.434986 (+ 933us) server_negotiation.cc:407] Connection header received
0807 04:16:12.436988 (+ 2002us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:12.436994 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:12.437087 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:12.437210 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:12.439550 (+ 2340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:12.440709 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:12.442523 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:12.443230 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:12.443387 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:12.447538 (+ 4151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:12.447548 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:12.447556 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:12.447606 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:12.450900 (+ 3294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:12.451976 (+ 1076us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:12.451982 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:12.451985 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:12.452119 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:12.452651 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:12.452655 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:12.452657 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:12.453017 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:12.453134 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:12.454093 (+ 959us) server_negotiation.cc:299] Negotiation successful
0807 04:16:12.454272 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":230,"threads_started":1}
I20260807 04:16:12.456344 12057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:12.434043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:37369 (local address 127.7.200.193:55233)
0807 04:16:12.434806 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:12.434852 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:12.436660 (+ 1808us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:12.437588 (+ 928us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:12.437597 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:12.438463 (+ 866us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:12.439294 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:12.439316 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:12.440939 (+ 1623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:12.440944 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:12.442346 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:12.442361 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:12.443492 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:12.443498 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:12.443729 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:12.444579 (+ 850us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:12.444602 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:12.447283 (+ 2681us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:12.451082 (+ 3799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:12.451095 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:12.451117 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:12.451846 (+ 729us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:12.452243 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:12.452251 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:12.452257 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:12.452524 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:12.453147 (+ 623us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:12.453159 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:12.453668 (+ 509us) client_negotiation.cc:769] Sending connection context
0807 04:16:12.454041 (+ 373us) client_negotiation.cc:240] Negotiation successful
0807 04:16:12.454676 (+ 635us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":322,"threads_started":1}
I20260807 04:16:12.458189 12054 heartbeater.cc:347] Connected to a master server at 127.7.200.254:37369
I20260807 04:16:12.458544 12054 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:12.459455 12054 heartbeater.cc:511] Master 127.7.200.254:37369 requested a full tablet report, sending...
I20260807 04:16:12.461867 11849 ts_manager.cc:194] Registered new tserver with Master: 6c41053a6fd14282b9f636b70aaccbf5 (127.7.200.193:42769)
WARNING: no policy specified for kudu/127.7.200.194@KRBTEST.COM; defaulting to no policy
I20260807 04:16:12.463449 11849 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.193@KRBTEST.COM'} at 127.7.200.193:55233
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
I20260807 04:16:12.498201 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:0
--local_ip_for_outbound_sockets=127.7.200.194
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:37369
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:44227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:12.849674 12060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:12.850020 12060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:12.850205 12060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:12.857805 12060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:12.857932 12060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:12.858150 12060 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:16:12.868713 12060 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:44227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:37369
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:12.870155 12060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:12.871469 12060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:12.885109 12065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:12.885190 12066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:12.885159 12068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:12.886170 12060 server_base.cc:1034] running on GCE node
I20260807 04:16:12.886891 12060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:12.887987 12060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:12.889262 12060 hybrid_clock.cc:648] HybridClock initialized: now 1786076172889194 us; error 68 us; skew 500 ppm
I20260807 04:16:12.889627 12060 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:12 dist-test-slave-qg60 krb5kdc[11795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076172, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:12.893151 12060 init.cc:377] Logged in from keytab as kudu/127.7.200.194@KRBTEST.COM (short username kudu)
I20260807 04:16:12.894747 12060 webserver.cc:460] Webserver started at http://127.7.200.194:40825/ using document root <none> and password file <none>
I20260807 04:16:12.895437 12060 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:12.895589 12060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:12.895994 12060 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:12.899231 12060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-1/data/instance:
uuid: "b2dcd92efb15486b8115df7e479c5b89"
format_stamp: "Formatted at 2026-08-07 04:16:12 on dist-test-slave-qg60"
server_key: "e25720fefe2a7563e880d304c90dd7ca"
server_key_iv: "c68b2b87bfed5cc42a83f32e3de65616"
server_key_version: "encryptionkey@0"
I20260807 04:16:12.900061 12060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance:
uuid: "b2dcd92efb15486b8115df7e479c5b89"
format_stamp: "Formatted at 2026-08-07 04:16:12 on dist-test-slave-qg60"
server_key: "e25720fefe2a7563e880d304c90dd7ca"
server_key_iv: "c68b2b87bfed5cc42a83f32e3de65616"
server_key_version: "encryptionkey@0"
I20260807 04:16:12.905619 12060 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 04:16:12.909260 12076 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:12.910753 12060 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 04:16:12.910983 12060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "b2dcd92efb15486b8115df7e479c5b89"
format_stamp: "Formatted at 2026-08-07 04:16:12 on dist-test-slave-qg60"
server_key: "e25720fefe2a7563e880d304c90dd7ca"
server_key_iv: "c68b2b87bfed5cc42a83f32e3de65616"
server_key_version: "encryptionkey@0"
I20260807 04:16:12.911262 12060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:12.926368 12060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:12.931133 12060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:12.931401 12060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:12.932533 12060 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:16:12.934032 12060 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:12.934113 12060 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:12.934203 12060 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:12.934257 12060 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:12.972095 12060 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:37917
I20260807 04:16:12.972131 12198 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:37917 every 8 connection(s)
I20260807 04:16:12.973616 12060 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:16:12.983093 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 12060
I20260807 04:16:12.983363 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance
I20260807 04:16:12.983974 7971 external_mini_cluster.cc:1428] Setting key c87d0ad4d4005f49c2aaf92ee327fde0
Aug 07 04:16:12 dist-test-slave-qg60 krb5kdc[11795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076172, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:16:12.997499 12201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:12.976285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:55159 (local address 127.7.200.254:37369)
0807 04:16:12.976912 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:12.976917 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:12.977770 (+ 853us) server_negotiation.cc:407] Connection header received
0807 04:16:12.979913 (+ 2143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:12.979922 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:12.980018 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:12.980159 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:12.982160 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:12.982945 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:12.985359 (+ 2414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:12.985817 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:12.985918 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:12.990247 (+ 4329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:12.990255 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:12.990263 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:12.990307 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:12.994014 (+ 3707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:12.994821 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:12.994829 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:12.994834 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:12.995010 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:12.995507 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:12.995511 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:12.995514 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:12.995810 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:12.996001 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:12.996998 (+ 997us) server_negotiation.cc:299] Negotiation successful
0807 04:16:12.997210 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":509,"thread_start_us":354,"threads_started":1}
I20260807 04:16:12.999228 12202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:12.976803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:37369 (local address 127.7.200.194:55159)
0807 04:16:12.977579 (+ 776us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:12.977624 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:12.979530 (+ 1906us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:12.980499 (+ 969us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:12.980511 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:12.981310 (+ 799us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:12.981923 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:12.981942 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:12.983173 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:12.983182 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:12.985186 (+ 2004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:12.985199 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:12.986076 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:12.986083 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:12.986427 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:12.987284 (+ 857us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:12.987310 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:12.989972 (+ 2662us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:12.994175 (+ 4203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:12.994182 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:12.994196 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:12.994677 (+ 481us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:12.995128 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:12.995132 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:12.995134 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:12.995333 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:12.995968 (+ 635us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:12.995978 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:12.996482 (+ 504us) client_negotiation.cc:769] Sending connection context
0807 04:16:12.996871 (+ 389us) client_negotiation.cc:240] Negotiation successful
0807 04:16:12.997591 (+ 720us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":292,"threads_started":1}
I20260807 04:16:13.000890 12199 heartbeater.cc:347] Connected to a master server at 127.7.200.254:37369
I20260807 04:16:13.001240 12199 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:13.001995 12199 heartbeater.cc:511] Master 127.7.200.254:37369 requested a full tablet report, sending...
I20260807 04:16:13.003525 11849 ts_manager.cc:194] Registered new tserver with Master: b2dcd92efb15486b8115df7e479c5b89 (127.7.200.194:37917)
I20260807 04:16:13.004392 11849 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.194@KRBTEST.COM'} at 127.7.200.194:55159
WARNING: no policy specified for kudu/127.7.200.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
I20260807 04:16:13.045930 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:0
--local_ip_for_outbound_sockets=127.7.200.195
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:37369
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:44227
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:13.384965 12205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:13.385303 12205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:13.385470 12205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:13.392937 12205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:13.393095 12205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:13.393265 12205 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:16:13.403312 12205 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:44227
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:37369
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:13.404709 12205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:13.406250 12205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:13.419442 12210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:13.419387 12211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:13.419452 12215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:13.420506 12205 server_base.cc:1034] running on GCE node
I20260807 04:16:13.421202 12205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:13.422166 12205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:13.423362 12205 hybrid_clock.cc:648] HybridClock initialized: now 1786076173423301 us; error 53 us; skew 500 ppm
I20260807 04:16:13.423692 12205 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:13 dist-test-slave-qg60 krb5kdc[11795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076173, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:13.426903 12205 init.cc:377] Logged in from keytab as kudu/127.7.200.195@KRBTEST.COM (short username kudu)
I20260807 04:16:13.428406 12205 webserver.cc:460] Webserver started at http://127.7.200.195:34837/ using document root <none> and password file <none>
I20260807 04:16:13.429359 12205 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:13.429517 12205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:13.429893 12205 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:13.433940 12205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-2/data/instance:
uuid: "fcca7cee9b3e47a396e5814083d32ca3"
format_stamp: "Formatted at 2026-08-07 04:16:13 on dist-test-slave-qg60"
server_key: "cbeb0e5f743af3b015022fc0a37f240b"
server_key_iv: "61733d653efbabc21a122b4e92d3be90"
server_key_version: "encryptionkey@0"
I20260807 04:16:13.434957 12205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance:
uuid: "fcca7cee9b3e47a396e5814083d32ca3"
format_stamp: "Formatted at 2026-08-07 04:16:13 on dist-test-slave-qg60"
server_key: "cbeb0e5f743af3b015022fc0a37f240b"
server_key_iv: "61733d653efbabc21a122b4e92d3be90"
server_key_version: "encryptionkey@0"
I20260807 04:16:13.440400 12205 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 04:16:13.443965 12223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:13.445462 12205 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:16:13.445643 12205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "fcca7cee9b3e47a396e5814083d32ca3"
format_stamp: "Formatted at 2026-08-07 04:16:13 on dist-test-slave-qg60"
server_key: "cbeb0e5f743af3b015022fc0a37f240b"
server_key_iv: "61733d653efbabc21a122b4e92d3be90"
server_key_version: "encryptionkey@0"
I20260807 04:16:13.445859 12205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:13.467208 12054 heartbeater.cc:503] Master 127.7.200.254:37369 was elected leader, sending a full tablet report...
I20260807 04:16:13.476141 12205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:13.480621 12205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:13.480950 12205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:13.482023 12205 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:16:13.483381 12205 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:13.483484 12205 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:13.483628 12205 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:13.483716 12205 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:13.520507 12205 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:44551
I20260807 04:16:13.520597 12351 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:44551 every 8 connection(s)
I20260807 04:16:13.521981 12205 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:16:13.531442 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 12205
I20260807 04:16:13.531710 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance
I20260807 04:16:13.532300 7971 external_mini_cluster.cc:1428] Setting key e1c124755e10d99a3f2805ea89550e21
Aug 07 04:16:13 dist-test-slave-qg60 krb5kdc[11795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076173, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:16:13.546486 12354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:13.524855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:41333 (local address 127.7.200.254:37369)
0807 04:16:13.525364 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:13.525369 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:13.526537 (+ 1168us) server_negotiation.cc:407] Connection header received
0807 04:16:13.528844 (+ 2307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:13.528851 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:13.528984 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:13.529124 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:13.530951 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:13.532333 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:13.534472 (+ 2139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:13.535094 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:13.535204 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:13.539317 (+ 4113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:13.539326 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:13.539333 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:13.539384 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:13.542566 (+ 3182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:13.543614 (+ 1048us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:13.543618 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:13.543620 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:13.543754 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:13.544432 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:13.544436 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:13.544438 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:13.544811 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:13.544950 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:13.545793 (+ 843us) server_negotiation.cc:299] Negotiation successful
0807 04:16:13.546072 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":275,"threads_started":1}
I20260807 04:16:13.547659 12355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:13.525499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:37369 (local address 127.7.200.195:41333)
0807 04:16:13.526293 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:13.526351 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:13.528477 (+ 2126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:13.529412 (+ 935us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:13.529422 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:13.530042 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:13.530719 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:13.530739 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:13.532577 (+ 1838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:13.532581 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:13.534314 (+ 1733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:13.534327 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:13.535357 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:13.535365 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:13.535686 (+ 321us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:13.536559 (+ 873us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:13.536582 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:13.539021 (+ 2439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:13.542734 (+ 3713us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:13.542742 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:13.542756 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:13.543478 (+ 722us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:13.543856 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:13.543859 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:13.543861 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:13.544089 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:13.544999 (+ 910us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:13.545008 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:13.545355 (+ 347us) client_negotiation.cc:769] Sending connection context
0807 04:16:13.545622 (+ 267us) client_negotiation.cc:240] Negotiation successful
0807 04:16:13.546151 (+ 529us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":330,"threads_started":1}
I20260807 04:16:13.549486 12352 heartbeater.cc:347] Connected to a master server at 127.7.200.254:37369
I20260807 04:16:13.549837 12352 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:13.550681 12352 heartbeater.cc:511] Master 127.7.200.254:37369 requested a full tablet report, sending...
I20260807 04:16:13.552254 11849 ts_manager.cc:194] Registered new tserver with Master: fcca7cee9b3e47a396e5814083d32ca3 (127.7.200.195:44551)
I20260807 04:16:13.553208 11849 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.195@KRBTEST.COM'} at 127.7.200.195:41333
I20260807 04:16:13.561535 7971 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 04:16:13 dist-test-slave-qg60 krb5kdc[11795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076173, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 04:16:13 dist-test-slave-qg60 krb5kdc[11795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076173, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.193@KRBTEST.COM
I20260807 04:16:13.623876 12360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:13.606853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53826 (local address 127.7.200.193:42769)
0807 04:16:13.607571 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:13.607579 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:13.607605 (+ 26us) server_negotiation.cc:407] Connection header received
0807 04:16:13.607668 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:13.607675 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:13.607887 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:13.608078 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:13.609731 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:13.610760 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:13.612010 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:13.612620 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:13.612778 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:13.617347 (+ 4569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:13.617361 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:13.617377 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:13.617419 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:13.620422 (+ 3003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:13.621273 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:13.621281 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:13.621284 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:13.621433 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:13.622005 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:13.622009 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:13.622011 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:13.622404 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:13.622650 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:13.623228 (+ 578us) server_negotiation.cc:299] Negotiation successful
0807 04:16:13.623564 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":333,"threads_started":1}
Aug 07 04:16:13 dist-test-slave-qg60 krb5kdc[11795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076173, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:16:13.644618 12354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:13.629372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52192 (local address 127.7.200.254:37369)
0807 04:16:13.629609 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:13.629616 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:13.629754 (+ 138us) server_negotiation.cc:407] Connection header received
0807 04:16:13.629966 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:13.629971 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:13.630038 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:13.630158 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:13.631424 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:13.632242 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:13.633953 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:13.634379 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:13.634535 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:13.638782 (+ 4247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:13.638787 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:13.638791 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:13.638830 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:13.641793 (+ 2963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:13.642506 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:13.642510 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:13.642513 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:13.642649 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:13.643161 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:13.643165 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:13.643168 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:13.643551 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:13.643756 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:13.644141 (+ 385us) server_negotiation.cc:299] Negotiation successful
0807 04:16:13.644355 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
W20260807 04:16:13.645466 11849 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52192
I20260807 04:16:13.646710 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 11919
I20260807 04:16:13.661338 12360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:13.647808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53834 (local address 127.7.200.193:42769)
0807 04:16:13.648005 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:13.648011 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:13.648262 (+ 251us) server_negotiation.cc:407] Connection header received
0807 04:16:13.648394 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:13.648398 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:13.648504 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:13.648593 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:13.650257 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:13.651059 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:13.652515 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:13.653031 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:13.653143 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:13.655488 (+ 2345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:13.655493 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:13.655497 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:13.655529 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:13.658595 (+ 3066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:13.659323 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:13.659327 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:13.659329 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:13.659496 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:13.659853 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:13.659856 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:13.659858 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:13.660143 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:13.660337 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:13.660847 (+ 510us) server_negotiation.cc:299] Negotiation successful
0807 04:16:13.661075 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 04:16:13.662097 12049 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:13.749390 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 11919
I20260807 04:16:13.770676 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 12060
Aug 07 04:16:13 dist-test-slave-qg60 krb5kdc[11795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076173, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.194@KRBTEST.COM
I20260807 04:16:13.788225 12365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:13.771664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38486 (local address 127.7.200.194:37917)
0807 04:16:13.772343 (+ 679us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:13.772350 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:13.772376 (+ 26us) server_negotiation.cc:407] Connection header received
0807 04:16:13.772443 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:13.772449 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:13.772681 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:13.772885 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:13.774254 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:13.775262 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:13.776634 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:13.777285 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:13.777390 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:13.782069 (+ 4679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:13.782082 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:13.782096 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:13.782130 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:13.785328 (+ 3198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:13.786044 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:13.786052 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:13.786054 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:13.786179 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:13.786616 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:13.786619 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:13.786621 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:13.786955 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:13.787231 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:13.787642 (+ 411us) server_negotiation.cc:299] Negotiation successful
0807 04:16:13.787871 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":372,"threads_started":1}
I20260807 04:16:13.789918 12194 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:13.882159 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 12060
I20260807 04:16:13.903071 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 12205
Aug 07 04:16:13 dist-test-slave-qg60 krb5kdc[11795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076173, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.195@KRBTEST.COM
I20260807 04:16:13.921308 12367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:13.904226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39720 (local address 127.7.200.195:44551)
0807 04:16:13.904955 (+ 729us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:13.904962 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:13.904992 (+ 30us) server_negotiation.cc:407] Connection header received
0807 04:16:13.905056 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:13.905062 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:13.905279 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:13.905475 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:13.906936 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:13.907993 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:13.909569 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:13.910147 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:13.910304 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:13.915283 (+ 4979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:13.915296 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:13.915312 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:13.915348 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:13.918468 (+ 3120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:13.919181 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:13.919187 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:13.919190 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:13.919311 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:13.919716 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:13.919721 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:13.919723 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:13.920090 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:13.920351 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:13.920666 (+ 315us) server_negotiation.cc:299] Negotiation successful
0807 04:16:13.921013 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":578,"thread_start_us":347,"threads_started":1}
I20260807 04:16:13.922672 12347 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:14.011279 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 12205
I20260807 04:16:14.030468 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 11811
I20260807 04:16:14.031857 11882 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:14.139596 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 11811
2026-08-07T04:16:14Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4187 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:16:14 dist-test-slave-qg60 krb5kdc[12372](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:16:14 dist-test-slave-qg60 krb5kdc[12372](info): set up 2 sockets
Aug 07 04:16:14 dist-test-slave-qg60 krb5kdc[12372](info): commencing operation
krb5kdc: starting...
W20260807 04:16:15.281847 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.096s user 0.004s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:16:15 dist-test-slave-qg60 krb5kdc[12372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076175, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:16:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:16:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
I20260807 04:16:15.521411 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:39323
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:34147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:39323
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:15.859967 12386 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:15.860292 12386 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:15.860468 12386 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:15.868052 12386 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:16:15.868170 12386 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:15.868261 12386 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:15.868372 12386 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:16:15.868443 12386 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:16:15.878798 12386 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:34147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:39323
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:39323
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:15.880143 12386 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:15.881474 12386 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:15.893395 12393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:15.893468 12395 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:15.893967 12392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:15.894600 12386 server_base.cc:1034] running on GCE node
I20260807 04:16:15.895450 12386 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:15.896886 12386 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:15.898108 12386 hybrid_clock.cc:648] HybridClock initialized: now 1786076175898064 us; error 35 us; skew 500 ppm
I20260807 04:16:15.898419 12386 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:15 dist-test-slave-qg60 krb5kdc[12372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076175, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:15.901603 12386 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:16:15.902787 12386 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:15.902976 12386 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:15.903434 12386 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:15.906603 12386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "88afd8cd49784178ba701e4f52b43572"
format_stamp: "Formatted at 2026-08-07 04:16:15 on dist-test-slave-qg60"
server_key: "89828aea00d9246d82b64a0d0bb552be"
server_key_iv: "cacd96a33ecc2db4cd44500caec98172"
server_key_version: "encryptionkey@0"
I20260807 04:16:15.907503 12386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "88afd8cd49784178ba701e4f52b43572"
format_stamp: "Formatted at 2026-08-07 04:16:15 on dist-test-slave-qg60"
server_key: "89828aea00d9246d82b64a0d0bb552be"
server_key_iv: "cacd96a33ecc2db4cd44500caec98172"
server_key_version: "encryptionkey@0"
I20260807 04:16:15.913025 12386 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260807 04:16:15.917228 12401 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:15.918622 12386 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:16:15.918828 12386 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "88afd8cd49784178ba701e4f52b43572"
format_stamp: "Formatted at 2026-08-07 04:16:15 on dist-test-slave-qg60"
server_key: "89828aea00d9246d82b64a0d0bb552be"
server_key_iv: "cacd96a33ecc2db4cd44500caec98172"
server_key_version: "encryptionkey@0"
I20260807 04:16:15.919106 12386 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:15.947432 12386 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:15.952152 12386 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:15.952453 12386 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:15.971638 12386 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:39323
I20260807 04:16:15.971665 12460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:39323 every 8 connection(s)
I20260807 04:16:15.972606 12386 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:16:15.976483 12461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:15.976861 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 12386
I20260807 04:16:15.977145 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:16:15.977792 7971 external_mini_cluster.cc:1428] Setting key a3a8a0c02af30e47a89c6027219f7894
I20260807 04:16:15.991307 12461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88afd8cd49784178ba701e4f52b43572: Bootstrap starting.
Aug 07 04:16:15 dist-test-slave-qg60 krb5kdc[12372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076175, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:16:15.994501 12461 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 88afd8cd49784178ba701e4f52b43572: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:15.995869 12461 log.cc:824] T 00000000000000000000000000000000 P 88afd8cd49784178ba701e4f52b43572: Log is configured to *not* fsync() on all Append() calls
I20260807 04:16:15.999636 12461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88afd8cd49784178ba701e4f52b43572: No bootstrap required, opened a new log
I20260807 04:16:16.004760 12464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:15.979951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40174 (local address 127.7.200.254:39323)
0807 04:16:15.980859 (+ 908us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:15.980875 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:15.980926 (+ 51us) server_negotiation.cc:407] Connection header received
0807 04:16:15.983405 (+ 2479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:15.983437 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:15.983968 (+ 531us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:15.984440 (+ 472us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:15.986038 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:15.988142 (+ 2104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:15.989651 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:15.990679 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:15.990870 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:15.995094 (+ 4224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:15.995105 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:15.995123 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:15.995171 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:15.999405 (+ 4234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:16.000298 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:16.000306 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:16.000318 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:16.000545 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:16.001128 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:16.001133 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:16.001136 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:16.001906 (+ 770us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:16.002238 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:16.002685 (+ 447us) server_negotiation.cc:299] Negotiation successful
0807 04:16:16.003209 (+ 524us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":606,"thread_start_us":376,"threads_started":1}
I20260807 04:16:16.009997 12461 raft_consensus.cc:348] T 00000000000000000000000000000000 P 88afd8cd49784178ba701e4f52b43572 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88afd8cd49784178ba701e4f52b43572" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 39323 } }
I20260807 04:16:16.010385 12461 raft_consensus.cc:374] T 00000000000000000000000000000000 P 88afd8cd49784178ba701e4f52b43572 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:16.010454 12461 raft_consensus.cc:729] T 00000000000000000000000000000000 P 88afd8cd49784178ba701e4f52b43572 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88afd8cd49784178ba701e4f52b43572, State: Initialized, Role: FOLLOWER
I20260807 04:16:16.011035 12461 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88afd8cd49784178ba701e4f52b43572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88afd8cd49784178ba701e4f52b43572" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 39323 } }
I20260807 04:16:16.011282 12461 raft_consensus.cc:388] T 00000000000000000000000000000000 P 88afd8cd49784178ba701e4f52b43572 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:16:16.011433 12461 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88afd8cd49784178ba701e4f52b43572 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:16:16.011615 12461 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88afd8cd49784178ba701e4f52b43572 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:16.014230 12461 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88afd8cd49784178ba701e4f52b43572 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88afd8cd49784178ba701e4f52b43572" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 39323 } }
I20260807 04:16:16.014784 12461 leader_election.cc:302] T 00000000000000000000000000000000 P 88afd8cd49784178ba701e4f52b43572 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 88afd8cd49784178ba701e4f52b43572; no voters:
I20260807 04:16:16.015434 12461 leader_election.cc:288] T 00000000000000000000000000000000 P 88afd8cd49784178ba701e4f52b43572 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:16:16.015702 12466 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 88afd8cd49784178ba701e4f52b43572 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:16:16.016471 12466 raft_consensus.cc:686] T 00000000000000000000000000000000 P 88afd8cd49784178ba701e4f52b43572 [term 1 LEADER]: Becoming Leader. State: Replica: 88afd8cd49784178ba701e4f52b43572, State: Running, Role: LEADER
I20260807 04:16:16.017184 12466 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88afd8cd49784178ba701e4f52b43572 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88afd8cd49784178ba701e4f52b43572" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 39323 } }
I20260807 04:16:16.017773 12461 sys_catalog.cc:564] T 00000000000000000000000000000000 P 88afd8cd49784178ba701e4f52b43572 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:16:16.020375 12467 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88afd8cd49784178ba701e4f52b43572 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "88afd8cd49784178ba701e4f52b43572" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88afd8cd49784178ba701e4f52b43572" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 39323 } } }
I20260807 04:16:16.020824 12467 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88afd8cd49784178ba701e4f52b43572 [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:16.021034 12468 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88afd8cd49784178ba701e4f52b43572 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88afd8cd49784178ba701e4f52b43572. Latest consensus state: current_term: 1 leader_uuid: "88afd8cd49784178ba701e4f52b43572" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88afd8cd49784178ba701e4f52b43572" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 39323 } } }
I20260807 04:16:16.021409 12468 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88afd8cd49784178ba701e4f52b43572 [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:16.023192 12471 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:16:16.030431 12471 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:16:16.040616 12471 catalog_manager.cc:1347] Generated new cluster ID: eaf2dbf30a3d46e0bde5561f10fda98e
I20260807 04:16:16.040781 12471 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:16:16.055085 12471 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:16:16.056519 12471 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:16:16.068666 12471 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 88afd8cd49784178ba701e4f52b43572: Generated new TSK 0
I20260807 04:16:16.069798 12471 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.200.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
I20260807 04:16:16.132901 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:0
--local_ip_for_outbound_sockets=127.7.200.193
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:39323
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:34147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:16.480015 12489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:16.480355 12489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:16.480572 12489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:16.488025 12489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:16.488131 12489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:16.488360 12489 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:16:16.498459 12489 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:34147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:39323
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:16.499859 12489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:16.501259 12489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:16.515446 12494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:16.515475 12495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:16.515641 12497 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:16.516342 12489 server_base.cc:1034] running on GCE node
I20260807 04:16:16.517421 12489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:16.518671 12489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:16.519987 12489 hybrid_clock.cc:648] HybridClock initialized: now 1786076176519931 us; error 33 us; skew 500 ppm
I20260807 04:16:16.520346 12489 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:16 dist-test-slave-qg60 krb5kdc[12372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076176, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:16.524140 12489 init.cc:377] Logged in from keytab as kudu/127.7.200.193@KRBTEST.COM (short username kudu)
I20260807 04:16:16.525534 12489 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:16.525636 12489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:16.525928 12489 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:16.529191 12489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-0/data/instance:
uuid: "37ce9fb93dac4a2998b66f5f51f09d8e"
format_stamp: "Formatted at 2026-08-07 04:16:16 on dist-test-slave-qg60"
server_key: "71a19eecd659548c0add220fe73f6cd8"
server_key_iv: "d73f19e3d8b9dd0e697046c1e5ed2d73"
server_key_version: "encryptionkey@0"
I20260807 04:16:16.530035 12489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance:
uuid: "37ce9fb93dac4a2998b66f5f51f09d8e"
format_stamp: "Formatted at 2026-08-07 04:16:16 on dist-test-slave-qg60"
server_key: "71a19eecd659548c0add220fe73f6cd8"
server_key_iv: "d73f19e3d8b9dd0e697046c1e5ed2d73"
server_key_version: "encryptionkey@0"
I20260807 04:16:16.535642 12489 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 04:16:16.539629 12503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:16.541148 12489 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:16:16.541342 12489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "37ce9fb93dac4a2998b66f5f51f09d8e"
format_stamp: "Formatted at 2026-08-07 04:16:16 on dist-test-slave-qg60"
server_key: "71a19eecd659548c0add220fe73f6cd8"
server_key_iv: "d73f19e3d8b9dd0e697046c1e5ed2d73"
server_key_version: "encryptionkey@0"
I20260807 04:16:16.541587 12489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:16.554206 12489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:16.558993 12489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:16.559302 12489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:16.560349 12489 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:16:16.561800 12489 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:16.561944 12489 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:16.562083 12489 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:16.562177 12489 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:16.596900 12489 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:44365
I20260807 04:16:16.596948 12623 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:44365 every 8 connection(s)
I20260807 04:16:16.597929 12489 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:16:16.598960 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 12489
I20260807 04:16:16.599192 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance
I20260807 04:16:16.599872 7971 external_mini_cluster.cc:1428] Setting key 5b8bb4c6fc737ea620f70825cd1546f2
Aug 07 04:16:16 dist-test-slave-qg60 krb5kdc[12372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076176, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:16:16.619544 12626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:16.600618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:42555 (local address 127.7.200.254:39323)
0807 04:16:16.601148 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:16.601154 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:16.602186 (+ 1032us) server_negotiation.cc:407] Connection header received
0807 04:16:16.604025 (+ 1839us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:16.604033 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:16.604124 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:16.604251 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:16.605812 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:16.606972 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:16.608540 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:16.609284 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:16.609430 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:16.613529 (+ 4099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:16.613535 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:16.613538 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:16.613571 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:16.616236 (+ 2665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:16.617063 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:16.617069 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:16.617073 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:16.617202 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:16.617630 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:16.617635 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:16.617638 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:16.617973 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:16.618131 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:16.618922 (+ 791us) server_negotiation.cc:299] Negotiation successful
0807 04:16:16.619155 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":262,"threads_started":1}
I20260807 04:16:16.620496 12627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:16.601180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:39323 (local address 127.7.200.193:42555)
0807 04:16:16.602015 (+ 835us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:16.602062 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:16.603756 (+ 1694us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:16.604437 (+ 681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:16.604445 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:16.605057 (+ 612us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:16.605632 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:16.605650 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:16.607146 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:16.607149 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:16.608379 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:16.608392 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:16.609518 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:16.609529 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:16.609722 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:16.610437 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:16.610463 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:16.613275 (+ 2812us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:16.616384 (+ 3109us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:16.616394 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:16.616411 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:16.616931 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:16.617317 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:16.617321 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:16.617325 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:16.617511 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:16.618105 (+ 594us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:16.618113 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:16.618535 (+ 422us) client_negotiation.cc:769] Sending connection context
0807 04:16:16.618803 (+ 268us) client_negotiation.cc:240] Negotiation successful
0807 04:16:16.619363 (+ 560us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":356,"threads_started":1}
I20260807 04:16:16.622212 12624 heartbeater.cc:347] Connected to a master server at 127.7.200.254:39323
I20260807 04:16:16.622609 12624 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:16.623472 12624 heartbeater.cc:511] Master 127.7.200.254:39323 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.7.200.194@KRBTEST.COM; defaulting to no policy
I20260807 04:16:16.626080 12422 ts_manager.cc:194] Registered new tserver with Master: 37ce9fb93dac4a2998b66f5f51f09d8e (127.7.200.193:44365)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.194@KRBTEST.COM" created.
I20260807 04:16:16.627816 12422 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.193@KRBTEST.COM'} at 127.7.200.193:42555
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
I20260807 04:16:16.657217 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:0
--local_ip_for_outbound_sockets=127.7.200.194
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:39323
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:34147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:16.998844 12630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:16.999186 12630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:16.999359 12630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:17.006976 12630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:17.007159 12630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:17.007352 12630 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:16:17.017819 12630 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:34147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:39323
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:17.019318 12630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:17.020854 12630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:17.034837 12636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:17.034893 12637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:17.034885 12639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:17.036123 12630 server_base.cc:1034] running on GCE node
I20260807 04:16:17.036978 12630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:17.038049 12630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:17.039278 12630 hybrid_clock.cc:648] HybridClock initialized: now 1786076177039212 us; error 58 us; skew 500 ppm
I20260807 04:16:17.039638 12630 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:17 dist-test-slave-qg60 krb5kdc[12372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076177, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:17.049302 12630 init.cc:377] Logged in from keytab as kudu/127.7.200.194@KRBTEST.COM (short username kudu)
I20260807 04:16:17.050901 12630 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:17.051055 12630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:17.051455 12630 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:17.054800 12630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-1/data/instance:
uuid: "87500c5d1e63472291bee18e1acdbb8b"
format_stamp: "Formatted at 2026-08-07 04:16:17 on dist-test-slave-qg60"
server_key: "54ba00c87e4f66166c0e51c56c5b5f7f"
server_key_iv: "11f59ffbffde0d27351728e352777925"
server_key_version: "encryptionkey@0"
I20260807 04:16:17.055763 12630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance:
uuid: "87500c5d1e63472291bee18e1acdbb8b"
format_stamp: "Formatted at 2026-08-07 04:16:17 on dist-test-slave-qg60"
server_key: "54ba00c87e4f66166c0e51c56c5b5f7f"
server_key_iv: "11f59ffbffde0d27351728e352777925"
server_key_version: "encryptionkey@0"
I20260807 04:16:17.061523 12630 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 04:16:17.065285 12646 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:17.066692 12630 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 04:16:17.066898 12630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "87500c5d1e63472291bee18e1acdbb8b"
format_stamp: "Formatted at 2026-08-07 04:16:17 on dist-test-slave-qg60"
server_key: "54ba00c87e4f66166c0e51c56c5b5f7f"
server_key_iv: "11f59ffbffde0d27351728e352777925"
server_key_version: "encryptionkey@0"
I20260807 04:16:17.067173 12630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:17.085337 12630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:17.089707 12630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:17.090036 12630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:17.091151 12630 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:16:17.092828 12630 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:17.092964 12630 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:17.093113 12630 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:17.093221 12630 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:17.130337 12630 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:43275
I20260807 04:16:17.130431 12769 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:43275 every 8 connection(s)
I20260807 04:16:17.131290 12630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:16:17.132557 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 12630
I20260807 04:16:17.132803 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance
I20260807 04:16:17.133387 7971 external_mini_cluster.cc:1428] Setting key 7e902ae254654c3c46247bef46717555
Aug 07 04:16:17 dist-test-slave-qg60 krb5kdc[12372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076177, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:16:17.153751 12772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:17.134175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:55671 (local address 127.7.200.254:39323)
0807 04:16:17.134670 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:17.134674 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:17.136064 (+ 1390us) server_negotiation.cc:407] Connection header received
0807 04:16:17.138022 (+ 1958us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:17.138028 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:17.138121 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:17.138241 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:17.139783 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:17.140540 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:17.142184 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:17.142617 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:17.142757 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:17.146901 (+ 4144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:17.146906 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:17.146910 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:17.146946 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:17.149999 (+ 3053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:17.151076 (+ 1077us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:17.151080 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:17.151083 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:17.151208 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:17.151775 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:17.151779 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:17.151780 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:17.152102 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:17.152216 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:17.153262 (+ 1046us) server_negotiation.cc:299] Negotiation successful
0807 04:16:17.153453 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":271,"threads_started":1}
I20260807 04:16:17.155426 12773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:17.134921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:39323 (local address 127.7.200.194:55671)
0807 04:16:17.135917 (+ 996us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:17.135957 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:17.137737 (+ 1780us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:17.138486 (+ 749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:17.138495 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:17.139039 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:17.139609 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:17.139627 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:17.140705 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:17.140710 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:17.142018 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:17.142042 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:17.142871 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:17.142878 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:17.143112 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:17.143856 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:17.143884 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:17.146622 (+ 2738us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:17.150166 (+ 3544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:17.150179 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:17.150200 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:17.150895 (+ 695us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:17.151322 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:17.151330 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:17.151337 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:17.151614 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:17.152240 (+ 626us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:17.152251 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:17.152770 (+ 519us) client_negotiation.cc:769] Sending connection context
0807 04:16:17.153112 (+ 342us) client_negotiation.cc:240] Negotiation successful
0807 04:16:17.153800 (+ 688us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":759,"thread_start_us":506,"threads_started":1}
I20260807 04:16:17.157095 12770 heartbeater.cc:347] Connected to a master server at 127.7.200.254:39323
I20260807 04:16:17.157428 12770 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:17.158141 12770 heartbeater.cc:511] Master 127.7.200.254:39323 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.7.200.195@KRBTEST.COM; defaulting to no policy
I20260807 04:16:17.159710 12422 ts_manager.cc:194] Registered new tserver with Master: 87500c5d1e63472291bee18e1acdbb8b (127.7.200.194:43275)
I20260807 04:16:17.160585 12422 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.194@KRBTEST.COM'} at 127.7.200.194:55671
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
I20260807 04:16:17.190441 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:0
--local_ip_for_outbound_sockets=127.7.200.195
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:39323
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:34147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:17.533583 12776 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:17.533932 12776 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:17.534123 12776 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:17.541587 12776 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:17.541759 12776 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:17.541949 12776 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:16:17.552258 12776 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:34147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:39323
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:17.553680 12776 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:17.555058 12776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:17.568711 12781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:17.568670 12782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:17.568966 12784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:17.570101 12776 server_base.cc:1034] running on GCE node
I20260807 04:16:17.570811 12776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:17.571946 12776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:17.573163 12776 hybrid_clock.cc:648] HybridClock initialized: now 1786076177573122 us; error 26 us; skew 500 ppm
I20260807 04:16:17.573555 12776 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:17 dist-test-slave-qg60 krb5kdc[12372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076177, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:17.577041 12776 init.cc:377] Logged in from keytab as kudu/127.7.200.195@KRBTEST.COM (short username kudu)
I20260807 04:16:17.578475 12776 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:17.578634 12776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:17.578980 12776 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:17.582129 12776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-2/data/instance:
uuid: "3ce74ebaf67541ee9191a85768c76b14"
format_stamp: "Formatted at 2026-08-07 04:16:17 on dist-test-slave-qg60"
server_key: "d57c157afa75059e6b6433ff7e39cb64"
server_key_iv: "653fbb1a906e8f31dbf7ac5409885b3c"
server_key_version: "encryptionkey@0"
I20260807 04:16:17.582989 12776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance:
uuid: "3ce74ebaf67541ee9191a85768c76b14"
format_stamp: "Formatted at 2026-08-07 04:16:17 on dist-test-slave-qg60"
server_key: "d57c157afa75059e6b6433ff7e39cb64"
server_key_iv: "653fbb1a906e8f31dbf7ac5409885b3c"
server_key_version: "encryptionkey@0"
I20260807 04:16:17.588526 12776 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 04:16:17.592249 12790 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:17.593775 12776 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:16:17.593962 12776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "3ce74ebaf67541ee9191a85768c76b14"
format_stamp: "Formatted at 2026-08-07 04:16:17 on dist-test-slave-qg60"
server_key: "d57c157afa75059e6b6433ff7e39cb64"
server_key_iv: "653fbb1a906e8f31dbf7ac5409885b3c"
server_key_version: "encryptionkey@0"
I20260807 04:16:17.594200 12776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:17.626689 12776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:17.631701 12624 heartbeater.cc:503] Master 127.7.200.254:39323 was elected leader, sending a full tablet report...
I20260807 04:16:17.631978 12776 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:17.632295 12776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:17.633507 12776 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:16:17.635417 12776 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:17.635545 12776 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:17.635673 12776 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:17.635763 12776 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:17.672242 12776 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:39067
I20260807 04:16:17.672333 12911 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:39067 every 8 connection(s)
I20260807 04:16:17.673215 12776 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:16:17.675011 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 12776
I20260807 04:16:17.675248 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance
I20260807 04:16:17.675839 7971 external_mini_cluster.cc:1428] Setting key ff563f50d05f2fb4414e19d55413e14e
Aug 07 04:16:17 dist-test-slave-qg60 krb5kdc[12372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076177, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:16:17.695672 12914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:17.676144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:53347 (local address 127.7.200.254:39323)
0807 04:16:17.676704 (+ 560us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:17.676710 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:17.678123 (+ 1413us) server_negotiation.cc:407] Connection header received
0807 04:16:17.680404 (+ 2281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:17.680410 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:17.680520 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:17.680640 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:17.682290 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:17.683115 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:17.684721 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:17.685194 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:17.685331 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:17.689099 (+ 3768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:17.689104 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:17.689108 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:17.689150 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:17.692576 (+ 3426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:17.693399 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:17.693403 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:17.693405 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:17.693563 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:17.694013 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:17.694017 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:17.694020 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:17.694313 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:17.694434 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:17.695206 (+ 772us) server_negotiation.cc:299] Negotiation successful
0807 04:16:17.695399 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416,"thread_start_us":306,"threads_started":1}
I20260807 04:16:17.696583 12915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:17.676910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:39323 (local address 127.7.200.195:53347)
0807 04:16:17.677877 (+ 967us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:17.677932 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:17.680084 (+ 2152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:17.680935 (+ 851us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:17.680944 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:17.681519 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:17.682110 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:17.682128 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:17.683273 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:17.683278 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:17.684549 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:17.684562 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:17.685447 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:17.685456 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:17.685721 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:17.686485 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:17.686509 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:17.688865 (+ 2356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:17.692711 (+ 3846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:17.692719 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:17.692782 (+ 63us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:17.693277 (+ 495us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:17.693667 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:17.693671 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:17.693673 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:17.693856 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:17.694434 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:17.694440 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:17.694799 (+ 359us) client_negotiation.cc:769] Sending connection context
0807 04:16:17.695046 (+ 247us) client_negotiation.cc:240] Negotiation successful
0807 04:16:17.695446 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"thread_start_us":373,"threads_started":1}
I20260807 04:16:17.698093 12912 heartbeater.cc:347] Connected to a master server at 127.7.200.254:39323
I20260807 04:16:17.698364 12912 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:17.699272 12912 heartbeater.cc:511] Master 127.7.200.254:39323 requested a full tablet report, sending...
I20260807 04:16:17.700996 12422 ts_manager.cc:194] Registered new tserver with Master: 3ce74ebaf67541ee9191a85768c76b14 (127.7.200.195:39067)
I20260807 04:16:17.701895 12422 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.195@KRBTEST.COM'} at 127.7.200.195:53347
I20260807 04:16:17.704914 7971 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 04:16:17.723317 12914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:17.709849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40178 (local address 127.7.200.254:39323)
0807 04:16:17.710025 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:17.710029 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:17.710565 (+ 536us) server_negotiation.cc:407] Connection header received
0807 04:16:17.710704 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:17.710708 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:17.710811 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:17.710899 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:17.712516 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:17.713405 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:17.714750 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:17.715168 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:17.715274 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:17.717662 (+ 2388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:17.717667 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:17.717671 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:17.717708 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:17.720508 (+ 2800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:17.721230 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:17.721234 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:17.721236 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:17.721355 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:17.721678 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:17.721681 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:17.721683 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:17.722062 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:17.722288 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:17.722592 (+ 304us) server_negotiation.cc:299] Negotiation successful
0807 04:16:17.722999 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 04:16:17.728188 12422 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40178:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:16:17.735560 12422 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:16:17.768433 12925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:17.750299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:39067 (local address 127.0.0.1:40726)
0807 04:16:17.751746 (+ 1447us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:17.751792 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:17.752027 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:17.758449 (+ 6422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:17.758457 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:17.758489 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:16:17.758860 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:17.758870 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:17.761244 (+ 2374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:17.761252 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:17.764150 (+ 2898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:17.764167 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:17.767178 (+ 3011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:17.767188 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:17.767457 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:17.767539 (+ 82us) client_negotiation.cc:769] Sending connection context
0807 04:16:17.767702 (+ 163us) client_negotiation.cc:240] Negotiation successful
0807 04:16:17.767942 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1172,"mutex_wait_us":1,"thread_start_us":946,"threads_started":1}
I20260807 04:16:17.769307 12928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:17.751492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40726 (local address 127.7.200.195:39067)
0807 04:16:17.757886 (+ 6394us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:17.757892 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:17.757920 (+ 28us) server_negotiation.cc:407] Connection header received
0807 04:16:17.758007 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:17.758014 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:17.758211 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:17.758441 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:16:17.759288 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:17.761017 (+ 1729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:17.764366 (+ 3349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:17.766571 (+ 2205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:17.766717 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:17.767017 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:17.768714 (+ 1697us) server_negotiation.cc:299] Negotiation successful
0807 04:16:17.768943 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6237,"thread_start_us":6066,"threads_started":1}
I20260807 04:16:17.773994 12842 tablet_service.cc:1467] Processing CreateTablet for tablet 59e9877b97534bbdbf40fb69ec22e65d (DEFAULT_TABLE table=test-table [id=594518dbd3984d55979b3adfc32d7eec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:16:17.776176 12929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:17.751693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55516 (local address 127.7.200.194:43275)
0807 04:16:17.757342 (+ 5649us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:17.757355 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:17.765158 (+ 7803us) server_negotiation.cc:407] Connection header received
0807 04:16:17.766540 (+ 1382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:17.766554 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:17.766936 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:17.767195 (+ 259us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:16:17.768300 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:17.769965 (+ 1665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:17.773066 (+ 3101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:17.774629 (+ 1563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:17.774741 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:17.774949 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:17.775605 (+ 656us) server_negotiation.cc:299] Negotiation successful
0807 04:16:17.775794 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5423,"thread_start_us":5254,"threads_started":1}
I20260807 04:16:17.776419 12842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59e9877b97534bbdbf40fb69ec22e65d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:17.777041 12930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:17.750595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:43275 (local address 127.0.0.1:55516)
0807 04:16:17.764997 (+ 14402us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:17.765023 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:17.766310 (+ 1287us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:17.767510 (+ 1200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:17.767520 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:17.767555 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:16:17.768098 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:17.768114 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:17.770531 (+ 2417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:17.770536 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:17.772860 (+ 2324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:17.772876 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:17.775161 (+ 2285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:17.775167 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:17.775349 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:17.775391 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 04:16:17.776404 (+ 1013us) client_negotiation.cc:240] Negotiation successful
0807 04:16:17.776558 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14266,"mutex_wait_us":1,"thread_start_us":18316,"threads_started":1}
I20260807 04:16:17.777088 12927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:17.758148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:44365 (local address 127.0.0.1:59646)
0807 04:16:17.767787 (+ 9639us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:17.767805 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:17.767939 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:17.769145 (+ 1206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:17.769149 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:17.769175 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:16:17.769497 (+ 322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:17.769508 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:17.771742 (+ 2234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:17.771748 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:17.773934 (+ 2186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:17.773950 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:17.776119 (+ 2169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:17.776125 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:17.776463 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:17.776496 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 04:16:17.776571 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 04:16:17.776698 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9481,"mutex_wait_us":5,"thread_start_us":6570,"threads_started":1}
I20260807 04:16:17.781445 12931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:17.758805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59646 (local address 127.7.200.193:44365)
0807 04:16:17.765687 (+ 6882us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:17.765694 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:17.768094 (+ 2400us) server_negotiation.cc:407] Connection header received
0807 04:16:17.768230 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:17.768240 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:17.768492 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:17.768696 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:16:17.769695 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:17.771522 (+ 1827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:17.774132 (+ 2610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:17.775646 (+ 1514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:17.775773 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:17.775982 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:17.780910 (+ 4928us) server_negotiation.cc:299] Negotiation successful
0807 04:16:17.781130 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6716,"thread_start_us":6539,"threads_started":1}
I20260807 04:16:17.781010 12698 tablet_service.cc:1467] Processing CreateTablet for tablet 59e9877b97534bbdbf40fb69ec22e65d (DEFAULT_TABLE table=test-table [id=594518dbd3984d55979b3adfc32d7eec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:16:17.782624 12698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59e9877b97534bbdbf40fb69ec22e65d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:17.785583 12554 tablet_service.cc:1467] Processing CreateTablet for tablet 59e9877b97534bbdbf40fb69ec22e65d (DEFAULT_TABLE table=test-table [id=594518dbd3984d55979b3adfc32d7eec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:16:17.787070 12554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59e9877b97534bbdbf40fb69ec22e65d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:17.791126 12932 tablet_bootstrap.cc:492] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14: Bootstrap starting.
I20260807 04:16:17.794497 12932 tablet_bootstrap.cc:654] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:17.795585 12932 log.cc:824] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14: Log is configured to *not* fsync() on all Append() calls
I20260807 04:16:17.798188 12934 tablet_bootstrap.cc:492] T 59e9877b97534bbdbf40fb69ec22e65d P 87500c5d1e63472291bee18e1acdbb8b: Bootstrap starting.
I20260807 04:16:17.800491 12932 tablet_bootstrap.cc:492] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14: No bootstrap required, opened a new log
I20260807 04:16:17.800865 12932 ts_tablet_manager.cc:1397] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260807 04:16:17.801967 12935 tablet_bootstrap.cc:492] T 59e9877b97534bbdbf40fb69ec22e65d P 37ce9fb93dac4a2998b66f5f51f09d8e: Bootstrap starting.
I20260807 04:16:17.802376 12934 tablet_bootstrap.cc:654] T 59e9877b97534bbdbf40fb69ec22e65d P 87500c5d1e63472291bee18e1acdbb8b: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:17.803821 12934 log.cc:824] T 59e9877b97534bbdbf40fb69ec22e65d P 87500c5d1e63472291bee18e1acdbb8b: Log is configured to *not* fsync() on all Append() calls
I20260807 04:16:17.805387 12935 tablet_bootstrap.cc:654] T 59e9877b97534bbdbf40fb69ec22e65d P 37ce9fb93dac4a2998b66f5f51f09d8e: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:17.806578 12935 log.cc:824] T 59e9877b97534bbdbf40fb69ec22e65d P 37ce9fb93dac4a2998b66f5f51f09d8e: Log is configured to *not* fsync() on all Append() calls
I20260807 04:16:17.807283 12934 tablet_bootstrap.cc:492] T 59e9877b97534bbdbf40fb69ec22e65d P 87500c5d1e63472291bee18e1acdbb8b: No bootstrap required, opened a new log
I20260807 04:16:17.807636 12934 ts_tablet_manager.cc:1397] T 59e9877b97534bbdbf40fb69ec22e65d P 87500c5d1e63472291bee18e1acdbb8b: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.008s
I20260807 04:16:17.811901 12932 raft_consensus.cc:348] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ce74ebaf67541ee9191a85768c76b14" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39067 } } peers { permanent_uuid: "87500c5d1e63472291bee18e1acdbb8b" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 43275 } } peers { permanent_uuid: "37ce9fb93dac4a2998b66f5f51f09d8e" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 44365 } }
I20260807 04:16:17.812388 12932 raft_consensus.cc:374] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:17.812534 12932 raft_consensus.cc:729] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ce74ebaf67541ee9191a85768c76b14, State: Initialized, Role: FOLLOWER
I20260807 04:16:17.813297 12932 consensus_queue.cc:260] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ce74ebaf67541ee9191a85768c76b14" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39067 } } peers { permanent_uuid: "87500c5d1e63472291bee18e1acdbb8b" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 43275 } } peers { permanent_uuid: "37ce9fb93dac4a2998b66f5f51f09d8e" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 44365 } }
I20260807 04:16:17.814550 12912 heartbeater.cc:503] Master 127.7.200.254:39323 was elected leader, sending a full tablet report...
I20260807 04:16:17.815200 12932 ts_tablet_manager.cc:1428] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14: Time spent starting tablet: real 0.014s user 0.009s sys 0.004s
I20260807 04:16:17.815984 12935 tablet_bootstrap.cc:492] T 59e9877b97534bbdbf40fb69ec22e65d P 37ce9fb93dac4a2998b66f5f51f09d8e: No bootstrap required, opened a new log
I20260807 04:16:17.816321 12935 ts_tablet_manager.cc:1397] T 59e9877b97534bbdbf40fb69ec22e65d P 37ce9fb93dac4a2998b66f5f51f09d8e: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.009s
I20260807 04:16:17.818320 12934 raft_consensus.cc:348] T 59e9877b97534bbdbf40fb69ec22e65d P 87500c5d1e63472291bee18e1acdbb8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ce74ebaf67541ee9191a85768c76b14" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39067 } } peers { permanent_uuid: "87500c5d1e63472291bee18e1acdbb8b" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 43275 } } peers { permanent_uuid: "37ce9fb93dac4a2998b66f5f51f09d8e" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 44365 } }
I20260807 04:16:17.818800 12934 raft_consensus.cc:374] T 59e9877b97534bbdbf40fb69ec22e65d P 87500c5d1e63472291bee18e1acdbb8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:17.818953 12934 raft_consensus.cc:729] T 59e9877b97534bbdbf40fb69ec22e65d P 87500c5d1e63472291bee18e1acdbb8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87500c5d1e63472291bee18e1acdbb8b, State: Initialized, Role: FOLLOWER
I20260807 04:16:17.819684 12934 consensus_queue.cc:260] T 59e9877b97534bbdbf40fb69ec22e65d P 87500c5d1e63472291bee18e1acdbb8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ce74ebaf67541ee9191a85768c76b14" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39067 } } peers { permanent_uuid: "87500c5d1e63472291bee18e1acdbb8b" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 43275 } } peers { permanent_uuid: "37ce9fb93dac4a2998b66f5f51f09d8e" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 44365 } }
I20260807 04:16:17.820978 12770 heartbeater.cc:503] Master 127.7.200.254:39323 was elected leader, sending a full tablet report...
I20260807 04:16:17.821619 12934 ts_tablet_manager.cc:1428] T 59e9877b97534bbdbf40fb69ec22e65d P 87500c5d1e63472291bee18e1acdbb8b: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260807 04:16:17.825870 12935 raft_consensus.cc:348] T 59e9877b97534bbdbf40fb69ec22e65d P 37ce9fb93dac4a2998b66f5f51f09d8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ce74ebaf67541ee9191a85768c76b14" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39067 } } peers { permanent_uuid: "87500c5d1e63472291bee18e1acdbb8b" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 43275 } } peers { permanent_uuid: "37ce9fb93dac4a2998b66f5f51f09d8e" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 44365 } }
I20260807 04:16:17.826217 12935 raft_consensus.cc:374] T 59e9877b97534bbdbf40fb69ec22e65d P 37ce9fb93dac4a2998b66f5f51f09d8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:17.826293 12935 raft_consensus.cc:729] T 59e9877b97534bbdbf40fb69ec22e65d P 37ce9fb93dac4a2998b66f5f51f09d8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37ce9fb93dac4a2998b66f5f51f09d8e, State: Initialized, Role: FOLLOWER
I20260807 04:16:17.826850 12935 consensus_queue.cc:260] T 59e9877b97534bbdbf40fb69ec22e65d P 37ce9fb93dac4a2998b66f5f51f09d8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ce74ebaf67541ee9191a85768c76b14" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39067 } } peers { permanent_uuid: "87500c5d1e63472291bee18e1acdbb8b" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 43275 } } peers { permanent_uuid: "37ce9fb93dac4a2998b66f5f51f09d8e" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 44365 } }
I20260807 04:16:17.828624 12935 ts_tablet_manager.cc:1428] T 59e9877b97534bbdbf40fb69ec22e65d P 37ce9fb93dac4a2998b66f5f51f09d8e: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
W20260807 04:16:17.850296 12625 tablet.cc:2369] T 59e9877b97534bbdbf40fb69ec22e65d P 37ce9fb93dac4a2998b66f5f51f09d8e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 04:16:17.883510 12771 tablet.cc:2369] T 59e9877b97534bbdbf40fb69ec22e65d P 87500c5d1e63472291bee18e1acdbb8b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 04:16:17.924865 12913 tablet.cc:2369] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:16:18.019001 12938 raft_consensus.cc:482] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:16:18.019354 12938 raft_consensus.cc:504] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ce74ebaf67541ee9191a85768c76b14" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39067 } } peers { permanent_uuid: "87500c5d1e63472291bee18e1acdbb8b" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 43275 } } peers { permanent_uuid: "37ce9fb93dac4a2998b66f5f51f09d8e" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 44365 } }
I20260807 04:16:18.021129 12938 leader_election.cc:288] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87500c5d1e63472291bee18e1acdbb8b (127.7.200.194:43275), 37ce9fb93dac4a2998b66f5f51f09d8e (127.7.200.193:44365)
I20260807 04:16:18.028553 12929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:18.021650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:54753 (local address 127.7.200.194:43275)
0807 04:16:18.021880 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:18.021886 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:18.021913 (+ 27us) server_negotiation.cc:407] Connection header received
0807 04:16:18.022010 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:18.022017 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:18.022126 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:18.022253 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:16:18.022773 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:18.023846 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:18.026178 (+ 2332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:18.027594 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:18.027749 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:18.027809 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:18.028214 (+ 405us) server_negotiation.cc:299] Negotiation successful
0807 04:16:18.028324 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 04:16:18.028653 12915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:18.021455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:43275 (local address 127.7.200.195:54753)
0807 04:16:18.021668 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:18.021689 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:18.021835 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:18.022283 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:18.022288 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:18.022322 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:16:18.022583 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:18.022594 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:18.024091 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:18.024098 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:18.025985 (+ 1887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:18.026000 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:18.027761 (+ 1761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:18.027768 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:18.028008 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:18.028050 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 04:16:18.028160 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 04:16:18.028319 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260807 04:16:18.030061 12931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:18.021921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:60911 (local address 127.7.200.193:44365)
0807 04:16:18.022204 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:18.022211 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:18.022497 (+ 286us) server_negotiation.cc:407] Connection header received
0807 04:16:18.022701 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:18.022709 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:18.022793 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:18.022864 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:16:18.023693 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:18.024990 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:18.027553 (+ 2563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:18.028945 (+ 1392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:18.029128 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:18.029200 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:18.029779 (+ 579us) server_negotiation.cc:299] Negotiation successful
0807 04:16:18.029882 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 04:16:18.029872 12720 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59e9877b97534bbdbf40fb69ec22e65d" candidate_uuid: "3ce74ebaf67541ee9191a85768c76b14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87500c5d1e63472291bee18e1acdbb8b" is_pre_election: true
I20260807 04:16:18.030340 12943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:18.021466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:44365 (local address 127.7.200.195:60911)
0807 04:16:18.022389 (+ 923us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:18.022414 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:18.022559 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:18.022917 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:18.022945 (+ 28us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:18.022970 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:16:18.023344 (+ 374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:18.023355 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:18.025210 (+ 1855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:18.025215 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:18.027344 (+ 2129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:18.027363 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:18.029374 (+ 2011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:18.029383 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:18.029597 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:18.029632 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 04:16:18.029748 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 04:16:18.029903 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":790,"mutex_wait_us":134,"thread_start_us":605,"threads_started":1}
I20260807 04:16:18.030619 12720 raft_consensus.cc:2454] T 59e9877b97534bbdbf40fb69ec22e65d P 87500c5d1e63472291bee18e1acdbb8b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ce74ebaf67541ee9191a85768c76b14 in term 0.
I20260807 04:16:18.031459 12794 leader_election.cc:302] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ce74ebaf67541ee9191a85768c76b14, 87500c5d1e63472291bee18e1acdbb8b; no voters:
I20260807 04:16:18.031558 12576 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59e9877b97534bbdbf40fb69ec22e65d" candidate_uuid: "3ce74ebaf67541ee9191a85768c76b14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37ce9fb93dac4a2998b66f5f51f09d8e" is_pre_election: true
I20260807 04:16:18.031896 12938 raft_consensus.cc:2781] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:16:18.032066 12938 raft_consensus.cc:482] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:16:18.032212 12938 raft_consensus.cc:3037] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:18.032179 12576 raft_consensus.cc:2454] T 59e9877b97534bbdbf40fb69ec22e65d P 37ce9fb93dac4a2998b66f5f51f09d8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ce74ebaf67541ee9191a85768c76b14 in term 0.
I20260807 04:16:18.034747 12938 raft_consensus.cc:504] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ce74ebaf67541ee9191a85768c76b14" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39067 } } peers { permanent_uuid: "87500c5d1e63472291bee18e1acdbb8b" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 43275 } } peers { permanent_uuid: "37ce9fb93dac4a2998b66f5f51f09d8e" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 44365 } }
I20260807 04:16:18.035506 12938 leader_election.cc:288] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14 [CANDIDATE]: Term 1 election: Requested vote from peers 87500c5d1e63472291bee18e1acdbb8b (127.7.200.194:43275), 37ce9fb93dac4a2998b66f5f51f09d8e (127.7.200.193:44365)
I20260807 04:16:18.036048 12720 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59e9877b97534bbdbf40fb69ec22e65d" candidate_uuid: "3ce74ebaf67541ee9191a85768c76b14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87500c5d1e63472291bee18e1acdbb8b"
I20260807 04:16:18.036059 12576 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59e9877b97534bbdbf40fb69ec22e65d" candidate_uuid: "3ce74ebaf67541ee9191a85768c76b14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37ce9fb93dac4a2998b66f5f51f09d8e"
I20260807 04:16:18.036298 12576 raft_consensus.cc:3037] T 59e9877b97534bbdbf40fb69ec22e65d P 37ce9fb93dac4a2998b66f5f51f09d8e [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:18.036299 12720 raft_consensus.cc:3037] T 59e9877b97534bbdbf40fb69ec22e65d P 87500c5d1e63472291bee18e1acdbb8b [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:18.040136 12720 raft_consensus.cc:2454] T 59e9877b97534bbdbf40fb69ec22e65d P 87500c5d1e63472291bee18e1acdbb8b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ce74ebaf67541ee9191a85768c76b14 in term 1.
I20260807 04:16:18.040135 12576 raft_consensus.cc:2454] T 59e9877b97534bbdbf40fb69ec22e65d P 37ce9fb93dac4a2998b66f5f51f09d8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ce74ebaf67541ee9191a85768c76b14 in term 1.
I20260807 04:16:18.040619 12793 leader_election.cc:302] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37ce9fb93dac4a2998b66f5f51f09d8e, 3ce74ebaf67541ee9191a85768c76b14; no voters:
I20260807 04:16:18.041028 12938 raft_consensus.cc:2781] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:16:18.041559 12938 raft_consensus.cc:686] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14 [term 1 LEADER]: Becoming Leader. State: Replica: 3ce74ebaf67541ee9191a85768c76b14, State: Running, Role: LEADER
I20260807 04:16:18.042104 12938 consensus_queue.cc:237] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ce74ebaf67541ee9191a85768c76b14" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39067 } } peers { permanent_uuid: "87500c5d1e63472291bee18e1acdbb8b" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 43275 } } peers { permanent_uuid: "37ce9fb93dac4a2998b66f5f51f09d8e" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 44365 } }
I20260807 04:16:18.047385 12420 catalog_manager.cc:5495] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ce74ebaf67541ee9191a85768c76b14 (127.7.200.195). New cstate: current_term: 1 leader_uuid: "3ce74ebaf67541ee9191a85768c76b14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ce74ebaf67541ee9191a85768c76b14" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87500c5d1e63472291bee18e1acdbb8b" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 43275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37ce9fb93dac4a2998b66f5f51f09d8e" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 44365 } health_report { overall_health: UNKNOWN } } }
I20260807 04:16:18.068194 12928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:18.062764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40734 (local address 127.7.200.195:39067)
0807 04:16:18.063002 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:18.063010 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:18.063124 (+ 114us) server_negotiation.cc:407] Connection header received
0807 04:16:18.063336 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:18.063341 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:18.063423 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:18.063552 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:16:18.063890 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:18.064664 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:18.066022 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:18.066416 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:18.066511 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:18.067025 (+ 514us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:16:18.067575 (+ 550us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:16:18.067691 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:18.067816 (+ 125us) server_negotiation.cc:299] Negotiation successful
0807 04:16:18.067889 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 04:16:18.076881 12576 raft_consensus.cc:1261] T 59e9877b97534bbdbf40fb69ec22e65d P 37ce9fb93dac4a2998b66f5f51f09d8e [term 1 FOLLOWER]: Refusing update from remote peer 3ce74ebaf67541ee9191a85768c76b14: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:16:18.076896 12720 raft_consensus.cc:1261] T 59e9877b97534bbdbf40fb69ec22e65d P 87500c5d1e63472291bee18e1acdbb8b [term 1 FOLLOWER]: Refusing update from remote peer 3ce74ebaf67541ee9191a85768c76b14: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:16:18.077970 12944 consensus_queue.cc:1035] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37ce9fb93dac4a2998b66f5f51f09d8e" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 44365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:16:18.078382 12938 consensus_queue.cc:1035] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87500c5d1e63472291bee18e1acdbb8b" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 43275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:16:18.089756 12948 mvcc.cc:205] Tried to move back new op lower bound from 7315768025391476736 to 7315768025264721920. Current Snapshot: MvccSnapshot[applied={T|T < 7315768025391476736}]
I20260807 04:16:18.113567 12422 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40178:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:16:18.113978 12422 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40178:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:16:18.119087 12422 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 88afd8cd49784178ba701e4f52b43572: Sending DeleteTablet for 3 replicas of tablet 59e9877b97534bbdbf40fb69ec22e65d
I20260807 04:16:18.120299 12842 tablet_service.cc:1514] Processing DeleteTablet for tablet 59e9877b97534bbdbf40fb69ec22e65d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:16:18 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:40726
I20260807 04:16:18.120679 12554 tablet_service.cc:1514] Processing DeleteTablet for tablet 59e9877b97534bbdbf40fb69ec22e65d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:16:18 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:59646
I20260807 04:16:18.120968 12698 tablet_service.cc:1514] Processing DeleteTablet for tablet 59e9877b97534bbdbf40fb69ec22e65d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:16:18 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:55516
I20260807 04:16:18.121603 12958 tablet_replica.cc:330] T 59e9877b97534bbdbf40fb69ec22e65d P 37ce9fb93dac4a2998b66f5f51f09d8e: stopping tablet replica
I20260807 04:16:18.122051 12958 raft_consensus.cc:2229] T 59e9877b97534bbdbf40fb69ec22e65d P 37ce9fb93dac4a2998b66f5f51f09d8e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:16:18.122318 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 12489
I20260807 04:16:18.122663 12958 raft_consensus.cc:2258] T 59e9877b97534bbdbf40fb69ec22e65d P 37ce9fb93dac4a2998b66f5f51f09d8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:16:18.125097 12958 ts_tablet_manager.cc:1905] T 59e9877b97534bbdbf40fb69ec22e65d P 37ce9fb93dac4a2998b66f5f51f09d8e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:16:18.132385 12959 tablet_replica.cc:330] T 59e9877b97534bbdbf40fb69ec22e65d P 87500c5d1e63472291bee18e1acdbb8b: stopping tablet replica
I20260807 04:16:18.133107 12959 raft_consensus.cc:2229] T 59e9877b97534bbdbf40fb69ec22e65d P 87500c5d1e63472291bee18e1acdbb8b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:16:18.133808 12959 raft_consensus.cc:2258] T 59e9877b97534bbdbf40fb69ec22e65d P 87500c5d1e63472291bee18e1acdbb8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:16:18.134689 12958 ts_tablet_manager.cc:1918] T 59e9877b97534bbdbf40fb69ec22e65d P 37ce9fb93dac4a2998b66f5f51f09d8e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:16:18.134905 12958 log.cc:1196] T 59e9877b97534bbdbf40fb69ec22e65d P 37ce9fb93dac4a2998b66f5f51f09d8e: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-0/wal/wals/59e9877b97534bbdbf40fb69ec22e65d
I20260807 04:16:18.135582 12958 ts_tablet_manager.cc:1939] T 59e9877b97534bbdbf40fb69ec22e65d P 37ce9fb93dac4a2998b66f5f51f09d8e: Deleting consensus metadata
I20260807 04:16:18.136580 12959 ts_tablet_manager.cc:1905] T 59e9877b97534bbdbf40fb69ec22e65d P 87500c5d1e63472291bee18e1acdbb8b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:16:18.138037 12405 catalog_manager.cc:4841] TS 37ce9fb93dac4a2998b66f5f51f09d8e (127.7.200.193:44365): tablet 59e9877b97534bbdbf40fb69ec22e65d (table test-table [id=594518dbd3984d55979b3adfc32d7eec]) successfully deleted
I20260807 04:16:18.145118 12959 ts_tablet_manager.cc:1918] T 59e9877b97534bbdbf40fb69ec22e65d P 87500c5d1e63472291bee18e1acdbb8b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:16:18.145468 12959 log.cc:1196] T 59e9877b97534bbdbf40fb69ec22e65d P 87500c5d1e63472291bee18e1acdbb8b: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-1/wal/wals/59e9877b97534bbdbf40fb69ec22e65d
I20260807 04:16:18.145539 12957 tablet_replica.cc:330] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14: stopping tablet replica
I20260807 04:16:18.146191 12959 ts_tablet_manager.cc:1939] T 59e9877b97534bbdbf40fb69ec22e65d P 87500c5d1e63472291bee18e1acdbb8b: Deleting consensus metadata
I20260807 04:16:18.146555 12957 raft_consensus.cc:2229] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14 [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:16:18.147259 12957 raft_consensus.cc:2258] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:16:18.148456 12406 catalog_manager.cc:4841] TS 87500c5d1e63472291bee18e1acdbb8b (127.7.200.194:43275): tablet 59e9877b97534bbdbf40fb69ec22e65d (table test-table [id=594518dbd3984d55979b3adfc32d7eec]) successfully deleted
I20260807 04:16:18.149780 12957 ts_tablet_manager.cc:1905] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 07 04:16:18 dist-test-slave-qg60 krb5kdc[12372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076175, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.193@KRBTEST.COM
I20260807 04:16:18.157016 12957 ts_tablet_manager.cc:1918] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:16:18.157233 12957 log.cc:1196] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786076137270840-7971-0/minicluster-data/ts-2/wal/wals/59e9877b97534bbdbf40fb69ec22e65d
I20260807 04:16:18.157846 12957 ts_tablet_manager.cc:1939] T 59e9877b97534bbdbf40fb69ec22e65d P 3ce74ebaf67541ee9191a85768c76b14: Deleting consensus metadata
I20260807 04:16:18.159778 12402 catalog_manager.cc:4841] TS 3ce74ebaf67541ee9191a85768c76b14 (127.7.200.195:39067): tablet 59e9877b97534bbdbf40fb69ec22e65d (table test-table [id=594518dbd3984d55979b3adfc32d7eec]) successfully deleted
I20260807 04:16:18.163537 12931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:18.124411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59648 (local address 127.7.200.193:44365)
0807 04:16:18.124593 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:18.124599 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:18.141367 (+ 16768us) server_negotiation.cc:407] Connection header received
0807 04:16:18.141698 (+ 331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:18.141723 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:18.141812 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:18.141912 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:18.144031 (+ 2119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:18.145242 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:18.147212 (+ 1970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:18.147844 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:18.147944 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:18.154131 (+ 6187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:18.154152 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:18.154171 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:18.154224 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:18.158429 (+ 4205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:18.159498 (+ 1069us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:18.159509 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:18.159513 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:18.159704 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:18.161206 (+ 1502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:18.161213 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:18.161217 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:18.161890 (+ 673us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:18.162213 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:18.162890 (+ 677us) server_negotiation.cc:299] Negotiation successful
0807 04:16:18.163140 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 04:16:18.164383 12619 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:18.274149 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 12489
I20260807 04:16:18.294909 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 12630
Aug 07 04:16:18 dist-test-slave-qg60 krb5kdc[12372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076175, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.194@KRBTEST.COM
I20260807 04:16:18.313079 12929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:18.295827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55522 (local address 127.7.200.194:43275)
0807 04:16:18.296005 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:18.296009 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:18.296035 (+ 26us) server_negotiation.cc:407] Connection header received
0807 04:16:18.296144 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:18.296148 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:18.296212 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:18.296297 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:18.298015 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:18.298881 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:18.300817 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:18.301280 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:18.301384 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:18.306420 (+ 5036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:18.306438 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:18.306458 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:18.306498 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:18.310251 (+ 3753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:18.310923 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:18.310933 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:18.310937 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:18.311093 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:18.311455 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:18.311460 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:18.311464 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:18.311945 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:18.312257 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:18.312424 (+ 167us) server_negotiation.cc:299] Negotiation successful
0807 04:16:18.312661 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 04:16:18.313912 12763 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:18.405510 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 12630
I20260807 04:16:18.432693 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 12776
Aug 07 04:16:18 dist-test-slave-qg60 krb5kdc[12372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076175, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.195@KRBTEST.COM
I20260807 04:16:18.450219 12928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:18.433747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40740 (local address 127.7.200.195:39067)
0807 04:16:18.433955 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:18.433964 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:18.433986 (+ 22us) server_negotiation.cc:407] Connection header received
0807 04:16:18.434052 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:18.434057 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:18.434155 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:18.434263 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:18.435627 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:18.436472 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:18.438021 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:18.438471 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:18.438636 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:18.443180 (+ 4544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:18.443192 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:18.443206 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:18.443242 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:18.447146 (+ 3904us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:18.447829 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:18.447846 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:18.447852 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:18.448081 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:18.448465 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:18.448469 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:18.448473 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:18.449031 (+ 558us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:18.449377 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:18.449546 (+ 169us) server_negotiation.cc:299] Negotiation successful
0807 04:16:18.449801 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 04:16:18.451068 12907 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:18.577168 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 12776
I20260807 04:16:18.599962 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 12386
I20260807 04:16:18.601325 12455 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:18.715305 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 12386
2026-08-07T04:16:18Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4576 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-07T04:16:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:16:18Z Disabled control of system clock
I20260807 04:16:18.797086 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:43945
--webserver_interface=127.7.200.254
--webserver_port=0
--builtin_ntp_servers=127.7.200.212:37791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:43945
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 04:16:19.156890 12969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:19.157204 12969 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:19.157351 12969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:19.164711 12969 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:16:19.164844 12969 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:19.164942 12969 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:19.165057 12969 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:16:19.165110 12969 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:16:19.174690 12969 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:37791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:43945
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:43945
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:19.176122 12969 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:19.178098 12969 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:19.190605 12977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:19.190541 12975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:19.191082 12974 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:19.191499 12969 server_base.cc:1034] running on GCE node
I20260807 04:16:19.192342 12969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:19.193810 12969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:19.195055 12969 hybrid_clock.cc:648] HybridClock initialized: now 1786076179195000 us; error 39 us; skew 500 ppm
I20260807 04:16:19.195407 12969 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 04:16:19.197801 12969 webserver.cc:460] Webserver started at http://127.7.200.254:42911/ using document root <none> and password file <none>
I20260807 04:16:19.198475 12969 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:19.198565 12969 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:19.198829 12969 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:19.201913 12969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "8c796525c9dd4136bb331ab01843b2bc"
format_stamp: "Formatted at 2026-08-07 04:16:19 on dist-test-slave-qg60"
server_key: "e25c401c9f5d9f74451efa0c0fc77fbc"
server_key_iv: "717c7f01d409d50b61555d2bb47b8715"
server_key_version: "encryptionkey@0"
I20260807 04:16:19.202670 12969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "8c796525c9dd4136bb331ab01843b2bc"
format_stamp: "Formatted at 2026-08-07 04:16:19 on dist-test-slave-qg60"
server_key: "e25c401c9f5d9f74451efa0c0fc77fbc"
server_key_iv: "717c7f01d409d50b61555d2bb47b8715"
server_key_version: "encryptionkey@0"
I20260807 04:16:19.207962 12969 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 04:16:19.211514 12983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:19.213075 12969 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:16:19.213269 12969 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "8c796525c9dd4136bb331ab01843b2bc"
format_stamp: "Formatted at 2026-08-07 04:16:19 on dist-test-slave-qg60"
server_key: "e25c401c9f5d9f74451efa0c0fc77fbc"
server_key_iv: "717c7f01d409d50b61555d2bb47b8715"
server_key_version: "encryptionkey@0"
I20260807 04:16:19.213513 12969 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:19.219405 12969 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:19.220170 12969 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:19.220484 12969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:19.239553 12969 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:43945
I20260807 04:16:19.239589 13038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:43945 every 8 connection(s)
I20260807 04:16:19.241072 12969 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:16:19.242334 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 12969
I20260807 04:16:19.242583 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:16:19.243485 7971 external_mini_cluster.cc:1428] Setting key c8766a36b577b55e6f34d02625ed5596
I20260807 04:16:19.246253 13039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:19.252445 13042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:19.245844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35638 (local address 127.7.200.254:43945)
0807 04:16:19.246976 (+ 1132us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:19.246989 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:19.247038 (+ 49us) server_negotiation.cc:407] Connection header received
0807 04:16:19.248650 (+ 1612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:19.248672 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:19.249177 (+ 505us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:19.249591 (+ 414us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:19.250725 (+ 1134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:19.250731 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:19.250743 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:16:19.250757 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:19.250841 (+ 84us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:16:19.250860 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:19.251119 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:19.251272 (+ 153us) server_negotiation.cc:299] Negotiation successful
0807 04:16:19.251536 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":650,"thread_start_us":420,"threads_started":1}
I20260807 04:16:19.258052 13039 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c796525c9dd4136bb331ab01843b2bc: Bootstrap starting.
I20260807 04:16:19.261291 13039 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8c796525c9dd4136bb331ab01843b2bc: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:19.262415 13039 log.cc:824] T 00000000000000000000000000000000 P 8c796525c9dd4136bb331ab01843b2bc: Log is configured to *not* fsync() on all Append() calls
I20260807 04:16:19.265213 13039 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c796525c9dd4136bb331ab01843b2bc: No bootstrap required, opened a new log
I20260807 04:16:19.273308 13039 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8c796525c9dd4136bb331ab01843b2bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c796525c9dd4136bb331ab01843b2bc" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43945 } }
I20260807 04:16:19.273692 13039 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8c796525c9dd4136bb331ab01843b2bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:19.273810 13039 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8c796525c9dd4136bb331ab01843b2bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c796525c9dd4136bb331ab01843b2bc, State: Initialized, Role: FOLLOWER
I20260807 04:16:19.274447 13039 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8c796525c9dd4136bb331ab01843b2bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c796525c9dd4136bb331ab01843b2bc" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43945 } }
I20260807 04:16:19.274696 13039 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8c796525c9dd4136bb331ab01843b2bc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:16:19.274839 13039 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8c796525c9dd4136bb331ab01843b2bc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:16:19.275031 13039 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8c796525c9dd4136bb331ab01843b2bc [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:19.277313 13039 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8c796525c9dd4136bb331ab01843b2bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c796525c9dd4136bb331ab01843b2bc" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43945 } }
I20260807 04:16:19.277835 13039 leader_election.cc:302] T 00000000000000000000000000000000 P 8c796525c9dd4136bb331ab01843b2bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8c796525c9dd4136bb331ab01843b2bc; no voters:
I20260807 04:16:19.278419 13039 leader_election.cc:288] T 00000000000000000000000000000000 P 8c796525c9dd4136bb331ab01843b2bc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:16:19.278573 13044 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8c796525c9dd4136bb331ab01843b2bc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:16:19.279811 13044 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8c796525c9dd4136bb331ab01843b2bc [term 1 LEADER]: Becoming Leader. State: Replica: 8c796525c9dd4136bb331ab01843b2bc, State: Running, Role: LEADER
I20260807 04:16:19.280328 13044 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8c796525c9dd4136bb331ab01843b2bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c796525c9dd4136bb331ab01843b2bc" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43945 } }
I20260807 04:16:19.280764 13039 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8c796525c9dd4136bb331ab01843b2bc [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:16:19.282974 13045 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c796525c9dd4136bb331ab01843b2bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8c796525c9dd4136bb331ab01843b2bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c796525c9dd4136bb331ab01843b2bc" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43945 } } }
I20260807 04:16:19.283375 13045 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c796525c9dd4136bb331ab01843b2bc [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:19.284076 13046 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c796525c9dd4136bb331ab01843b2bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8c796525c9dd4136bb331ab01843b2bc. Latest consensus state: current_term: 1 leader_uuid: "8c796525c9dd4136bb331ab01843b2bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c796525c9dd4136bb331ab01843b2bc" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43945 } } }
I20260807 04:16:19.284428 13046 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c796525c9dd4136bb331ab01843b2bc [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:19.290812 13053 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:16:19.296298 13053 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:16:19.305398 13053 catalog_manager.cc:1347] Generated new cluster ID: 65864eac46bc456c9bc642d7352e6e11
I20260807 04:16:19.305562 13053 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:16:19.317385 13053 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:16:19.317888 13053 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:16:19.324446 13053 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8c796525c9dd4136bb331ab01843b2bc: Generated new TSK 0
I20260807 04:16:19.325505 13053 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:16:19.340111 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:0
--local_ip_for_outbound_sockets=127.7.200.193
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:43945
--builtin_ntp_servers=127.7.200.212:37791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 04:16:19.685091 13067 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:19.685407 13067 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:19.685575 13067 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:19.693023 13067 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:19.693166 13067 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:19.693346 13067 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:16:19.702589 13067 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:37791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:43945
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:19.704128 13067 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:19.706075 13067 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:19.720151 13073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:19.720270 13072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:19.720258 13075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:19.721432 13067 server_base.cc:1034] running on GCE node
I20260807 04:16:19.722074 13067 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:19.723043 13067 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:19.724254 13067 hybrid_clock.cc:648] HybridClock initialized: now 1786076179724202 us; error 44 us; skew 500 ppm
I20260807 04:16:19.724630 13067 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 04:16:19.726936 13067 webserver.cc:460] Webserver started at http://127.7.200.193:34077/ using document root <none> and password file <none>
I20260807 04:16:19.727818 13067 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:19.727936 13067 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:19.728276 13067 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:19.731402 13067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-0/data/instance:
uuid: "87c8c04e0686438fa014092106617bc5"
format_stamp: "Formatted at 2026-08-07 04:16:19 on dist-test-slave-qg60"
server_key: "a88df8e58605bfdf8ebbb330a33d535c"
server_key_iv: "910b9498fbd290860a97a24f0d5e9d1b"
server_key_version: "encryptionkey@0"
I20260807 04:16:19.732198 13067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance:
uuid: "87c8c04e0686438fa014092106617bc5"
format_stamp: "Formatted at 2026-08-07 04:16:19 on dist-test-slave-qg60"
server_key: "a88df8e58605bfdf8ebbb330a33d535c"
server_key_iv: "910b9498fbd290860a97a24f0d5e9d1b"
server_key_version: "encryptionkey@0"
I20260807 04:16:19.737406 13067 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.007s
I20260807 04:16:19.741261 13082 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:19.742835 13067 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:16:19.743108 13067 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "87c8c04e0686438fa014092106617bc5"
format_stamp: "Formatted at 2026-08-07 04:16:19 on dist-test-slave-qg60"
server_key: "a88df8e58605bfdf8ebbb330a33d535c"
server_key_iv: "910b9498fbd290860a97a24f0d5e9d1b"
server_key_version: "encryptionkey@0"
I20260807 04:16:19.743362 13067 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:19.749286 13067 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:19.750101 13067 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:19.750379 13067 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:19.751314 13067 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:16:19.752722 13067 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:19.752898 13067 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:19.753038 13067 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:19.753136 13067 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:19.789166 13067 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:32873
I20260807 04:16:19.789256 13208 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:32873 every 8 connection(s)
I20260807 04:16:19.790513 13067 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:16:19.795363 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 13067
I20260807 04:16:19.795588 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance
I20260807 04:16:19.796255 7971 external_mini_cluster.cc:1428] Setting key 82a7d2cfac2f95f5a491991a89177976
I20260807 04:16:19.799316 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:0
--local_ip_for_outbound_sockets=127.7.200.194
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:43945
--builtin_ntp_servers=127.7.200.212:37791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260807 04:16:19.799842 13211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:19.793170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:42285 (local address 127.7.200.254:43945)
0807 04:16:19.793640 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:19.793647 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:19.795202 (+ 1555us) server_negotiation.cc:407] Connection header received
0807 04:16:19.797187 (+ 1985us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:19.797192 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:19.797268 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:19.797406 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:19.798809 (+ 1403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:19.798814 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:19.798819 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:16:19.798837 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:19.798890 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:16:19.798905 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:19.799051 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:19.799411 (+ 360us) server_negotiation.cc:299] Negotiation successful
0807 04:16:19.799483 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":220,"threads_started":1}
I20260807 04:16:19.800776 13212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:19.793787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:43945 (local address 127.7.200.193:42285)
0807 04:16:19.794988 (+ 1201us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:19.795040 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:19.796896 (+ 1856us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:19.797595 (+ 699us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:19.797604 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:19.797695 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:19.798471 (+ 776us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 04:16:19.798476 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:19.798527 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 04:16:19.798630 (+ 103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:19.799176 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:19.799186 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:19.799192 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 04:16:19.799473 (+ 281us) client_negotiation.cc:240] Negotiation successful
0807 04:16:19.799767 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":299,"threads_started":1}
I20260807 04:16:19.802276 13209 heartbeater.cc:347] Connected to a master server at 127.7.200.254:43945
I20260807 04:16:19.802597 13209 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:19.803272 13209 heartbeater.cc:511] Master 127.7.200.254:43945 requested a full tablet report, sending...
I20260807 04:16:19.805508 13001 ts_manager.cc:194] Registered new tserver with Master: 87c8c04e0686438fa014092106617bc5 (127.7.200.193:32873)
W20260807 04:16:20.132359 13213 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:20.132656 13213 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:20.132849 13213 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:20.140218 13213 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:20.140332 13213 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:20.140563 13213 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:16:20.150367 13213 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:37791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:43945
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:20.151748 13213 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:20.153622 13213 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:20.167423 13218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:20.167464 13219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:20.167495 13221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:20.174425 13213 server_base.cc:1034] running on GCE node
I20260807 04:16:20.175177 13213 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:20.176246 13213 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:20.177515 13213 hybrid_clock.cc:648] HybridClock initialized: now 1786076180177453 us; error 43 us; skew 500 ppm
I20260807 04:16:20.177878 13213 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 04:16:20.180626 13213 webserver.cc:460] Webserver started at http://127.7.200.194:45143/ using document root <none> and password file <none>
I20260807 04:16:20.181455 13213 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:20.181591 13213 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:20.182029 13213 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:20.185272 13213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-1/data/instance:
uuid: "be95dda592bb4142bcdf924e96196099"
format_stamp: "Formatted at 2026-08-07 04:16:20 on dist-test-slave-qg60"
server_key: "f92de5239ee2ca3012a93d931a31f2f9"
server_key_iv: "d398926fa621eecbb6e9811d9ea3dedb"
server_key_version: "encryptionkey@0"
I20260807 04:16:20.186081 13213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance:
uuid: "be95dda592bb4142bcdf924e96196099"
format_stamp: "Formatted at 2026-08-07 04:16:20 on dist-test-slave-qg60"
server_key: "f92de5239ee2ca3012a93d931a31f2f9"
server_key_iv: "d398926fa621eecbb6e9811d9ea3dedb"
server_key_version: "encryptionkey@0"
I20260807 04:16:20.191448 13213 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 04:16:20.195108 13228 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:20.196525 13213 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 04:16:20.196712 13213 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "be95dda592bb4142bcdf924e96196099"
format_stamp: "Formatted at 2026-08-07 04:16:20 on dist-test-slave-qg60"
server_key: "f92de5239ee2ca3012a93d931a31f2f9"
server_key_iv: "d398926fa621eecbb6e9811d9ea3dedb"
server_key_version: "encryptionkey@0"
I20260807 04:16:20.197041 13213 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:20.202857 13213 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:20.203646 13213 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:20.203922 13213 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:20.204936 13213 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:16:20.206323 13213 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:20.206449 13213 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:20.206588 13213 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:20.206684 13213 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:20.243078 13213 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:46027
I20260807 04:16:20.243113 13347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:46027 every 8 connection(s)
I20260807 04:16:20.244673 13213 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:16:20.254703 13211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:20.248029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:44645 (local address 127.7.200.254:43945)
0807 04:16:20.248230 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:20.248235 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:20.249875 (+ 1640us) server_negotiation.cc:407] Connection header received
0807 04:16:20.251678 (+ 1803us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:20.251684 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:20.251758 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:20.251876 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:20.253738 (+ 1862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:20.253744 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:20.253748 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:16:20.253766 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:20.253804 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:16:20.253817 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:20.253936 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:20.254203 (+ 267us) server_negotiation.cc:299] Negotiation successful
0807 04:16:20.254273 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 04:16:20.254911 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 13213
I20260807 04:16:20.255098 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance
I20260807 04:16:20.255645 7971 external_mini_cluster.cc:1428] Setting key d307cf09b4c8e01a388317b9301bd8d3
I20260807 04:16:20.255638 13351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:20.248689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:43945 (local address 127.7.200.194:44645)
0807 04:16:20.249712 (+ 1023us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:20.249748 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:20.251364 (+ 1616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:20.252246 (+ 882us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:20.252255 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:20.252344 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:20.253364 (+ 1020us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 04:16:20.253369 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:20.253418 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 04:16:20.253527 (+ 109us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:20.253937 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:20.253947 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:20.253955 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 04:16:20.254231 (+ 276us) client_negotiation.cc:240] Negotiation successful
0807 04:16:20.254479 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":350,"threads_started":1}
I20260807 04:16:20.257220 13348 heartbeater.cc:347] Connected to a master server at 127.7.200.254:43945
I20260807 04:16:20.257629 13348 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:20.258327 13348 heartbeater.cc:511] Master 127.7.200.254:43945 requested a full tablet report, sending...
I20260807 04:16:20.258993 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:0
--local_ip_for_outbound_sockets=127.7.200.195
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:43945
--builtin_ntp_servers=127.7.200.212:37791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260807 04:16:20.259820 13001 ts_manager.cc:194] Registered new tserver with Master: be95dda592bb4142bcdf924e96196099 (127.7.200.194:46027)
W20260807 04:16:20.598728 13352 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:20.599277 13352 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:20.599472 13352 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:20.606983 13352 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:20.607095 13352 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:20.607280 13352 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:16:20.616492 13352 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:37791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:43945
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:20.617929 13352 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:20.619812 13352 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:20.634222 13359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:20.634173 13362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:20.634764 13357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:20.635215 13352 server_base.cc:1034] running on GCE node
I20260807 04:16:20.635891 13352 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:20.637033 13352 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:20.638301 13352 hybrid_clock.cc:648] HybridClock initialized: now 1786076180638254 us; error 41 us; skew 500 ppm
I20260807 04:16:20.638648 13352 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 04:16:20.641086 13352 webserver.cc:460] Webserver started at http://127.7.200.195:45859/ using document root <none> and password file <none>
I20260807 04:16:20.641816 13352 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:20.641956 13352 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:20.642293 13352 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:20.645519 13352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-2/data/instance:
uuid: "3721ee1759b84aff9ca8e3d9ca538bb9"
format_stamp: "Formatted at 2026-08-07 04:16:20 on dist-test-slave-qg60"
server_key: "43bc0ce5e276789b9040a2906304f2ba"
server_key_iv: "b70214efc7ca00971413e73a46e07058"
server_key_version: "encryptionkey@0"
I20260807 04:16:20.646375 13352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance:
uuid: "3721ee1759b84aff9ca8e3d9ca538bb9"
format_stamp: "Formatted at 2026-08-07 04:16:20 on dist-test-slave-qg60"
server_key: "43bc0ce5e276789b9040a2906304f2ba"
server_key_iv: "b70214efc7ca00971413e73a46e07058"
server_key_version: "encryptionkey@0"
I20260807 04:16:20.651904 13352 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 04:16:20.655370 13368 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:20.656776 13352 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 04:16:20.656951 13352 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "3721ee1759b84aff9ca8e3d9ca538bb9"
format_stamp: "Formatted at 2026-08-07 04:16:20 on dist-test-slave-qg60"
server_key: "43bc0ce5e276789b9040a2906304f2ba"
server_key_iv: "b70214efc7ca00971413e73a46e07058"
server_key_version: "encryptionkey@0"
I20260807 04:16:20.657192 13352 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:20.663159 13352 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:20.663950 13352 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:20.664237 13352 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:20.665225 13352 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:16:20.666621 13352 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:20.666745 13352 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:20.666883 13352 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:20.666975 13352 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:20.702733 13352 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:39453
I20260807 04:16:20.702792 13489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:39453 every 8 connection(s)
I20260807 04:16:20.704174 13352 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:16:20.712363 13211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:20.706870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:38253 (local address 127.7.200.254:43945)
0807 04:16:20.707218 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:20.707222 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:20.708486 (+ 1264us) server_negotiation.cc:407] Connection header received
0807 04:16:20.710296 (+ 1810us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:20.710301 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:20.710359 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:20.710470 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:20.711713 (+ 1243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:20.711718 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:20.711721 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:16:20.711738 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:20.711771 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:16:20.711783 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:20.711887 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:20.712068 (+ 181us) server_negotiation.cc:299] Negotiation successful
0807 04:16:20.712122 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217}
I20260807 04:16:20.713292 13492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:20.707377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:43945 (local address 127.7.200.195:38253)
0807 04:16:20.708327 (+ 950us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:20.708370 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:20.710021 (+ 1651us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:20.710669 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:20.710677 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:20.710764 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:20.711424 (+ 660us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 04:16:20.711426 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:20.711463 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 04:16:20.711550 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:20.711874 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:20.711882 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:20.711887 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 04:16:20.712130 (+ 243us) client_negotiation.cc:240] Negotiation successful
0807 04:16:20.712316 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":284,"threads_started":1}
I20260807 04:16:20.714448 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 13352
I20260807 04:16:20.714630 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance
I20260807 04:16:20.714840 13490 heartbeater.cc:347] Connected to a master server at 127.7.200.254:43945
I20260807 04:16:20.715180 13490 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:20.715293 7971 external_mini_cluster.cc:1428] Setting key 699626cfc85c52b1ba6a88ba492ed890
I20260807 04:16:20.715917 13490 heartbeater.cc:511] Master 127.7.200.254:43945 requested a full tablet report, sending...
I20260807 04:16:20.717490 13001 ts_manager.cc:194] Registered new tserver with Master: 3721ee1759b84aff9ca8e3d9ca538bb9 (127.7.200.195:39453)
I20260807 04:16:20.718604 7971 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 04:16:20.726120 13211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:20.723325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35654 (local address 127.7.200.254:43945)
0807 04:16:20.723510 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:20.723515 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:20.724033 (+ 518us) server_negotiation.cc:407] Connection header received
0807 04:16:20.724237 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:20.724241 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:20.724301 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:20.724394 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:20.725495 (+ 1101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:20.725500 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:20.725503 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:16:20.725519 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:20.725574 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:16:20.725588 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:20.725695 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:20.725813 (+ 118us) server_negotiation.cc:299] Negotiation successful
0807 04:16:20.725863 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 04:16:20.730530 13000 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35654:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:16:20.737353 13000 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:16:20.756897 13505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:20.753273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60156 (local address 127.7.200.194:46027)
0807 04:16:20.754025 (+ 752us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:20.754037 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:20.754074 (+ 37us) server_negotiation.cc:407] Connection header received
0807 04:16:20.754159 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:20.754170 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:20.754435 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:20.754625 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:20.755917 (+ 1292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:20.755926 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:20.755940 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:16:20.755974 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:20.756021 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:16:20.756042 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:20.756254 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:20.756372 (+ 118us) server_negotiation.cc:299] Negotiation successful
0807 04:16:20.756480 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":551,"thread_start_us":396,"threads_started":1}
I20260807 04:16:20.756976 13503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:20.752462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:46027 (local address 127.0.0.1:60156)
0807 04:16:20.753330 (+ 868us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:20.753391 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:20.753564 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:20.754671 (+ 1107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:20.754680 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:20.754782 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:20.755658 (+ 876us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 04:16:20.755661 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:20.755683 (+ 22us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 04:16:20.755749 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:20.756177 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:20.756188 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:20.756196 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 04:16:20.756388 (+ 192us) client_negotiation.cc:240] Negotiation successful
0807 04:16:20.756500 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":475,"threads_started":1}
I20260807 04:16:20.759856 13503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:20.752794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:32873 (local address 127.0.0.1:57624)
0807 04:16:20.757218 (+ 4424us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:20.757238 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:20.757333 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:20.757918 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:20.757925 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:20.757981 (+ 56us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:20.758653 (+ 672us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 04:16:20.758656 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:20.758676 (+ 20us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 04:16:20.758728 (+ 52us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:20.759414 (+ 686us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:20.759419 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:20.759424 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 04:16:20.759558 (+ 134us) client_negotiation.cc:240] Negotiation successful
0807 04:16:20.759612 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4319,"threads_started":1}
I20260807 04:16:20.759887 13506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:20.753445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57624 (local address 127.7.200.193:32873)
0807 04:16:20.756186 (+ 2741us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:20.756198 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:20.757432 (+ 1234us) server_negotiation.cc:407] Connection header received
0807 04:16:20.757494 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:20.757499 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:20.757723 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:20.757883 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:20.759208 (+ 1325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:20.759215 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:20.759224 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:16:20.759244 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:20.759284 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:16:20.759297 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:20.759399 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:20.759581 (+ 182us) server_negotiation.cc:299] Negotiation successful
0807 04:16:20.759657 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2544,"thread_start_us":2416,"threads_started":1}
I20260807 04:16:20.761307 13279 tablet_service.cc:1467] Processing CreateTablet for tablet 42a15b5ec22a463e960213c95523579c (DEFAULT_TABLE table=test-table [id=9ee8475edf7e42959d1799a3d9b48f06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:16:20.762743 13279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42a15b5ec22a463e960213c95523579c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:20.769243 13507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:20.765697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33388 (local address 127.7.200.195:39453)
0807 04:16:20.766492 (+ 795us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:20.766500 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:20.766535 (+ 35us) server_negotiation.cc:407] Connection header received
0807 04:16:20.766607 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:20.766615 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:20.766822 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:20.766981 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:20.768339 (+ 1358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:20.768348 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:20.768362 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:16:20.768382 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:20.768436 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:16:20.768456 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:20.768642 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:20.768705 (+ 63us) server_negotiation.cc:299] Negotiation successful
0807 04:16:20.768830 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":628,"thread_start_us":440,"threads_started":1}
I20260807 04:16:20.769250 13504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:20.765388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:39453 (local address 127.0.0.1:33388)
0807 04:16:20.765630 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:20.765649 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:20.765747 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:20.767000 (+ 1253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:20.767005 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:20.767038 (+ 33us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:20.768102 (+ 1064us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 04:16:20.768105 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:20.768125 (+ 20us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 04:16:20.768172 (+ 47us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:20.768588 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:20.768593 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:20.768598 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 04:16:20.768756 (+ 158us) client_negotiation.cc:240] Negotiation successful
0807 04:16:20.768813 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260807 04:16:20.769881 13138 tablet_service.cc:1467] Processing CreateTablet for tablet 42a15b5ec22a463e960213c95523579c (DEFAULT_TABLE table=test-table [id=9ee8475edf7e42959d1799a3d9b48f06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:16:20.771234 13138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42a15b5ec22a463e960213c95523579c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:20.773283 13420 tablet_service.cc:1467] Processing CreateTablet for tablet 42a15b5ec22a463e960213c95523579c (DEFAULT_TABLE table=test-table [id=9ee8475edf7e42959d1799a3d9b48f06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:16:20.774744 13420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42a15b5ec22a463e960213c95523579c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:20.777400 13508 tablet_bootstrap.cc:492] T 42a15b5ec22a463e960213c95523579c P be95dda592bb4142bcdf924e96196099: Bootstrap starting.
I20260807 04:16:20.781145 13508 tablet_bootstrap.cc:654] T 42a15b5ec22a463e960213c95523579c P be95dda592bb4142bcdf924e96196099: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:20.782527 13508 log.cc:824] T 42a15b5ec22a463e960213c95523579c P be95dda592bb4142bcdf924e96196099: Log is configured to *not* fsync() on all Append() calls
I20260807 04:16:20.785197 13510 tablet_bootstrap.cc:492] T 42a15b5ec22a463e960213c95523579c P 87c8c04e0686438fa014092106617bc5: Bootstrap starting.
I20260807 04:16:20.786115 13508 tablet_bootstrap.cc:492] T 42a15b5ec22a463e960213c95523579c P be95dda592bb4142bcdf924e96196099: No bootstrap required, opened a new log
I20260807 04:16:20.786406 13508 ts_tablet_manager.cc:1397] T 42a15b5ec22a463e960213c95523579c P be95dda592bb4142bcdf924e96196099: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260807 04:16:20.794322 13511 tablet_bootstrap.cc:492] T 42a15b5ec22a463e960213c95523579c P 3721ee1759b84aff9ca8e3d9ca538bb9: Bootstrap starting.
I20260807 04:16:20.795120 13508 raft_consensus.cc:348] T 42a15b5ec22a463e960213c95523579c P be95dda592bb4142bcdf924e96196099 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be95dda592bb4142bcdf924e96196099" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 46027 } } peers { permanent_uuid: "87c8c04e0686438fa014092106617bc5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32873 } } peers { permanent_uuid: "3721ee1759b84aff9ca8e3d9ca538bb9" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39453 } }
I20260807 04:16:20.795513 13508 raft_consensus.cc:374] T 42a15b5ec22a463e960213c95523579c P be95dda592bb4142bcdf924e96196099 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:20.795622 13508 raft_consensus.cc:729] T 42a15b5ec22a463e960213c95523579c P be95dda592bb4142bcdf924e96196099 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be95dda592bb4142bcdf924e96196099, State: Initialized, Role: FOLLOWER
I20260807 04:16:20.796442 13508 consensus_queue.cc:260] T 42a15b5ec22a463e960213c95523579c P be95dda592bb4142bcdf924e96196099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be95dda592bb4142bcdf924e96196099" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 46027 } } peers { permanent_uuid: "87c8c04e0686438fa014092106617bc5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32873 } } peers { permanent_uuid: "3721ee1759b84aff9ca8e3d9ca538bb9" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39453 } }
I20260807 04:16:20.796886 13510 tablet_bootstrap.cc:654] T 42a15b5ec22a463e960213c95523579c P 87c8c04e0686438fa014092106617bc5: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:20.797914 13511 tablet_bootstrap.cc:654] T 42a15b5ec22a463e960213c95523579c P 3721ee1759b84aff9ca8e3d9ca538bb9: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:20.798669 13510 log.cc:824] T 42a15b5ec22a463e960213c95523579c P 87c8c04e0686438fa014092106617bc5: Log is configured to *not* fsync() on all Append() calls
I20260807 04:16:20.800522 13511 log.cc:824] T 42a15b5ec22a463e960213c95523579c P 3721ee1759b84aff9ca8e3d9ca538bb9: Log is configured to *not* fsync() on all Append() calls
I20260807 04:16:20.804020 13348 heartbeater.cc:503] Master 127.7.200.254:43945 was elected leader, sending a full tablet report...
I20260807 04:16:20.805317 13508 ts_tablet_manager.cc:1428] T 42a15b5ec22a463e960213c95523579c P be95dda592bb4142bcdf924e96196099: Time spent starting tablet: real 0.019s user 0.013s sys 0.006s
I20260807 04:16:20.808504 13209 heartbeater.cc:503] Master 127.7.200.254:43945 was elected leader, sending a full tablet report...
I20260807 04:16:20.808550 13510 tablet_bootstrap.cc:492] T 42a15b5ec22a463e960213c95523579c P 87c8c04e0686438fa014092106617bc5: No bootstrap required, opened a new log
I20260807 04:16:20.808961 13510 ts_tablet_manager.cc:1397] T 42a15b5ec22a463e960213c95523579c P 87c8c04e0686438fa014092106617bc5: Time spent bootstrapping tablet: real 0.024s user 0.009s sys 0.007s
I20260807 04:16:20.811436 13511 tablet_bootstrap.cc:492] T 42a15b5ec22a463e960213c95523579c P 3721ee1759b84aff9ca8e3d9ca538bb9: No bootstrap required, opened a new log
I20260807 04:16:20.811784 13511 ts_tablet_manager.cc:1397] T 42a15b5ec22a463e960213c95523579c P 3721ee1759b84aff9ca8e3d9ca538bb9: Time spent bootstrapping tablet: real 0.018s user 0.015s sys 0.000s
I20260807 04:16:20.820078 13510 raft_consensus.cc:348] T 42a15b5ec22a463e960213c95523579c P 87c8c04e0686438fa014092106617bc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be95dda592bb4142bcdf924e96196099" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 46027 } } peers { permanent_uuid: "87c8c04e0686438fa014092106617bc5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32873 } } peers { permanent_uuid: "3721ee1759b84aff9ca8e3d9ca538bb9" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39453 } }
I20260807 04:16:20.820604 13510 raft_consensus.cc:374] T 42a15b5ec22a463e960213c95523579c P 87c8c04e0686438fa014092106617bc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:20.820711 13510 raft_consensus.cc:729] T 42a15b5ec22a463e960213c95523579c P 87c8c04e0686438fa014092106617bc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87c8c04e0686438fa014092106617bc5, State: Initialized, Role: FOLLOWER
I20260807 04:16:20.821421 13510 consensus_queue.cc:260] T 42a15b5ec22a463e960213c95523579c P 87c8c04e0686438fa014092106617bc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be95dda592bb4142bcdf924e96196099" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 46027 } } peers { permanent_uuid: "87c8c04e0686438fa014092106617bc5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32873 } } peers { permanent_uuid: "3721ee1759b84aff9ca8e3d9ca538bb9" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39453 } }
I20260807 04:16:20.822505 13511 raft_consensus.cc:348] T 42a15b5ec22a463e960213c95523579c P 3721ee1759b84aff9ca8e3d9ca538bb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be95dda592bb4142bcdf924e96196099" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 46027 } } peers { permanent_uuid: "87c8c04e0686438fa014092106617bc5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32873 } } peers { permanent_uuid: "3721ee1759b84aff9ca8e3d9ca538bb9" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39453 } }
I20260807 04:16:20.822958 13511 raft_consensus.cc:374] T 42a15b5ec22a463e960213c95523579c P 3721ee1759b84aff9ca8e3d9ca538bb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:20.823060 13511 raft_consensus.cc:729] T 42a15b5ec22a463e960213c95523579c P 3721ee1759b84aff9ca8e3d9ca538bb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3721ee1759b84aff9ca8e3d9ca538bb9, State: Initialized, Role: FOLLOWER
I20260807 04:16:20.823457 13510 ts_tablet_manager.cc:1428] T 42a15b5ec22a463e960213c95523579c P 87c8c04e0686438fa014092106617bc5: Time spent starting tablet: real 0.014s user 0.009s sys 0.004s
I20260807 04:16:20.823804 13511 consensus_queue.cc:260] T 42a15b5ec22a463e960213c95523579c P 3721ee1759b84aff9ca8e3d9ca538bb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be95dda592bb4142bcdf924e96196099" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 46027 } } peers { permanent_uuid: "87c8c04e0686438fa014092106617bc5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32873 } } peers { permanent_uuid: "3721ee1759b84aff9ca8e3d9ca538bb9" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39453 } }
I20260807 04:16:20.825081 13490 heartbeater.cc:503] Master 127.7.200.254:43945 was elected leader, sending a full tablet report...
I20260807 04:16:20.825659 13511 ts_tablet_manager.cc:1428] T 42a15b5ec22a463e960213c95523579c P 3721ee1759b84aff9ca8e3d9ca538bb9: Time spent starting tablet: real 0.014s user 0.008s sys 0.005s
I20260807 04:16:20.921132 13516 raft_consensus.cc:482] T 42a15b5ec22a463e960213c95523579c P 87c8c04e0686438fa014092106617bc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:16:20.921532 13516 raft_consensus.cc:504] T 42a15b5ec22a463e960213c95523579c P 87c8c04e0686438fa014092106617bc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be95dda592bb4142bcdf924e96196099" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 46027 } } peers { permanent_uuid: "87c8c04e0686438fa014092106617bc5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32873 } } peers { permanent_uuid: "3721ee1759b84aff9ca8e3d9ca538bb9" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39453 } }
I20260807 04:16:20.923379 13516 leader_election.cc:288] T 42a15b5ec22a463e960213c95523579c P 87c8c04e0686438fa014092106617bc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be95dda592bb4142bcdf924e96196099 (127.7.200.194:46027), 3721ee1759b84aff9ca8e3d9ca538bb9 (127.7.200.195:39453)
I20260807 04:16:20.927059 13507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:20.923904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:54793 (local address 127.7.200.195:39453)
0807 04:16:20.924154 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:20.924160 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:20.924814 (+ 654us) server_negotiation.cc:407] Connection header received
0807 04:16:20.925056 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:20.925065 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:20.925117 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:20.925223 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:20.926367 (+ 1144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:20.926379 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:20.926382 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:16:20.926398 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:20.926430 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:16:20.926443 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:20.926578 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:20.926699 (+ 121us) server_negotiation.cc:299] Negotiation successful
0807 04:16:20.926764 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 04:16:20.927248 13518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:20.923756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:39453 (local address 127.7.200.193:54793)
0807 04:16:20.924656 (+ 900us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:20.924672 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:20.924881 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:20.925258 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:20.925266 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:20.925293 (+ 27us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:20.926122 (+ 829us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 04:16:20.926126 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:20.926153 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 04:16:20.926207 (+ 54us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:20.926568 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:20.926573 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:20.926578 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 04:16:20.926734 (+ 156us) client_negotiation.cc:240] Negotiation successful
0807 04:16:20.926786 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":784,"thread_start_us":547,"threads_started":1}
I20260807 04:16:20.927536 13505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:20.923974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:40749 (local address 127.7.200.194:46027)
0807 04:16:20.924152 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:20.924159 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:20.925353 (+ 1194us) server_negotiation.cc:407] Connection header received
0807 04:16:20.925600 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:20.925605 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:20.925695 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:20.925812 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:20.926799 (+ 987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:20.926805 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:20.926810 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:16:20.926836 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:20.926867 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:16:20.926880 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:20.927023 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:20.927144 (+ 121us) server_negotiation.cc:299] Negotiation successful
0807 04:16:20.927217 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 04:16:20.927722 13519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:20.923938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:46027 (local address 127.7.200.193:40749)
0807 04:16:20.925232 (+ 1294us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:20.925249 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:20.925404 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:20.925843 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:20.925846 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:20.925864 (+ 18us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:20.926580 (+ 716us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 04:16:20.926584 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:20.926598 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 04:16:20.926637 (+ 39us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:20.926996 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:20.927003 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:20.927008 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 04:16:20.927204 (+ 196us) client_negotiation.cc:240] Negotiation successful
0807 04:16:20.927264 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1170,"thread_start_us":914,"threads_started":1}
I20260807 04:16:20.928459 13441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42a15b5ec22a463e960213c95523579c" candidate_uuid: "87c8c04e0686438fa014092106617bc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3721ee1759b84aff9ca8e3d9ca538bb9" is_pre_election: true
I20260807 04:16:20.928721 13299 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42a15b5ec22a463e960213c95523579c" candidate_uuid: "87c8c04e0686438fa014092106617bc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be95dda592bb4142bcdf924e96196099" is_pre_election: true
I20260807 04:16:20.929016 13441 raft_consensus.cc:2454] T 42a15b5ec22a463e960213c95523579c P 3721ee1759b84aff9ca8e3d9ca538bb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87c8c04e0686438fa014092106617bc5 in term 0.
I20260807 04:16:20.929347 13299 raft_consensus.cc:2454] T 42a15b5ec22a463e960213c95523579c P be95dda592bb4142bcdf924e96196099 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87c8c04e0686438fa014092106617bc5 in term 0.
I20260807 04:16:20.929831 13087 leader_election.cc:302] T 42a15b5ec22a463e960213c95523579c P 87c8c04e0686438fa014092106617bc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3721ee1759b84aff9ca8e3d9ca538bb9, 87c8c04e0686438fa014092106617bc5; no voters:
I20260807 04:16:20.930305 13516 raft_consensus.cc:2781] T 42a15b5ec22a463e960213c95523579c P 87c8c04e0686438fa014092106617bc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:16:20.930442 13516 raft_consensus.cc:482] T 42a15b5ec22a463e960213c95523579c P 87c8c04e0686438fa014092106617bc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:16:20.930611 13516 raft_consensus.cc:3037] T 42a15b5ec22a463e960213c95523579c P 87c8c04e0686438fa014092106617bc5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:20.933101 13516 raft_consensus.cc:504] T 42a15b5ec22a463e960213c95523579c P 87c8c04e0686438fa014092106617bc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be95dda592bb4142bcdf924e96196099" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 46027 } } peers { permanent_uuid: "87c8c04e0686438fa014092106617bc5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32873 } } peers { permanent_uuid: "3721ee1759b84aff9ca8e3d9ca538bb9" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39453 } }
I20260807 04:16:20.933756 13516 leader_election.cc:288] T 42a15b5ec22a463e960213c95523579c P 87c8c04e0686438fa014092106617bc5 [CANDIDATE]: Term 1 election: Requested vote from peers be95dda592bb4142bcdf924e96196099 (127.7.200.194:46027), 3721ee1759b84aff9ca8e3d9ca538bb9 (127.7.200.195:39453)
I20260807 04:16:20.934291 13441 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42a15b5ec22a463e960213c95523579c" candidate_uuid: "87c8c04e0686438fa014092106617bc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3721ee1759b84aff9ca8e3d9ca538bb9"
I20260807 04:16:20.934303 13299 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42a15b5ec22a463e960213c95523579c" candidate_uuid: "87c8c04e0686438fa014092106617bc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be95dda592bb4142bcdf924e96196099"
I20260807 04:16:20.934510 13441 raft_consensus.cc:3037] T 42a15b5ec22a463e960213c95523579c P 3721ee1759b84aff9ca8e3d9ca538bb9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:20.934520 13299 raft_consensus.cc:3037] T 42a15b5ec22a463e960213c95523579c P be95dda592bb4142bcdf924e96196099 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:20.936859 13441 raft_consensus.cc:2454] T 42a15b5ec22a463e960213c95523579c P 3721ee1759b84aff9ca8e3d9ca538bb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87c8c04e0686438fa014092106617bc5 in term 1.
I20260807 04:16:20.936887 13299 raft_consensus.cc:2454] T 42a15b5ec22a463e960213c95523579c P be95dda592bb4142bcdf924e96196099 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87c8c04e0686438fa014092106617bc5 in term 1.
I20260807 04:16:20.937317 13087 leader_election.cc:302] T 42a15b5ec22a463e960213c95523579c P 87c8c04e0686438fa014092106617bc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3721ee1759b84aff9ca8e3d9ca538bb9, 87c8c04e0686438fa014092106617bc5; no voters:
I20260807 04:16:20.937659 13516 raft_consensus.cc:2781] T 42a15b5ec22a463e960213c95523579c P 87c8c04e0686438fa014092106617bc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:16:20.938191 13516 raft_consensus.cc:686] T 42a15b5ec22a463e960213c95523579c P 87c8c04e0686438fa014092106617bc5 [term 1 LEADER]: Becoming Leader. State: Replica: 87c8c04e0686438fa014092106617bc5, State: Running, Role: LEADER
I20260807 04:16:20.938761 13516 consensus_queue.cc:237] T 42a15b5ec22a463e960213c95523579c P 87c8c04e0686438fa014092106617bc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be95dda592bb4142bcdf924e96196099" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 46027 } } peers { permanent_uuid: "87c8c04e0686438fa014092106617bc5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32873 } } peers { permanent_uuid: "3721ee1759b84aff9ca8e3d9ca538bb9" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39453 } }
I20260807 04:16:20.943311 13001 catalog_manager.cc:5495] T 42a15b5ec22a463e960213c95523579c P 87c8c04e0686438fa014092106617bc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87c8c04e0686438fa014092106617bc5 (127.7.200.193). New cstate: current_term: 1 leader_uuid: "87c8c04e0686438fa014092106617bc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be95dda592bb4142bcdf924e96196099" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 46027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87c8c04e0686438fa014092106617bc5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3721ee1759b84aff9ca8e3d9ca538bb9" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39453 } health_report { overall_health: UNKNOWN } } }
W20260807 04:16:20.956028 13491 tablet.cc:2369] T 42a15b5ec22a463e960213c95523579c P 3721ee1759b84aff9ca8e3d9ca538bb9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:16:20.962517 13506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:20.960237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57628 (local address 127.7.200.193:32873)
0807 04:16:20.960452 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:20.960457 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:20.960475 (+ 18us) server_negotiation.cc:407] Connection header received
0807 04:16:20.960623 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:20.960627 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:20.960707 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:20.960854 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:20.961839 (+ 985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:20.961843 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:20.961846 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:16:20.961860 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:20.961911 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:16:20.961928 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:20.962052 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:20.962165 (+ 113us) server_negotiation.cc:299] Negotiation successful
0807 04:16:20.962211 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260807 04:16:20.971164 13441 raft_consensus.cc:1261] T 42a15b5ec22a463e960213c95523579c P 3721ee1759b84aff9ca8e3d9ca538bb9 [term 1 FOLLOWER]: Refusing update from remote peer 87c8c04e0686438fa014092106617bc5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:16:20.971155 13299 raft_consensus.cc:1261] T 42a15b5ec22a463e960213c95523579c P be95dda592bb4142bcdf924e96196099 [term 1 FOLLOWER]: Refusing update from remote peer 87c8c04e0686438fa014092106617bc5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:16:20.972378 13520 consensus_queue.cc:1035] T 42a15b5ec22a463e960213c95523579c P 87c8c04e0686438fa014092106617bc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3721ee1759b84aff9ca8e3d9ca538bb9" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:16:20.972808 13516 consensus_queue.cc:1035] T 42a15b5ec22a463e960213c95523579c P 87c8c04e0686438fa014092106617bc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be95dda592bb4142bcdf924e96196099" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 46027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:16:20.985471 13526 mvcc.cc:205] Tried to move back new op lower bound from 7315768037246611456 to 7315768037128822784. Current Snapshot: MvccSnapshot[applied={T|T < 7315768037246611456}]
I20260807 04:16:20.985520 13523 mvcc.cc:205] Tried to move back new op lower bound from 7315768037246611456 to 7315768037128822784. Current Snapshot: MvccSnapshot[applied={T|T < 7315768037246611456}]
I20260807 04:16:20.997771 13001 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35654:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:16:20.998073 13001 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35654:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:16:21.002151 13001 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8c796525c9dd4136bb331ab01843b2bc: Sending DeleteTablet for 3 replicas of tablet 42a15b5ec22a463e960213c95523579c
I20260807 04:16:21.003438 13279 tablet_service.cc:1514] Processing DeleteTablet for tablet 42a15b5ec22a463e960213c95523579c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:16:20 UTC) from {username='slave'} at 127.0.0.1:60156
I20260807 04:16:21.003628 13138 tablet_service.cc:1514] Processing DeleteTablet for tablet 42a15b5ec22a463e960213c95523579c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:16:20 UTC) from {username='slave'} at 127.0.0.1:57624
I20260807 04:16:21.003688 13420 tablet_service.cc:1514] Processing DeleteTablet for tablet 42a15b5ec22a463e960213c95523579c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:16:20 UTC) from {username='slave'} at 127.0.0.1:33388
I20260807 04:16:21.004571 13533 tablet_replica.cc:330] T 42a15b5ec22a463e960213c95523579c P be95dda592bb4142bcdf924e96196099: stopping tablet replica
I20260807 04:16:21.005276 13533 raft_consensus.cc:2229] T 42a15b5ec22a463e960213c95523579c P be95dda592bb4142bcdf924e96196099 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:16:21.005887 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 13067
I20260807 04:16:21.006016 13533 raft_consensus.cc:2258] T 42a15b5ec22a463e960213c95523579c P be95dda592bb4142bcdf924e96196099 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:16:21.008839 13533 ts_tablet_manager.cc:1905] T 42a15b5ec22a463e960213c95523579c P be95dda592bb4142bcdf924e96196099: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:16:21.013314 13534 tablet_replica.cc:330] T 42a15b5ec22a463e960213c95523579c P 3721ee1759b84aff9ca8e3d9ca538bb9: stopping tablet replica
I20260807 04:16:21.013897 13534 raft_consensus.cc:2229] T 42a15b5ec22a463e960213c95523579c P 3721ee1759b84aff9ca8e3d9ca538bb9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:16:21.014554 13534 raft_consensus.cc:2258] T 42a15b5ec22a463e960213c95523579c P 3721ee1759b84aff9ca8e3d9ca538bb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:16:21.015120 13506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:21.007629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57634 (local address 127.7.200.193:32873)
0807 04:16:21.008170 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:21.008176 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:21.012244 (+ 4068us) server_negotiation.cc:407] Connection header received
0807 04:16:21.012499 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:21.012505 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:21.012585 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:21.012709 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:21.014227 (+ 1518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:21.014233 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:21.014238 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:16:21.014260 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:21.014301 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:16:21.014318 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:21.014422 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:21.014713 (+ 291us) server_negotiation.cc:299] Negotiation successful
0807 04:16:21.014788 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401}
I20260807 04:16:21.015529 13535 tablet_replica.cc:330] T 42a15b5ec22a463e960213c95523579c P 87c8c04e0686438fa014092106617bc5: stopping tablet replica
I20260807 04:16:21.016001 13535 raft_consensus.cc:2229] T 42a15b5ec22a463e960213c95523579c P 87c8c04e0686438fa014092106617bc5 [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:16:21.016533 13204 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:21.017108 13534 ts_tablet_manager.cc:1905] T 42a15b5ec22a463e960213c95523579c P 3721ee1759b84aff9ca8e3d9ca538bb9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:16:21.017942 13533 ts_tablet_manager.cc:1918] T 42a15b5ec22a463e960213c95523579c P be95dda592bb4142bcdf924e96196099: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:16:21.018136 13533 log.cc:1196] T 42a15b5ec22a463e960213c95523579c P be95dda592bb4142bcdf924e96196099: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-1/wal/wals/42a15b5ec22a463e960213c95523579c
I20260807 04:16:21.018934 13533 ts_tablet_manager.cc:1939] T 42a15b5ec22a463e960213c95523579c P be95dda592bb4142bcdf924e96196099: Deleting consensus metadata
I20260807 04:16:21.020888 12986 catalog_manager.cc:4841] TS be95dda592bb4142bcdf924e96196099 (127.7.200.194:46027): tablet 42a15b5ec22a463e960213c95523579c (table test-table [id=9ee8475edf7e42959d1799a3d9b48f06]) successfully deleted
I20260807 04:16:21.023381 13534 ts_tablet_manager.cc:1918] T 42a15b5ec22a463e960213c95523579c P 3721ee1759b84aff9ca8e3d9ca538bb9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:16:21.023566 13534 log.cc:1196] T 42a15b5ec22a463e960213c95523579c P 3721ee1759b84aff9ca8e3d9ca538bb9: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786076137270840-7971-0/minicluster-data/ts-2/wal/wals/42a15b5ec22a463e960213c95523579c
I20260807 04:16:21.024143 13534 ts_tablet_manager.cc:1939] T 42a15b5ec22a463e960213c95523579c P 3721ee1759b84aff9ca8e3d9ca538bb9: Deleting consensus metadata
I20260807 04:16:21.026096 12987 catalog_manager.cc:4841] TS 3721ee1759b84aff9ca8e3d9ca538bb9 (127.7.200.195:39453): tablet 42a15b5ec22a463e960213c95523579c (table test-table [id=9ee8475edf7e42959d1799a3d9b48f06]) successfully deleted
I20260807 04:16:21.116837 13535 raft_consensus.cc:2258] T 42a15b5ec22a463e960213c95523579c P 87c8c04e0686438fa014092106617bc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:16:21.117784 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 13067
I20260807 04:16:21.138314 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 13213
W20260807 04:16:21.138289 12987 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.200.193:32873 (error 108)
I20260807 04:16:21.140282 13504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:21.139725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:32873 (local address 127.0.0.1:57644)
0807 04:16:21.139913 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:21.140090 (+ 177us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:32873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260807 04:16:21.140549 12987 catalog_manager.cc:4584] TS 87c8c04e0686438fa014092106617bc5 (127.7.200.193:32873): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 42a15b5ec22a463e960213c95523579c: Network error: Client connection negotiation failed: client connection to 127.7.200.193:32873: connect: Connection refused (error 111)
I20260807 04:16:21.141767 13505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:21.139162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60170 (local address 127.7.200.194:46027)
0807 04:16:21.139338 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:21.139343 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:21.139480 (+ 137us) server_negotiation.cc:407] Connection header received
0807 04:16:21.139704 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:21.139710 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:21.139825 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:21.139940 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:21.141132 (+ 1192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:21.141136 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:21.141140 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:16:21.141156 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:21.141187 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:16:21.141199 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:21.141307 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:21.141386 (+ 79us) server_negotiation.cc:299] Negotiation successful
0807 04:16:21.141435 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 04:16:21.142570 13343 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:21.194113 13504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:21.193620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:32873 (local address 127.0.0.1:57654)
0807 04:16:21.193824 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:21.193926 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:32873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260807 04:16:21.195179 13504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:21.194824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:32873 (local address 127.0.0.1:57664)
0807 04:16:21.194992 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:21.195066 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:32873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260807 04:16:21.233436 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 13213
I20260807 04:16:21.254094 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 13352
I20260807 04:16:21.255941 13504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:21.255453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:32873 (local address 127.0.0.1:57674)
0807 04:16:21.255684 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:21.255786 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:32873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260807 04:16:21.257084 13504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:21.256657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:32873 (local address 127.0.0.1:57684)
0807 04:16:21.256837 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:21.256924 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:32873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260807 04:16:21.257236 13507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:21.254906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33390 (local address 127.7.200.195:39453)
0807 04:16:21.255102 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:21.255107 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:21.255130 (+ 23us) server_negotiation.cc:407] Connection header received
0807 04:16:21.255341 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:21.255345 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:21.255430 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:21.255565 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:21.256511 (+ 946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:21.256519 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:21.256532 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:16:21.256557 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:21.256589 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:16:21.256601 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:21.256777 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:21.256865 (+ 88us) server_negotiation.cc:299] Negotiation successful
0807 04:16:21.256928 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 04:16:21.257869 13485 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:21.337978 13504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:21.337333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:32873 (local address 127.0.0.1:57698)
0807 04:16:21.337611 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:21.337729 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:32873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
I20260807 04:16:21.339229 13504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:21.338743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:32873 (local address 127.0.0.1:57712)
0807 04:16:21.338988 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:21.339090 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:32873: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124}
I20260807 04:16:21.348770 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 13352
I20260807 04:16:21.369889 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 12969
I20260807 04:16:21.371227 13034 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:21.480309 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 12969
2026-08-07T04:16:21Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2762 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260807 04:16:21.524796 7971 mini_oidc.cc:152] Starting JWKS server
I20260807 04:16:21.527758 7971 webserver.cc:460] Webserver started at https://127.0.0.1:34539/ using document root <none> and password file <none>
I20260807 04:16:21.528139 7971 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 04:16:21.528891 7971 webserver.cc:460] Webserver started at http://127.0.0.1:40405/ using document root <none> and password file <none>
2026-08-07T04:16:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:16:21Z Disabled control of system clock
I20260807 04:16:21.565393 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:38393
--webserver_interface=127.7.200.254
--webserver_port=0
--builtin_ntp_servers=127.7.200.212:42469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:38393
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34539/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786076137270840-7971-0/testchainca.cert with env {}
W20260807 04:16:21.904981 13550 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:21.905350 13550 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:21.905510 13550 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:21.912949 13550 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:16:21.913095 13550 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:21.913179 13550 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:21.913307 13550 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:16:21.913386 13550 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 04:16:21.913478 13550 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 04:16:21.913555 13550 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34539/jwks.json
I20260807 04:16:21.923839 13550 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:42469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:38393
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:38393
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34539/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786076137270840-7971-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:21.925315 13550 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:21.926689 13550 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:21.938709 13558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:21.938737 13555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:21.938678 13556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:21.939473 13550 server_base.cc:1034] running on GCE node
I20260807 04:16:21.940251 13550 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:21.941672 13550 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:21.942919 13550 hybrid_clock.cc:648] HybridClock initialized: now 1786076181942857 us; error 39 us; skew 500 ppm
I20260807 04:16:21.943259 13550 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 04:16:21.945658 13550 webserver.cc:460] Webserver started at http://127.7.200.254:40429/ using document root <none> and password file <none>
I20260807 04:16:21.946295 13550 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:21.946398 13550 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:21.946660 13550 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:21.949751 13550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "23ff701d803541ae9ab3f26bf9109b18"
format_stamp: "Formatted at 2026-08-07 04:16:21 on dist-test-slave-qg60"
server_key: "06cafc919f5336caed3fca076f66318e"
server_key_iv: "ed360c2091e7158ae3325cc1ab68011e"
server_key_version: "encryptionkey@0"
I20260807 04:16:21.950570 13550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "23ff701d803541ae9ab3f26bf9109b18"
format_stamp: "Formatted at 2026-08-07 04:16:21 on dist-test-slave-qg60"
server_key: "06cafc919f5336caed3fca076f66318e"
server_key_iv: "ed360c2091e7158ae3325cc1ab68011e"
server_key_version: "encryptionkey@0"
I20260807 04:16:21.956211 13550 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 04:16:21.959856 13565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:21.961423 13550 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:16:21.961629 13550 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "23ff701d803541ae9ab3f26bf9109b18"
format_stamp: "Formatted at 2026-08-07 04:16:21 on dist-test-slave-qg60"
server_key: "06cafc919f5336caed3fca076f66318e"
server_key_iv: "ed360c2091e7158ae3325cc1ab68011e"
server_key_version: "encryptionkey@0"
I20260807 04:16:21.961865 13550 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:21.982681 13550 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:21.983551 13550 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:21.983882 13550 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:22.002691 13550 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:38393
I20260807 04:16:22.002727 13617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:38393 every 8 connection(s)
I20260807 04:16:22.004148 13550 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:16:22.008085 13618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:22.010459 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 13550
I20260807 04:16:22.010725 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:16:22.011658 7971 external_mini_cluster.cc:1428] Setting key 2ce0d6bbb5791ce0c715e02d454c1ba4
I20260807 04:16:22.021190 13618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23ff701d803541ae9ab3f26bf9109b18: Bootstrap starting.
I20260807 04:16:22.025031 13618 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23ff701d803541ae9ab3f26bf9109b18: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:22.025982 13621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:22.013411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58022 (local address 127.7.200.254:38393)
0807 04:16:22.014505 (+ 1094us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:22.014518 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:22.014562 (+ 44us) server_negotiation.cc:407] Connection header received
0807 04:16:22.016247 (+ 1685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:22.016268 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:22.016719 (+ 451us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:22.017106 (+ 387us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:22.017812 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:22.019157 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:22.021031 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:22.021806 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:22.021937 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:22.023260 (+ 1323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:22.023268 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:22.023281 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:16:22.023824 (+ 543us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:22.023914 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:16:22.023934 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:22.024026 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:22.024283 (+ 257us) server_negotiation.cc:299] Negotiation successful
0807 04:16:22.024647 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":656,"thread_start_us":394,"threads_started":1}
I20260807 04:16:22.026181 13618 log.cc:824] T 00000000000000000000000000000000 P 23ff701d803541ae9ab3f26bf9109b18: Log is configured to *not* fsync() on all Append() calls
I20260807 04:16:22.029301 13618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23ff701d803541ae9ab3f26bf9109b18: No bootstrap required, opened a new log
I20260807 04:16:22.030138 7971 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 04:16:22.037161 13618 raft_consensus.cc:348] T 00000000000000000000000000000000 P 23ff701d803541ae9ab3f26bf9109b18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23ff701d803541ae9ab3f26bf9109b18" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 38393 } }
I20260807 04:16:22.037560 13618 raft_consensus.cc:374] T 00000000000000000000000000000000 P 23ff701d803541ae9ab3f26bf9109b18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:22.037668 13618 raft_consensus.cc:729] T 00000000000000000000000000000000 P 23ff701d803541ae9ab3f26bf9109b18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23ff701d803541ae9ab3f26bf9109b18, State: Initialized, Role: FOLLOWER
I20260807 04:16:22.038341 13618 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23ff701d803541ae9ab3f26bf9109b18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23ff701d803541ae9ab3f26bf9109b18" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 38393 } }
I20260807 04:16:22.038622 13618 raft_consensus.cc:388] T 00000000000000000000000000000000 P 23ff701d803541ae9ab3f26bf9109b18 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:16:22.038786 13618 raft_consensus.cc:482] T 00000000000000000000000000000000 P 23ff701d803541ae9ab3f26bf9109b18 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:16:22.038975 13618 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 23ff701d803541ae9ab3f26bf9109b18 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:22.041283 13618 raft_consensus.cc:504] T 00000000000000000000000000000000 P 23ff701d803541ae9ab3f26bf9109b18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23ff701d803541ae9ab3f26bf9109b18" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 38393 } }
I20260807 04:16:22.041823 13618 leader_election.cc:302] T 00000000000000000000000000000000 P 23ff701d803541ae9ab3f26bf9109b18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 23ff701d803541ae9ab3f26bf9109b18; no voters:
I20260807 04:16:22.042483 13618 leader_election.cc:288] T 00000000000000000000000000000000 P 23ff701d803541ae9ab3f26bf9109b18 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:16:22.042649 13623 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 23ff701d803541ae9ab3f26bf9109b18 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:16:22.043553 13623 raft_consensus.cc:686] T 00000000000000000000000000000000 P 23ff701d803541ae9ab3f26bf9109b18 [term 1 LEADER]: Becoming Leader. State: Replica: 23ff701d803541ae9ab3f26bf9109b18, State: Running, Role: LEADER
I20260807 04:16:22.044087 13623 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23ff701d803541ae9ab3f26bf9109b18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23ff701d803541ae9ab3f26bf9109b18" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 38393 } }
I20260807 04:16:22.044620 13618 sys_catalog.cc:564] T 00000000000000000000000000000000 P 23ff701d803541ae9ab3f26bf9109b18 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:16:22.047223 13624 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23ff701d803541ae9ab3f26bf9109b18 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "23ff701d803541ae9ab3f26bf9109b18" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23ff701d803541ae9ab3f26bf9109b18" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 38393 } } }
I20260807 04:16:22.047363 13625 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23ff701d803541ae9ab3f26bf9109b18 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23ff701d803541ae9ab3f26bf9109b18. Latest consensus state: current_term: 1 leader_uuid: "23ff701d803541ae9ab3f26bf9109b18" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23ff701d803541ae9ab3f26bf9109b18" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 38393 } } }
I20260807 04:16:22.047747 13625 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23ff701d803541ae9ab3f26bf9109b18 [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:22.047747 13624 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23ff701d803541ae9ab3f26bf9109b18 [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:22.052866 13629 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:16:22.058255 13629 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:16:22.071491 13629 catalog_manager.cc:1347] Generated new cluster ID: 917730ccee1a407b8b7ba97bdea28563
I20260807 04:16:22.071632 13629 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:16:22.094352 13629 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:16:22.096405 13629 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:16:22.110426 13629 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 23ff701d803541ae9ab3f26bf9109b18: Generated new TSK 0
I20260807 04:16:22.111546 13629 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 04:16:22.148494 13650 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260807 04:16:22.148778 13650 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 04:16:22.151292 13621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:22.126610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58030 (local address 127.7.200.254:38393)
0807 04:16:22.126816 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:22.126822 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:22.127391 (+ 569us) server_negotiation.cc:407] Connection header received
0807 04:16:22.127725 (+ 334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:22.127732 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:22.127820 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:22.128000 (+ 180us) server_negotiation.cc:226] Negotiated authn=JWT
0807 04:16:22.128513 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:22.129680 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:22.131102 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:22.131814 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:22.131967 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:22.132650 (+ 683us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 04:16:22.150517 (+ 17867us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34539/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 04:16:22.150943 (+ 426us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58030: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34539/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":66}
W20260807 04:16:22.151424 13621 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58030: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34539/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260807 04:16:22.152611 13649 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:16:22.126610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:38393 (local address 127.0.0.1:58030)
0807 04:16:22.127288 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:22.127304 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:22.127449 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:22.128030 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:22.128033 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:22.128043 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0807 04:16:22.128354 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:22.128361 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:22.129816 (+ 1455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:22.129820 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:22.130959 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:22.130970 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:22.132060 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:22.132070 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:22.132244 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:22.132331 (+ 87us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 04:16:22.150831 (+ 18500us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34539/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 04:16:22.151108 (+ 277us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.7.200.254:38393: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34539/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":352,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.7.200.254:38393: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34539/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260807 04:16:22.154428 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 13550
I20260807 04:16:22.155654 13613 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:22.253858 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 13550
2026-08-07T04:16:22Z chronyd exiting
I20260807 04:16:22.307447 7971 test_util.cc:175] -----------------------------------------------
I20260807 04:16:22.307644 7971 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786076137270840-7971-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (787 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260807 04:16:22.313130 7971 mini_oidc.cc:152] Starting JWKS server
I20260807 04:16:22.315026 7971 webserver.cc:460] Webserver started at https://127.0.0.1:45041/ using document root <none> and password file <none>
I20260807 04:16:22.315258 7971 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 04:16:22.315929 7971 webserver.cc:460] Webserver started at http://127.0.0.1:33979/ using document root <none> and password file <none>
2026-08-07T04:16:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:16:22Z Disabled control of system clock
I20260807 04:16:22.351662 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:44735
--webserver_interface=127.7.200.254
--webserver_port=0
--builtin_ntp_servers=127.7.200.212:38197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:44735
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45041/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786076137270840-7971-0/testchainca.cert with env {}
W20260807 04:16:22.689761 13658 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:22.690140 13658 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:22.690305 13658 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:22.697590 13658 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:16:22.697742 13658 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:22.697840 13658 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:22.697961 13658 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:16:22.698053 13658 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 04:16:22.698144 13658 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 04:16:22.698221 13658 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45041/jwks.json
I20260807 04:16:22.708048 13658 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:38197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:44735
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:44735
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45041/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786076137270840-7971-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:22.709458 13658 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:22.710781 13658 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:22.723206 13663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:22.723325 13666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:22.723359 13664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:22.724210 13658 server_base.cc:1034] running on GCE node
I20260807 04:16:22.725131 13658 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:22.726632 13658 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:22.727835 13658 hybrid_clock.cc:648] HybridClock initialized: now 1786076182727749 us; error 78 us; skew 500 ppm
I20260807 04:16:22.728255 13658 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 04:16:22.738204 13658 webserver.cc:460] Webserver started at http://127.7.200.254:46439/ using document root <none> and password file <none>
I20260807 04:16:22.739182 13658 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:22.739324 13658 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:22.739720 13658 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:22.743575 13658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "259ba588c25b457596941648827528bb"
format_stamp: "Formatted at 2026-08-07 04:16:22 on dist-test-slave-qg60"
server_key: "d2987eb0fc82735a6dbea1449599939a"
server_key_iv: "c3c4e2eea60c2acac82540c98245bffd"
server_key_version: "encryptionkey@0"
I20260807 04:16:22.745011 13658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "259ba588c25b457596941648827528bb"
format_stamp: "Formatted at 2026-08-07 04:16:22 on dist-test-slave-qg60"
server_key: "d2987eb0fc82735a6dbea1449599939a"
server_key_iv: "c3c4e2eea60c2acac82540c98245bffd"
server_key_version: "encryptionkey@0"
I20260807 04:16:22.752661 13658 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260807 04:16:22.756363 13672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:22.757956 13658 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:16:22.758172 13658 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "259ba588c25b457596941648827528bb"
format_stamp: "Formatted at 2026-08-07 04:16:22 on dist-test-slave-qg60"
server_key: "d2987eb0fc82735a6dbea1449599939a"
server_key_iv: "c3c4e2eea60c2acac82540c98245bffd"
server_key_version: "encryptionkey@0"
I20260807 04:16:22.758409 13658 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:22.779795 13658 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:22.780865 13658 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:22.781234 13658 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:22.803691 13658 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:44735
I20260807 04:16:22.803721 13729 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:44735 every 8 connection(s)
I20260807 04:16:22.805266 13658 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:16:22.809387 13730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:22.813892 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 13658
I20260807 04:16:22.814138 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:16:22.815083 7971 external_mini_cluster.cc:1428] Setting key f8b2549ad6a8597047948b6ebfb3b9b0
I20260807 04:16:22.822490 13730 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 259ba588c25b457596941648827528bb: Bootstrap starting.
I20260807 04:16:22.825902 13730 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 259ba588c25b457596941648827528bb: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:22.827196 13730 log.cc:824] T 00000000000000000000000000000000 P 259ba588c25b457596941648827528bb: Log is configured to *not* fsync() on all Append() calls
I20260807 04:16:22.830719 13733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:22.817393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47684 (local address 127.7.200.254:44735)
0807 04:16:22.818603 (+ 1210us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:22.818615 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:22.818655 (+ 40us) server_negotiation.cc:407] Connection header received
0807 04:16:22.821039 (+ 2384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:22.821063 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:22.821556 (+ 493us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:22.821934 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:22.822514 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:22.823881 (+ 1367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:22.825278 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:22.826018 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:22.826229 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:22.827612 (+ 1383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:22.827626 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:22.827646 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:16:22.828413 (+ 767us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:22.828525 (+ 112us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:16:22.828553 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:22.828659 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:22.829012 (+ 353us) server_negotiation.cc:299] Negotiation successful
0807 04:16:22.829353 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":804,"thread_start_us":565,"threads_started":1}
I20260807 04:16:22.831146 13730 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 259ba588c25b457596941648827528bb: No bootstrap required, opened a new log
I20260807 04:16:22.835157 7971 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 04:16:22.840024 13730 raft_consensus.cc:348] T 00000000000000000000000000000000 P 259ba588c25b457596941648827528bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "259ba588c25b457596941648827528bb" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44735 } }
I20260807 04:16:22.840440 13730 raft_consensus.cc:374] T 00000000000000000000000000000000 P 259ba588c25b457596941648827528bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:22.840560 13730 raft_consensus.cc:729] T 00000000000000000000000000000000 P 259ba588c25b457596941648827528bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 259ba588c25b457596941648827528bb, State: Initialized, Role: FOLLOWER
I20260807 04:16:22.841218 13730 consensus_queue.cc:260] T 00000000000000000000000000000000 P 259ba588c25b457596941648827528bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "259ba588c25b457596941648827528bb" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44735 } }
I20260807 04:16:22.841485 13730 raft_consensus.cc:388] T 00000000000000000000000000000000 P 259ba588c25b457596941648827528bb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:16:22.841624 13730 raft_consensus.cc:482] T 00000000000000000000000000000000 P 259ba588c25b457596941648827528bb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:16:22.841851 13730 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 259ba588c25b457596941648827528bb [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:22.844497 13730 raft_consensus.cc:504] T 00000000000000000000000000000000 P 259ba588c25b457596941648827528bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "259ba588c25b457596941648827528bb" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44735 } }
I20260807 04:16:22.845093 13730 leader_election.cc:302] T 00000000000000000000000000000000 P 259ba588c25b457596941648827528bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 259ba588c25b457596941648827528bb; no voters:
I20260807 04:16:22.845794 13730 leader_election.cc:288] T 00000000000000000000000000000000 P 259ba588c25b457596941648827528bb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:16:22.845999 13735 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 259ba588c25b457596941648827528bb [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:16:22.846830 13735 raft_consensus.cc:686] T 00000000000000000000000000000000 P 259ba588c25b457596941648827528bb [term 1 LEADER]: Becoming Leader. State: Replica: 259ba588c25b457596941648827528bb, State: Running, Role: LEADER
I20260807 04:16:22.847541 13735 consensus_queue.cc:237] T 00000000000000000000000000000000 P 259ba588c25b457596941648827528bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "259ba588c25b457596941648827528bb" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44735 } }
I20260807 04:16:22.848280 13730 sys_catalog.cc:564] T 00000000000000000000000000000000 P 259ba588c25b457596941648827528bb [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:16:22.850692 13736 sys_catalog.cc:455] T 00000000000000000000000000000000 P 259ba588c25b457596941648827528bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "259ba588c25b457596941648827528bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "259ba588c25b457596941648827528bb" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44735 } } }
I20260807 04:16:22.850834 13737 sys_catalog.cc:455] T 00000000000000000000000000000000 P 259ba588c25b457596941648827528bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 259ba588c25b457596941648827528bb. Latest consensus state: current_term: 1 leader_uuid: "259ba588c25b457596941648827528bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "259ba588c25b457596941648827528bb" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44735 } } }
I20260807 04:16:22.851183 13737 sys_catalog.cc:458] T 00000000000000000000000000000000 P 259ba588c25b457596941648827528bb [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:22.851197 13736 sys_catalog.cc:458] T 00000000000000000000000000000000 P 259ba588c25b457596941648827528bb [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:22.854163 13743 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:16:22.859409 13743 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:16:22.870240 13743 catalog_manager.cc:1347] Generated new cluster ID: 889003ba20f74ef1b7ea053ca4c8ffdd
I20260807 04:16:22.870380 13743 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:16:22.888187 13743 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:16:22.890165 13743 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:16:22.899881 13743 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 259ba588c25b457596941648827528bb: Generated new TSK 0
I20260807 04:16:22.901170 13743 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 04:16:22.942863 13761 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260807 04:16:22.943032 13761 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 04:16:22.944248 13733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:22.916203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47688 (local address 127.7.200.254:44735)
0807 04:16:22.916527 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:22.916537 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:22.917244 (+ 707us) server_negotiation.cc:407] Connection header received
0807 04:16:22.917511 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:22.917515 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:22.917592 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:22.917788 (+ 196us) server_negotiation.cc:226] Negotiated authn=JWT
0807 04:16:22.918306 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:22.919079 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:22.920464 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:22.920989 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:22.921136 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:22.921647 (+ 511us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 04:16:22.943443 (+ 21796us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45041/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 04:16:22.943917 (+ 474us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47688: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45041/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":139}
W20260807 04:16:22.944396 13733 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47688: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45041/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260807 04:16:22.944505 13760 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:16:22.916182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:44735 (local address 127.0.0.1:47688)
0807 04:16:22.917132 (+ 950us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:22.917148 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:22.917329 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:22.917789 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:22.917795 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:22.917808 (+ 13us) client_negotiation.cc:189] Negotiated authn=JWT
0807 04:16:22.918124 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:22.918134 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:22.919241 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:22.919248 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:22.920310 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:22.920321 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:22.921170 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:22.921176 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:22.921341 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:22.921377 (+ 36us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 04:16:22.943725 (+ 22348us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45041/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 04:16:22.944056 (+ 331us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.7.200.254:44735: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45041/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":794,"thread_start_us":619,"threads_started":1}
I20260807 04:16:22.946730 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 13658
I20260807 04:16:22.948140 13724 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:23.045351 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 13658
2026-08-07T04:16:23Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (793 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260807 04:16:23.105741 7971 mini_oidc.cc:152] Starting JWKS server
I20260807 04:16:23.109136 7971 webserver.cc:460] Webserver started at https://127.0.0.1:36147/ using document root <none> and password file <none>
I20260807 04:16:23.109531 7971 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 04:16:23.110252 7971 webserver.cc:460] Webserver started at http://127.0.0.1:38815/ using document root <none> and password file <none>
2026-08-07T04:16:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:16:23Z Disabled control of system clock
I20260807 04:16:23.147925 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:32993
--webserver_interface=127.7.200.254
--webserver_port=0
--builtin_ntp_servers=127.7.200.212:37917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:32993
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36147/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 04:16:23.479598 13770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:23.479904 13770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:23.480091 13770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:23.487268 13770 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:16:23.487370 13770 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:23.487458 13770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:23.487543 13770 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:16:23.487625 13770 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 04:16:23.487720 13770 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 04:16:23.487780 13770 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36147/jwks.json
I20260807 04:16:23.496877 13770 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:37917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:32993
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:32993
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36147/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:23.498257 13770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:23.500083 13770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:23.512393 13776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:23.512529 13775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:23.512463 13778 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:23.513464 13770 server_base.cc:1034] running on GCE node
I20260807 04:16:23.514283 13770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:23.515729 13770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:23.516965 13770 hybrid_clock.cc:648] HybridClock initialized: now 1786076183516897 us; error 69 us; skew 500 ppm
I20260807 04:16:23.517416 13770 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 04:16:23.520073 13770 webserver.cc:460] Webserver started at http://127.7.200.254:40727/ using document root <none> and password file <none>
I20260807 04:16:23.520853 13770 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:23.520982 13770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:23.521349 13770 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:23.524353 13770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "68da179f15324b84af977460c3a4ef04"
format_stamp: "Formatted at 2026-08-07 04:16:23 on dist-test-slave-qg60"
server_key: "01c0f69bc4e7f4e7b00c54b980ebb20e"
server_key_iv: "b7cb5c4972cb53362c6c27114a805587"
server_key_version: "encryptionkey@0"
I20260807 04:16:23.525218 13770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "68da179f15324b84af977460c3a4ef04"
format_stamp: "Formatted at 2026-08-07 04:16:23 on dist-test-slave-qg60"
server_key: "01c0f69bc4e7f4e7b00c54b980ebb20e"
server_key_iv: "b7cb5c4972cb53362c6c27114a805587"
server_key_version: "encryptionkey@0"
I20260807 04:16:23.530570 13770 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 04:16:23.534294 13784 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:23.535732 13770 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260807 04:16:23.536033 13770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "68da179f15324b84af977460c3a4ef04"
format_stamp: "Formatted at 2026-08-07 04:16:23 on dist-test-slave-qg60"
server_key: "01c0f69bc4e7f4e7b00c54b980ebb20e"
server_key_iv: "b7cb5c4972cb53362c6c27114a805587"
server_key_version: "encryptionkey@0"
I20260807 04:16:23.536299 13770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:23.566993 13770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:23.567919 13770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:23.568262 13770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:23.587900 13770 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:32993
I20260807 04:16:23.587920 13839 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:32993 every 8 connection(s)
I20260807 04:16:23.589350 13770 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:16:23.591943 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 13770
I20260807 04:16:23.592180 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:16:23.593067 7971 external_mini_cluster.cc:1428] Setting key 2beadcb1eecddecd9a267e93aac19824
I20260807 04:16:23.594177 13840 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:23.608979 13840 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68da179f15324b84af977460c3a4ef04: Bootstrap starting.
I20260807 04:16:23.609505 13843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:23.595197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47662 (local address 127.7.200.254:32993)
0807 04:16:23.596233 (+ 1036us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:23.596244 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:23.596282 (+ 38us) server_negotiation.cc:407] Connection header received
0807 04:16:23.599242 (+ 2960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:23.599264 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:23.599737 (+ 473us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:23.600095 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:23.600799 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:23.602169 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:23.604006 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:23.604722 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:23.604981 (+ 259us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:23.606278 (+ 1297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:23.606287 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:23.606301 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:16:23.606912 (+ 611us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:23.607336 (+ 424us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:16:23.607373 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:23.607472 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:23.607902 (+ 430us) server_negotiation.cc:299] Negotiation successful
0807 04:16:23.608273 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":625,"thread_start_us":400,"threads_started":1}
I20260807 04:16:23.612589 13840 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68da179f15324b84af977460c3a4ef04: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:23.613824 7971 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 04:16:23.613998 13840 log.cc:824] T 00000000000000000000000000000000 P 68da179f15324b84af977460c3a4ef04: Log is configured to *not* fsync() on all Append() calls
I20260807 04:16:23.617491 13840 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68da179f15324b84af977460c3a4ef04: No bootstrap required, opened a new log
I20260807 04:16:23.625102 13840 raft_consensus.cc:348] T 00000000000000000000000000000000 P 68da179f15324b84af977460c3a4ef04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68da179f15324b84af977460c3a4ef04" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 32993 } }
I20260807 04:16:23.625487 13840 raft_consensus.cc:374] T 00000000000000000000000000000000 P 68da179f15324b84af977460c3a4ef04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:23.625609 13840 raft_consensus.cc:729] T 00000000000000000000000000000000 P 68da179f15324b84af977460c3a4ef04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68da179f15324b84af977460c3a4ef04, State: Initialized, Role: FOLLOWER
I20260807 04:16:23.626174 13840 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68da179f15324b84af977460c3a4ef04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68da179f15324b84af977460c3a4ef04" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 32993 } }
I20260807 04:16:23.626415 13840 raft_consensus.cc:388] T 00000000000000000000000000000000 P 68da179f15324b84af977460c3a4ef04 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:16:23.626570 13840 raft_consensus.cc:482] T 00000000000000000000000000000000 P 68da179f15324b84af977460c3a4ef04 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:16:23.626739 13840 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 68da179f15324b84af977460c3a4ef04 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:23.629452 13840 raft_consensus.cc:504] T 00000000000000000000000000000000 P 68da179f15324b84af977460c3a4ef04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68da179f15324b84af977460c3a4ef04" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 32993 } }
I20260807 04:16:23.629974 13840 leader_election.cc:302] T 00000000000000000000000000000000 P 68da179f15324b84af977460c3a4ef04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 68da179f15324b84af977460c3a4ef04; no voters:
I20260807 04:16:23.630559 13840 leader_election.cc:288] T 00000000000000000000000000000000 P 68da179f15324b84af977460c3a4ef04 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:16:23.630729 13845 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 68da179f15324b84af977460c3a4ef04 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:16:23.631493 13845 raft_consensus.cc:686] T 00000000000000000000000000000000 P 68da179f15324b84af977460c3a4ef04 [term 1 LEADER]: Becoming Leader. State: Replica: 68da179f15324b84af977460c3a4ef04, State: Running, Role: LEADER
I20260807 04:16:23.632071 13845 consensus_queue.cc:237] T 00000000000000000000000000000000 P 68da179f15324b84af977460c3a4ef04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68da179f15324b84af977460c3a4ef04" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 32993 } }
I20260807 04:16:23.632846 13840 sys_catalog.cc:564] T 00000000000000000000000000000000 P 68da179f15324b84af977460c3a4ef04 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:16:23.635704 13846 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68da179f15324b84af977460c3a4ef04 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "68da179f15324b84af977460c3a4ef04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68da179f15324b84af977460c3a4ef04" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 32993 } } }
I20260807 04:16:23.636673 13846 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68da179f15324b84af977460c3a4ef04 [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:23.635735 13847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68da179f15324b84af977460c3a4ef04 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 68da179f15324b84af977460c3a4ef04. Latest consensus state: current_term: 1 leader_uuid: "68da179f15324b84af977460c3a4ef04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68da179f15324b84af977460c3a4ef04" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 32993 } } }
I20260807 04:16:23.637655 13847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68da179f15324b84af977460c3a4ef04 [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:23.637924 13855 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:16:23.642783 13855 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:16:23.651521 13855 catalog_manager.cc:1347] Generated new cluster ID: 28415cc5607b41f5bb62b9923d99d94d
I20260807 04:16:23.651685 13855 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:16:23.659687 13855 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:16:23.661734 13855 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:16:23.672299 13855 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 68da179f15324b84af977460c3a4ef04: Generated new TSK 0
I20260807 04:16:23.673267 13855 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:16:23.702275 13843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:23.693460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47668 (local address 127.7.200.254:32993)
0807 04:16:23.693675 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:23.693682 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:23.694179 (+ 497us) server_negotiation.cc:407] Connection header received
0807 04:16:23.694414 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:23.694422 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:23.694527 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:23.694699 (+ 172us) server_negotiation.cc:226] Negotiated authn=JWT
0807 04:16:23.695153 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:23.696288 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:23.697747 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:23.698467 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:23.698610 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:23.699124 (+ 514us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 04:16:23.701616 (+ 2492us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36147/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 04:16:23.701949 (+ 333us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47668: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36147/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":72}
W20260807 04:16:23.702422 13843 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47668: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36147/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260807 04:16:23.704061 13870 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:16:23.693407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:32993 (local address 127.0.0.1:47668)
0807 04:16:23.694064 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:23.694085 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:23.694212 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:23.694715 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:23.694718 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:23.694728 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0807 04:16:23.694997 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:23.695005 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:23.696430 (+ 1425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:23.696434 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:23.697589 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:23.697611 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:23.698690 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:23.698694 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:23.698815 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:23.698848 (+ 33us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 04:16:23.701837 (+ 2989us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36147/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 04:16:23.703631 (+ 1794us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.7.200.254:32993: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36147/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":514,"mutex_wait_us":1462,"thread_start_us":372,"threads_started":1}
I20260807 04:16:23.705729 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 13770
I20260807 04:16:23.707445 13835 generic_service.cc:196] Checking for leaks (request via RPC)
E20260807 04:16:23.714412 13871 webserver.cc:533] Webserver: sslize failed:
E20260807 04:16:23.714504 13871 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 04:16:23.800235 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 13770
2026-08-07T04:16:23Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (753 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-07T04:16:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:16:23Z Disabled control of system clock
I20260807 04:16:23.895656 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:43859
--webserver_interface=127.7.200.254
--webserver_port=0
--builtin_ntp_servers=127.7.200.212:45189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:43859
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786076137270840-7971-0/testchainca.cert with env {}
W20260807 04:16:24.235558 13876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:24.235904 13876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:24.236056 13876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:24.243954 13876 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:16:24.244094 13876 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:24.244163 13876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:24.244257 13876 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:16:24.244325 13876 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 04:16:24.244410 13876 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 04:16:24.244498 13876 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260807 04:16:24.255182 13876 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:45189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:43859
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:43859
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786076137270840-7971-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:24.256649 13876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:24.258045 13876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:24.270635 13881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:24.270735 13882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:24.270658 13884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:24.271736 13876 server_base.cc:1034] running on GCE node
I20260807 04:16:24.272691 13876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:24.274354 13876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:24.275593 13876 hybrid_clock.cc:648] HybridClock initialized: now 1786076184275548 us; error 38 us; skew 500 ppm
I20260807 04:16:24.275998 13876 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 04:16:24.278882 13876 webserver.cc:460] Webserver started at http://127.7.200.254:34187/ using document root <none> and password file <none>
I20260807 04:16:24.279659 13876 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:24.279785 13876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:24.280143 13876 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:24.283285 13876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "921e006e2ab14316bcbfd0be4d7aff57"
format_stamp: "Formatted at 2026-08-07 04:16:24 on dist-test-slave-qg60"
server_key: "32047d7eccab474783d273802fa60f5e"
server_key_iv: "feecc0df81ee6bf28495847097b037c2"
server_key_version: "encryptionkey@0"
I20260807 04:16:24.284148 13876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "921e006e2ab14316bcbfd0be4d7aff57"
format_stamp: "Formatted at 2026-08-07 04:16:24 on dist-test-slave-qg60"
server_key: "32047d7eccab474783d273802fa60f5e"
server_key_iv: "feecc0df81ee6bf28495847097b037c2"
server_key_version: "encryptionkey@0"
I20260807 04:16:24.289775 13876 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 04:16:24.293622 13890 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:24.295044 13876 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:16:24.295252 13876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "921e006e2ab14316bcbfd0be4d7aff57"
format_stamp: "Formatted at 2026-08-07 04:16:24 on dist-test-slave-qg60"
server_key: "32047d7eccab474783d273802fa60f5e"
server_key_iv: "feecc0df81ee6bf28495847097b037c2"
server_key_version: "encryptionkey@0"
I20260807 04:16:24.295501 13876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:24.310031 13876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:24.310902 13876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:24.311230 13876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:24.330564 13876 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:43859
I20260807 04:16:24.330586 13945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:43859 every 8 connection(s)
I20260807 04:16:24.331984 13876 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:16:24.335928 13946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:24.340318 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 13876
I20260807 04:16:24.340531 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:16:24.341450 7971 external_mini_cluster.cc:1428] Setting key 182e5754e6816d6da9f859aa058c2574
I20260807 04:16:24.349864 13946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 921e006e2ab14316bcbfd0be4d7aff57: Bootstrap starting.
I20260807 04:16:24.353639 13946 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 921e006e2ab14316bcbfd0be4d7aff57: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:24.354959 13946 log.cc:824] T 00000000000000000000000000000000 P 921e006e2ab14316bcbfd0be4d7aff57: Log is configured to *not* fsync() on all Append() calls
I20260807 04:16:24.358404 13946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 921e006e2ab14316bcbfd0be4d7aff57: No bootstrap required, opened a new log
I20260807 04:16:24.358461 13949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:24.343876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46116 (local address 127.7.200.254:43859)
0807 04:16:24.345160 (+ 1284us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:24.345189 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:24.345242 (+ 53us) server_negotiation.cc:407] Connection header received
0807 04:16:24.348006 (+ 2764us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:24.348034 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:24.348626 (+ 592us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:24.349140 (+ 514us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:24.349683 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:24.351731 (+ 2048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:24.353059 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:24.354194 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:24.354373 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:24.355640 (+ 1267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:24.355653 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:24.355674 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:16:24.356295 (+ 621us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:24.356411 (+ 116us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:16:24.356440 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:24.356561 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:24.356818 (+ 257us) server_negotiation.cc:299] Negotiation successful
0807 04:16:24.357153 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":718,"thread_start_us":480,"threads_started":1}
I20260807 04:16:24.362596 7971 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 04:16:24.368125 13946 raft_consensus.cc:348] T 00000000000000000000000000000000 P 921e006e2ab14316bcbfd0be4d7aff57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "921e006e2ab14316bcbfd0be4d7aff57" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43859 } }
I20260807 04:16:24.368464 13946 raft_consensus.cc:374] T 00000000000000000000000000000000 P 921e006e2ab14316bcbfd0be4d7aff57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:24.368541 13946 raft_consensus.cc:729] T 00000000000000000000000000000000 P 921e006e2ab14316bcbfd0be4d7aff57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 921e006e2ab14316bcbfd0be4d7aff57, State: Initialized, Role: FOLLOWER
I20260807 04:16:24.369148 13946 consensus_queue.cc:260] T 00000000000000000000000000000000 P 921e006e2ab14316bcbfd0be4d7aff57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "921e006e2ab14316bcbfd0be4d7aff57" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43859 } }
I20260807 04:16:24.369376 13946 raft_consensus.cc:388] T 00000000000000000000000000000000 P 921e006e2ab14316bcbfd0be4d7aff57 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:16:24.369539 13946 raft_consensus.cc:482] T 00000000000000000000000000000000 P 921e006e2ab14316bcbfd0be4d7aff57 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:16:24.369736 13946 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 921e006e2ab14316bcbfd0be4d7aff57 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:24.371968 13946 raft_consensus.cc:504] T 00000000000000000000000000000000 P 921e006e2ab14316bcbfd0be4d7aff57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "921e006e2ab14316bcbfd0be4d7aff57" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43859 } }
I20260807 04:16:24.372432 13946 leader_election.cc:302] T 00000000000000000000000000000000 P 921e006e2ab14316bcbfd0be4d7aff57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 921e006e2ab14316bcbfd0be4d7aff57; no voters:
I20260807 04:16:24.373052 13946 leader_election.cc:288] T 00000000000000000000000000000000 P 921e006e2ab14316bcbfd0be4d7aff57 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:16:24.373193 13951 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 921e006e2ab14316bcbfd0be4d7aff57 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:16:24.374468 13951 raft_consensus.cc:686] T 00000000000000000000000000000000 P 921e006e2ab14316bcbfd0be4d7aff57 [term 1 LEADER]: Becoming Leader. State: Replica: 921e006e2ab14316bcbfd0be4d7aff57, State: Running, Role: LEADER
I20260807 04:16:24.375018 13951 consensus_queue.cc:237] T 00000000000000000000000000000000 P 921e006e2ab14316bcbfd0be4d7aff57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "921e006e2ab14316bcbfd0be4d7aff57" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43859 } }
I20260807 04:16:24.375241 13946 sys_catalog.cc:564] T 00000000000000000000000000000000 P 921e006e2ab14316bcbfd0be4d7aff57 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:16:24.378119 13953 sys_catalog.cc:455] T 00000000000000000000000000000000 P 921e006e2ab14316bcbfd0be4d7aff57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 921e006e2ab14316bcbfd0be4d7aff57. Latest consensus state: current_term: 1 leader_uuid: "921e006e2ab14316bcbfd0be4d7aff57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "921e006e2ab14316bcbfd0be4d7aff57" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43859 } } }
I20260807 04:16:24.378635 13953 sys_catalog.cc:458] T 00000000000000000000000000000000 P 921e006e2ab14316bcbfd0be4d7aff57 [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:24.378239 13952 sys_catalog.cc:455] T 00000000000000000000000000000000 P 921e006e2ab14316bcbfd0be4d7aff57 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "921e006e2ab14316bcbfd0be4d7aff57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "921e006e2ab14316bcbfd0be4d7aff57" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43859 } } }
I20260807 04:16:24.379343 13952 sys_catalog.cc:458] T 00000000000000000000000000000000 P 921e006e2ab14316bcbfd0be4d7aff57 [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:24.381227 13960 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:16:24.386551 13960 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:16:24.396379 13960 catalog_manager.cc:1347] Generated new cluster ID: 7ef35bc58bcf457da58f533536e6a5e8
I20260807 04:16:24.396562 13960 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:16:24.432188 13960 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:16:24.433641 13960 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:16:24.442338 13960 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 921e006e2ab14316bcbfd0be4d7aff57: Generated new TSK 0
I20260807 04:16:24.443405 13960 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:16:25.342408 13949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:24.464503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46118 (local address 127.7.200.254:43859)
0807 04:16:24.464706 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:24.464714 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:24.465322 (+ 608us) server_negotiation.cc:407] Connection header received
0807 04:16:24.465579 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:24.465583 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:24.465658 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:24.465793 (+ 135us) server_negotiation.cc:226] Negotiated authn=JWT
0807 04:16:24.466357 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:24.467168 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:24.469302 (+ 2134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:24.469734 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:24.469829 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:24.470410 (+ 581us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 04:16:25.341657 (+871247us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 04:16:25.342092 (+ 435us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46118: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":71}
W20260807 04:16:25.342530 13949 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46118: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260807 04:16:25.342605 13978 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:16:24.464368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:43859 (local address 127.0.0.1:46118)
0807 04:16:24.465202 (+ 834us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:24.465223 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:24.465374 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:24.465835 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:24.465841 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:24.465855 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0807 04:16:24.466196 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:24.466209 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:24.467324 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:24.467330 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:24.469123 (+ 1793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:24.469139 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:24.469918 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:24.469925 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:24.470107 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:24.470154 (+ 47us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 04:16:25.341966 (+871812us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 04:16:25.342231 (+ 265us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.7.200.254:43859: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":691,"thread_start_us":533,"threads_started":1}
I20260807 04:16:25.343786 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 13876
I20260807 04:16:25.345180 13941 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:25.450641 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 13876
2026-08-07T04:16:25Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1628 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (432 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (432 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:16:26 dist-test-slave-qg60 krb5kdc[13994](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:16:26 dist-test-slave-qg60 krb5kdc[13994](info): set up 2 sockets
Aug 07 04:16:26 dist-test-slave-qg60 krb5kdc[13994](info): commencing operation
krb5kdc: starting...
W20260807 04:16:27.466958 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.002s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:16:27 dist-test-slave-qg60 krb5kdc[13994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076187, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:16:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:16:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
I20260807 04:16:27.732946 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:35497
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:41441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:35497
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:28.072908 14009 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:28.073217 14009 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:28.073382 14009 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:28.080943 14009 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:16:28.081058 14009 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:28.081172 14009 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:28.081260 14009 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:16:28.081357 14009 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:16:28.091696 14009 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:41441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:35497
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:35497
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:28.093169 14009 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:28.094515 14009 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:28.106423 14015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:28.106573 14016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:28.107348 14019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:28.108072 14009 server_base.cc:1034] running on GCE node
I20260807 04:16:28.109083 14009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:28.110639 14009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:28.111864 14009 hybrid_clock.cc:648] HybridClock initialized: now 1786076188111815 us; error 34 us; skew 500 ppm
I20260807 04:16:28.112267 14009 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:28 dist-test-slave-qg60 krb5kdc[13994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076188, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:28.119786 14009 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:16:28.121559 14009 webserver.cc:460] Webserver started at http://127.7.200.254:44055/ using document root <none> and password file <none>
I20260807 04:16:28.122321 14009 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:28.122479 14009 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:28.122823 14009 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:28.126042 14009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "276700464a494312bb438847957b8eca"
format_stamp: "Formatted at 2026-08-07 04:16:28 on dist-test-slave-qg60"
server_key: "377cf272b2a1f8c0a27264617743e9ed"
server_key_iv: "6d169a43f25462e0403626601a0ce4cc"
server_key_version: "encryptionkey@0"
I20260807 04:16:28.126863 14009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "276700464a494312bb438847957b8eca"
format_stamp: "Formatted at 2026-08-07 04:16:28 on dist-test-slave-qg60"
server_key: "377cf272b2a1f8c0a27264617743e9ed"
server_key_iv: "6d169a43f25462e0403626601a0ce4cc"
server_key_version: "encryptionkey@0"
I20260807 04:16:28.132316 14009 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260807 04:16:28.135972 14026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:28.137480 14009 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 04:16:28.137710 14009 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "276700464a494312bb438847957b8eca"
format_stamp: "Formatted at 2026-08-07 04:16:28 on dist-test-slave-qg60"
server_key: "377cf272b2a1f8c0a27264617743e9ed"
server_key_iv: "6d169a43f25462e0403626601a0ce4cc"
server_key_version: "encryptionkey@0"
I20260807 04:16:28.137930 14009 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:28.162948 14009 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:28.167466 14009 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:28.167794 14009 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:28.187549 14009 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:35497
I20260807 04:16:28.187573 14083 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:35497 every 8 connection(s)
I20260807 04:16:28.189036 14009 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:16:28.189669 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 14009
I20260807 04:16:28.189913 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:16:28.190768 7971 external_mini_cluster.cc:1428] Setting key 1d56d858988bd2ea88584e4b5d69c3c7
I20260807 04:16:28.193645 14084 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:28.204784 14084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 276700464a494312bb438847957b8eca: Bootstrap starting.
Aug 07 04:16:28 dist-test-slave-qg60 krb5kdc[13994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076187, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:16:28.208061 14084 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 276700464a494312bb438847957b8eca: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:28.209257 14084 log.cc:824] T 00000000000000000000000000000000 P 276700464a494312bb438847957b8eca: Log is configured to *not* fsync() on all Append() calls
I20260807 04:16:28.212826 14084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 276700464a494312bb438847957b8eca: No bootstrap required, opened a new log
I20260807 04:16:28.214068 14087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:28.192834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46394 (local address 127.7.200.254:35497)
0807 04:16:28.193707 (+ 873us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:28.193723 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:28.193777 (+ 54us) server_negotiation.cc:407] Connection header received
0807 04:16:28.195876 (+ 2099us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:28.195900 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:28.196293 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:28.196742 (+ 449us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:28.198240 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:28.199615 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:28.200890 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:28.201599 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:28.201813 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:28.205927 (+ 4114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:28.205935 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:28.205951 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:28.205988 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:28.209206 (+ 3218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:28.210044 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:28.210050 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:28.210056 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:28.210224 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:28.210691 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:28.210697 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:28.210699 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:28.211481 (+ 782us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:28.211780 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:28.212208 (+ 428us) server_negotiation.cc:299] Negotiation successful
0807 04:16:28.212641 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":336,"threads_started":1}
I20260807 04:16:28.221262 14084 raft_consensus.cc:348] T 00000000000000000000000000000000 P 276700464a494312bb438847957b8eca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "276700464a494312bb438847957b8eca" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 35497 } }
I20260807 04:16:28.221618 14084 raft_consensus.cc:374] T 00000000000000000000000000000000 P 276700464a494312bb438847957b8eca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:28.221695 14084 raft_consensus.cc:729] T 00000000000000000000000000000000 P 276700464a494312bb438847957b8eca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 276700464a494312bb438847957b8eca, State: Initialized, Role: FOLLOWER
I20260807 04:16:28.222262 14084 consensus_queue.cc:260] T 00000000000000000000000000000000 P 276700464a494312bb438847957b8eca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "276700464a494312bb438847957b8eca" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 35497 } }
I20260807 04:16:28.222512 14084 raft_consensus.cc:388] T 00000000000000000000000000000000 P 276700464a494312bb438847957b8eca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:16:28.222671 14084 raft_consensus.cc:482] T 00000000000000000000000000000000 P 276700464a494312bb438847957b8eca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:16:28.222896 14084 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 276700464a494312bb438847957b8eca [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:28.225394 14084 raft_consensus.cc:504] T 00000000000000000000000000000000 P 276700464a494312bb438847957b8eca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "276700464a494312bb438847957b8eca" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 35497 } }
I20260807 04:16:28.225893 14084 leader_election.cc:302] T 00000000000000000000000000000000 P 276700464a494312bb438847957b8eca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 276700464a494312bb438847957b8eca; no voters:
I20260807 04:16:28.226423 14084 leader_election.cc:288] T 00000000000000000000000000000000 P 276700464a494312bb438847957b8eca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:16:28.226608 14090 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 276700464a494312bb438847957b8eca [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:16:28.227814 14090 raft_consensus.cc:686] T 00000000000000000000000000000000 P 276700464a494312bb438847957b8eca [term 1 LEADER]: Becoming Leader. State: Replica: 276700464a494312bb438847957b8eca, State: Running, Role: LEADER
I20260807 04:16:28.228384 14090 consensus_queue.cc:237] T 00000000000000000000000000000000 P 276700464a494312bb438847957b8eca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "276700464a494312bb438847957b8eca" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 35497 } }
I20260807 04:16:28.228832 14084 sys_catalog.cc:564] T 00000000000000000000000000000000 P 276700464a494312bb438847957b8eca [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:16:28.231562 14092 sys_catalog.cc:455] T 00000000000000000000000000000000 P 276700464a494312bb438847957b8eca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 276700464a494312bb438847957b8eca. Latest consensus state: current_term: 1 leader_uuid: "276700464a494312bb438847957b8eca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "276700464a494312bb438847957b8eca" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 35497 } } }
I20260807 04:16:28.231952 14092 sys_catalog.cc:458] T 00000000000000000000000000000000 P 276700464a494312bb438847957b8eca [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:28.231648 14091 sys_catalog.cc:455] T 00000000000000000000000000000000 P 276700464a494312bb438847957b8eca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "276700464a494312bb438847957b8eca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "276700464a494312bb438847957b8eca" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 35497 } } }
I20260807 04:16:28.232163 14091 sys_catalog.cc:458] T 00000000000000000000000000000000 P 276700464a494312bb438847957b8eca [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:28.237931 14097 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:16:28.243588 14097 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:16:28.253868 14097 catalog_manager.cc:1347] Generated new cluster ID: 2b01ddfe85534c7081b359268c08ea36
I20260807 04:16:28.253994 14097 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:16:28.270797 14097 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:16:28.272441 14097 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:16:28.279889 14097 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 276700464a494312bb438847957b8eca: Generated new TSK 0
I20260807 04:16:28.281167 14097 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.200.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
I20260807 04:16:28.356946 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:0
--local_ip_for_outbound_sockets=127.7.200.193
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:35497
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:41441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:28.717141 14111 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:28.717468 14111 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:28.717574 14111 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:28.725890 14111 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:28.726024 14111 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:28.726154 14111 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:16:28.736474 14111 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:41441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:35497
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:28.737926 14111 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:28.739333 14111 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:28.757297 14118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:28.757295 14121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:28.757296 14119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:28.758680 14111 server_base.cc:1034] running on GCE node
I20260807 04:16:28.759387 14111 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:28.760442 14111 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:28.761683 14111 hybrid_clock.cc:648] HybridClock initialized: now 1786076188761610 us; error 71 us; skew 500 ppm
I20260807 04:16:28.762058 14111 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:28 dist-test-slave-qg60 krb5kdc[13994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076188, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:28.765431 14111 init.cc:377] Logged in from keytab as kudu/127.7.200.193@KRBTEST.COM (short username kudu)
I20260807 04:16:28.766916 14111 webserver.cc:460] Webserver started at http://127.7.200.193:36879/ using document root <none> and password file <none>
I20260807 04:16:28.767637 14111 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:28.767802 14111 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:28.768149 14111 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:28.771306 14111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-0/data/instance:
uuid: "024932a8f6474060ba028a7a1d1997d5"
format_stamp: "Formatted at 2026-08-07 04:16:28 on dist-test-slave-qg60"
server_key: "6a746a046683e057d3ed634127985597"
server_key_iv: "e96a87919c7af6c539c4185d6608bb74"
server_key_version: "encryptionkey@0"
I20260807 04:16:28.772186 14111 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance:
uuid: "024932a8f6474060ba028a7a1d1997d5"
format_stamp: "Formatted at 2026-08-07 04:16:28 on dist-test-slave-qg60"
server_key: "6a746a046683e057d3ed634127985597"
server_key_iv: "e96a87919c7af6c539c4185d6608bb74"
server_key_version: "encryptionkey@0"
I20260807 04:16:28.777767 14111 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260807 04:16:28.781878 14128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:28.783420 14111 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260807 04:16:28.783614 14111 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "024932a8f6474060ba028a7a1d1997d5"
format_stamp: "Formatted at 2026-08-07 04:16:28 on dist-test-slave-qg60"
server_key: "6a746a046683e057d3ed634127985597"
server_key_iv: "e96a87919c7af6c539c4185d6608bb74"
server_key_version: "encryptionkey@0"
I20260807 04:16:28.783836 14111 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:28.814827 14111 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:28.820182 14111 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:28.820544 14111 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:28.821808 14111 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:16:28.823274 14111 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:28.823383 14111 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:28.823542 14111 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:28.823627 14111 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:28.859897 14111 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:45049
I20260807 04:16:28.860013 14253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:45049 every 8 connection(s)
I20260807 04:16:28.861317 14111 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:16:28.864701 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 14111
I20260807 04:16:28.864931 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance
I20260807 04:16:28.865872 7971 external_mini_cluster.cc:1428] Setting key 405e402e4ca9ca7df9c7496b0db27fbd
Aug 07 04:16:28 dist-test-slave-qg60 krb5kdc[13994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076188, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:16:28.884294 14256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:28.864443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:50593 (local address 127.7.200.254:35497)
0807 04:16:28.865025 (+ 582us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:28.865033 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:28.866297 (+ 1264us) server_negotiation.cc:407] Connection header received
0807 04:16:28.868512 (+ 2215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:28.868517 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:28.868610 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:28.868730 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:28.870315 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:28.871026 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:28.872796 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:28.873237 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:28.873382 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:28.877372 (+ 3990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:28.877377 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:28.877381 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:28.877421 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:28.880691 (+ 3270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:28.881503 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:28.881512 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:28.881518 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:28.881680 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:28.882254 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:28.882262 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:28.882268 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:28.882656 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:28.882822 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:28.883513 (+ 691us) server_negotiation.cc:299] Negotiation successful
0807 04:16:28.883782 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":305,"threads_started":1}
I20260807 04:16:28.885068 14257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:28.865237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35497 (local address 127.7.200.193:50593)
0807 04:16:28.866122 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:28.866163 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:28.868235 (+ 2072us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:28.869018 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:28.869026 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:28.869562 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:28.870144 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:28.870162 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:28.871217 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:28.871221 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:28.872625 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:28.872638 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:28.873489 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:28.873497 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:28.873740 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:28.874489 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:28.874515 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:28.877122 (+ 2607us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:28.880860 (+ 3738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:28.880867 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:28.880880 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:28.881352 (+ 472us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:28.881816 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:28.881820 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:28.881823 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:28.882109 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:28.882782 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:28.882788 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:28.883116 (+ 328us) client_negotiation.cc:769] Sending connection context
0807 04:16:28.883346 (+ 230us) client_negotiation.cc:240] Negotiation successful
0807 04:16:28.883812 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"thread_start_us":396,"threads_started":1}
I20260807 04:16:28.886760 14254 heartbeater.cc:347] Connected to a master server at 127.7.200.254:35497
I20260807 04:16:28.887120 14254 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:28.888140 14254 heartbeater.cc:511] Master 127.7.200.254:35497 requested a full tablet report, sending...
I20260807 04:16:28.890643 14045 ts_manager.cc:194] Registered new tserver with Master: 024932a8f6474060ba028a7a1d1997d5 (127.7.200.193:45049)
I20260807 04:16:28.892172 14045 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.193@KRBTEST.COM'} at 127.7.200.193:50593
WARNING: no policy specified for kudu/127.7.200.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
I20260807 04:16:28.928931 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:0
--local_ip_for_outbound_sockets=127.7.200.194
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:35497
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:41441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:29.310894 14260 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:29.311204 14260 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:29.311417 14260 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:29.319506 14260 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:29.319628 14260 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:29.319830 14260 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:16:29.329859 14260 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:41441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:35497
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:29.331269 14260 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:29.332629 14260 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:29.346355 14266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:29.347085 14265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:29.347085 14268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:29.347177 14260 server_base.cc:1034] running on GCE node
I20260807 04:16:29.347901 14260 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:29.348940 14260 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:29.350211 14260 hybrid_clock.cc:648] HybridClock initialized: now 1786076189350152 us; error 32 us; skew 500 ppm
I20260807 04:16:29.350577 14260 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:29 dist-test-slave-qg60 krb5kdc[13994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076189, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:29.353729 14260 init.cc:377] Logged in from keytab as kudu/127.7.200.194@KRBTEST.COM (short username kudu)
I20260807 04:16:29.355175 14260 webserver.cc:460] Webserver started at http://127.7.200.194:45337/ using document root <none> and password file <none>
I20260807 04:16:29.355875 14260 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:29.356005 14260 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:29.356348 14260 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:29.359387 14260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-1/data/instance:
uuid: "46de4a21f9e44b01b140c8346f7a047f"
format_stamp: "Formatted at 2026-08-07 04:16:29 on dist-test-slave-qg60"
server_key: "65eb51bca455dabaa381ee75c4897cc7"
server_key_iv: "7b3e1b673e48885f9d9f055694df9d25"
server_key_version: "encryptionkey@0"
I20260807 04:16:29.360188 14260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance:
uuid: "46de4a21f9e44b01b140c8346f7a047f"
format_stamp: "Formatted at 2026-08-07 04:16:29 on dist-test-slave-qg60"
server_key: "65eb51bca455dabaa381ee75c4897cc7"
server_key_iv: "7b3e1b673e48885f9d9f055694df9d25"
server_key_version: "encryptionkey@0"
I20260807 04:16:29.365471 14260 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 04:16:29.369000 14275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:29.370455 14260 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 04:16:29.370739 14260 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "46de4a21f9e44b01b140c8346f7a047f"
format_stamp: "Formatted at 2026-08-07 04:16:29 on dist-test-slave-qg60"
server_key: "65eb51bca455dabaa381ee75c4897cc7"
server_key_iv: "7b3e1b673e48885f9d9f055694df9d25"
server_key_version: "encryptionkey@0"
I20260807 04:16:29.370963 14260 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:29.384272 14260 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:29.389117 14260 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:29.389423 14260 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:29.390441 14260 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:16:29.391808 14260 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:29.391912 14260 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:29.392062 14260 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:29.392143 14260 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:29.426409 14260 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:43807
I20260807 04:16:29.426456 14397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:43807 every 8 connection(s)
I20260807 04:16:29.427953 14260 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:16:29.437848 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 14260
I20260807 04:16:29.438041 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance
I20260807 04:16:29.438616 7971 external_mini_cluster.cc:1428] Setting key 4fc17b968e7ff09089abc45feea356ed
Aug 07 04:16:29 dist-test-slave-qg60 krb5kdc[13994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076189, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:16:29.449361 14401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:29.430667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:36883 (local address 127.7.200.254:35497)
0807 04:16:29.431154 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:29.431161 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:29.432090 (+ 929us) server_negotiation.cc:407] Connection header received
0807 04:16:29.433935 (+ 1845us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:29.433940 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:29.434019 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:29.434119 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:29.435610 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:29.436409 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:29.438365 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:29.438885 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:29.438994 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:29.443231 (+ 4237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:29.443236 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:29.443239 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:29.443271 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:29.446160 (+ 2889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:29.446905 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:29.446910 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:29.446912 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:29.447042 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:29.447498 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:29.447502 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:29.447505 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:29.447782 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:29.447939 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:29.448661 (+ 722us) server_negotiation.cc:299] Negotiation successful
0807 04:16:29.448951 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":229,"threads_started":1}
I20260807 04:16:29.450418 14402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:29.431208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35497 (local address 127.7.200.194:36883)
0807 04:16:29.431937 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:29.431974 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:29.433659 (+ 1685us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:29.434344 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:29.434353 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:29.434884 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:29.435445 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:29.435461 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:29.436550 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:29.436554 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:29.438189 (+ 1635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:29.438206 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:29.439132 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:29.439140 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:29.439412 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:29.440118 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:29.440149 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:29.442990 (+ 2841us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:29.446310 (+ 3320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:29.446319 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:29.446337 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:29.446768 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:29.447160 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:29.447165 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:29.447169 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:29.447369 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:29.447912 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:29.447921 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:29.448288 (+ 367us) client_negotiation.cc:769] Sending connection context
0807 04:16:29.448553 (+ 265us) client_negotiation.cc:240] Negotiation successful
0807 04:16:29.449241 (+ 688us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":303,"threads_started":1}
I20260807 04:16:29.451993 14399 heartbeater.cc:347] Connected to a master server at 127.7.200.254:35497
I20260807 04:16:29.452349 14399 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:29.453270 14399 heartbeater.cc:511] Master 127.7.200.254:35497 requested a full tablet report, sending...
I20260807 04:16:29.454886 14045 ts_manager.cc:194] Registered new tserver with Master: 46de4a21f9e44b01b140c8346f7a047f (127.7.200.194:43807)
I20260807 04:16:29.455742 14045 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.194@KRBTEST.COM'} at 127.7.200.194:36883
WARNING: no policy specified for kudu/127.7.200.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
I20260807 04:16:29.500212 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:0
--local_ip_for_outbound_sockets=127.7.200.195
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:35497
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:41441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:29.854929 14405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:29.855257 14405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:29.855433 14405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:29.863549 14405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:29.863716 14405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:29.863925 14405 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:16:29.874156 14405 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:41441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:35497
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:29.875658 14405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:29.877138 14405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:29.890815 14410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:29.890791 14413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:29.890755 14411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:29.891574 14405 server_base.cc:1034] running on GCE node
I20260807 04:16:29.892197 14405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:29.893241 14405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:29.894495 14405 hybrid_clock.cc:648] HybridClock initialized: now 1786076189894435 us; error 60 us; skew 500 ppm
I20260807 04:16:29.894838 14405 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 04:16:29.895848 14254 heartbeater.cc:503] Master 127.7.200.254:35497 was elected leader, sending a full tablet report...
Aug 07 04:16:29 dist-test-slave-qg60 krb5kdc[13994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076189, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:29.898603 14405 init.cc:377] Logged in from keytab as kudu/127.7.200.195@KRBTEST.COM (short username kudu)
I20260807 04:16:29.900130 14405 webserver.cc:460] Webserver started at http://127.7.200.195:39649/ using document root <none> and password file <none>
I20260807 04:16:29.900892 14405 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:29.901042 14405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:29.901372 14405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:29.904480 14405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-2/data/instance:
uuid: "c92dede7844b4ea1b5bf88a5b4c07e55"
format_stamp: "Formatted at 2026-08-07 04:16:29 on dist-test-slave-qg60"
server_key: "92db9fcc132ab04c2b7a7b0e2dadefe6"
server_key_iv: "2156f5dcb0a59f66df5e1b794d775631"
server_key_version: "encryptionkey@0"
I20260807 04:16:29.905400 14405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance:
uuid: "c92dede7844b4ea1b5bf88a5b4c07e55"
format_stamp: "Formatted at 2026-08-07 04:16:29 on dist-test-slave-qg60"
server_key: "92db9fcc132ab04c2b7a7b0e2dadefe6"
server_key_iv: "2156f5dcb0a59f66df5e1b794d775631"
server_key_version: "encryptionkey@0"
I20260807 04:16:29.910645 14405 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 04:16:29.914088 14420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:29.915452 14405 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:16:29.915634 14405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "c92dede7844b4ea1b5bf88a5b4c07e55"
format_stamp: "Formatted at 2026-08-07 04:16:29 on dist-test-slave-qg60"
server_key: "92db9fcc132ab04c2b7a7b0e2dadefe6"
server_key_iv: "2156f5dcb0a59f66df5e1b794d775631"
server_key_version: "encryptionkey@0"
I20260807 04:16:29.915845 14405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:29.931351 14405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:29.935393 14405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:29.935699 14405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:29.936683 14405 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:16:29.938477 14405 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:29.938563 14405 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:29.938735 14405 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:29.938799 14405 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:29.974695 14405 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:34863
I20260807 04:16:29.974723 14539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:34863 every 8 connection(s)
I20260807 04:16:29.976197 14405 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:16:29.977385 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 14405
I20260807 04:16:29.977589 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance
I20260807 04:16:29.978163 7971 external_mini_cluster.cc:1428] Setting key b8f1b5e639009a66015051240787c5cc
Aug 07 04:16:29 dist-test-slave-qg60 krb5kdc[13994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076189, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:16:29.998100 14542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:29.979353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:54791 (local address 127.7.200.254:35497)
0807 04:16:29.979937 (+ 584us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:29.979943 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:29.981161 (+ 1218us) server_negotiation.cc:407] Connection header received
0807 04:16:29.983108 (+ 1947us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:29.983112 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:29.983185 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:29.983274 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:29.984809 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:29.985599 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:29.987295 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:29.987684 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:29.987779 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:29.991522 (+ 3743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:29.991527 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:29.991530 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:29.991563 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:29.994979 (+ 3416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:29.995746 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:29.995750 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:29.995752 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:29.995888 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:29.996375 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:29.996394 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:29.996404 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:29.996691 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:29.996909 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:29.997642 (+ 733us) server_negotiation.cc:299] Negotiation successful
0807 04:16:29.997823 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":458,"thread_start_us":325,"threads_started":1}
I20260807 04:16:29.999125 14544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:29.980082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35497 (local address 127.7.200.195:54791)
0807 04:16:29.980996 (+ 914us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:29.981045 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:29.982851 (+ 1806us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:29.983489 (+ 638us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:29.983497 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:29.984078 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:29.984610 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:29.984627 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:29.985773 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:29.985777 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:29.987166 (+ 1389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:29.987178 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:29.987879 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:29.987883 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:29.988211 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:29.988969 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:29.988991 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:29.991306 (+ 2315us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:29.995146 (+ 3840us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:29.995153 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:29.995167 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:29.995620 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:29.996039 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:29.996042 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:29.996045 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:29.996259 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:29.996873 (+ 614us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:29.996879 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:29.997264 (+ 385us) client_negotiation.cc:769] Sending connection context
0807 04:16:29.997516 (+ 252us) client_negotiation.cc:240] Negotiation successful
0807 04:16:29.997939 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"thread_start_us":341,"threads_started":1}
I20260807 04:16:30.000880 14540 heartbeater.cc:347] Connected to a master server at 127.7.200.254:35497
I20260807 04:16:30.001209 14540 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:30.002038 14540 heartbeater.cc:511] Master 127.7.200.254:35497 requested a full tablet report, sending...
I20260807 04:16:30.003794 14045 ts_manager.cc:194] Registered new tserver with Master: c92dede7844b4ea1b5bf88a5b4c07e55 (127.7.200.195:34863)
I20260807 04:16:30.004669 14045 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.195@KRBTEST.COM'} at 127.7.200.195:54791
I20260807 04:16:30.007117 7971 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/test-admin.keytab.
Aug 07 04:16:30 dist-test-slave-qg60 krb5kdc[13994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:30.040722 7971 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260807 04:16:30.046710 14550 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:16:30.044058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52880 (local address 127.7.200.193:45049)
0807 04:16:30.044808 (+ 750us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:30.044824 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:30.044851 (+ 27us) server_negotiation.cc:407] Connection header received
0807 04:16:30.044916 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:30.044923 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:30.045155 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:30.045285 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:30.046214 (+ 929us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52880: BlockingRecv error: recv got EOF from 127.0.0.1:52880 (error 108)
Metrics: {"server-negotiator.queue_time_us":504,"thread_start_us":357,"threads_started":1}
W20260807 04:16:30.047446 7971 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/krb5cc)
Aug 07 04:16:30 dist-test-slave-qg60 krb5kdc[13994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:30.049239 7971 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 04:16:30 dist-test-slave-qg60 krb5kdc[13994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:30.050788 7971 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 04:16:30 dist-test-slave-qg60 krb5kdc[13994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.193@KRBTEST.COM
I20260807 04:16:30.067011 14550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:30.052456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52886 (local address 127.7.200.193:45049)
0807 04:16:30.052672 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:30.052679 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:30.052904 (+ 225us) server_negotiation.cc:407] Connection header received
0807 04:16:30.053059 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:30.053062 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:30.053158 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:30.053239 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:30.054301 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:30.055281 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:30.056480 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:30.057214 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:30.057332 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:30.061248 (+ 3916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:30.061262 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:30.061276 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:30.061310 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:30.064196 (+ 2886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:30.064998 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:30.065006 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:30.065008 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:30.065145 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:30.065485 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:30.065489 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:30.065491 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:30.065855 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:30.066103 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:30.066420 (+ 317us) server_negotiation.cc:299] Negotiation successful
0807 04:16:30.066700 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
W20260807 04:16:30.073315 14550 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:16:30.071398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52894 (local address 127.7.200.193:45049)
0807 04:16:30.071652 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:30.071657 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:30.071872 (+ 215us) server_negotiation.cc:407] Connection header received
0807 04:16:30.071973 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:30.071977 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:30.072043 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:30.072124 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:30.073046 (+ 922us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52894: BlockingRecv error: recv got EOF from 127.0.0.1:52894 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
W20260807 04:16:30.073329 7971 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/krb5cc' of type FILE
Aug 07 04:16:30 dist-test-slave-qg60 krb5kdc[13994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:30.075085 7971 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 04:16:30 dist-test-slave-qg60 krb5kdc[13994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:30.076571 7971 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 04:16:30 dist-test-slave-qg60 krb5kdc[13994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.193@KRBTEST.COM
I20260807 04:16:30.091642 14550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:30.078202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52902 (local address 127.7.200.193:45049)
0807 04:16:30.078459 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:30.078465 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:30.078620 (+ 155us) server_negotiation.cc:407] Connection header received
0807 04:16:30.078824 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:30.078829 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:30.078894 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:30.079010 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:30.080024 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:30.080818 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:30.082052 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:30.082483 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:30.082618 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:30.086484 (+ 3866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:30.086489 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:30.086492 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:30.086535 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:30.089426 (+ 2891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:30.090041 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:30.090045 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:30.090047 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:30.090179 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:30.090524 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:30.090527 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:30.090529 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:30.090790 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:30.091023 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:30.091217 (+ 194us) server_negotiation.cc:299] Negotiation successful
0807 04:16:30.091383 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260807 04:16:30.096321 14550 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:16:30.094337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52904 (local address 127.7.200.193:45049)
0807 04:16:30.094536 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:30.094543 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:30.094831 (+ 288us) server_negotiation.cc:407] Connection header received
0807 04:16:30.095063 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:30.095067 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:30.095133 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:30.095234 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:30.096091 (+ 857us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52904: BlockingRecv error: recv got EOF from 127.0.0.1:52904 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260807 04:16:30.096562 7971 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786076137270840-7971-0/krb5kdc/krb5cc' of type FILE
Aug 07 04:16:30 dist-test-slave-qg60 krb5kdc[13994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:30.098151 7971 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 04:16:30 dist-test-slave-qg60 krb5kdc[13994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:30.099400 7971 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 04:16:30 dist-test-slave-qg60 krb5kdc[13994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.193@KRBTEST.COM
I20260807 04:16:30.114317 14550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:30.100625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52916 (local address 127.7.200.193:45049)
0807 04:16:30.100855 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:30.100863 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:30.101211 (+ 348us) server_negotiation.cc:407] Connection header received
0807 04:16:30.101397 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:30.101401 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:30.101455 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:30.101554 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:30.102461 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:30.103188 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:30.104449 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:30.105152 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:30.105301 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:30.108973 (+ 3672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:30.108978 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:30.108981 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:30.109016 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:30.111612 (+ 2596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:30.112272 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:30.112278 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:30.112282 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:30.112445 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:30.112837 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:30.112843 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:30.112847 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:30.113127 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:30.113473 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:30.113741 (+ 268us) server_negotiation.cc:299] Negotiation successful
0807 04:16:30.113997 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 04:16:30.116050 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 14111
I20260807 04:16:30.128366 14550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:30.116790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52928 (local address 127.7.200.193:45049)
0807 04:16:30.116939 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:30.116943 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:30.117391 (+ 448us) server_negotiation.cc:407] Connection header received
0807 04:16:30.117569 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:30.117574 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:30.117632 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:30.117717 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:30.118697 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:30.119518 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:30.120846 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:30.121296 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:30.121394 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:30.123494 (+ 2100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:30.123499 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:30.123502 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:30.123532 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:30.126206 (+ 2674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:30.126824 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:30.126828 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:30.126830 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:30.126961 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:30.127270 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:30.127273 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:30.127275 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:30.127519 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:30.127723 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:30.127941 (+ 218us) server_negotiation.cc:299] Negotiation successful
0807 04:16:30.128103 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 04:16:30.129108 14249 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:30.217046 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 14111
I20260807 04:16:30.236537 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 14260
Aug 07 04:16:30 dist-test-slave-qg60 krb5kdc[13994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.194@KRBTEST.COM
I20260807 04:16:30.254866 14564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:30.237548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60596 (local address 127.7.200.194:43807)
0807 04:16:30.238113 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:30.238120 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:30.238145 (+ 25us) server_negotiation.cc:407] Connection header received
0807 04:16:30.238206 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:30.238213 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:30.238435 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:30.238614 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:30.239691 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:30.240841 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:30.242204 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:30.242795 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:30.242947 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:30.247532 (+ 4585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:30.247552 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:30.247569 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:30.247613 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:30.251119 (+ 3506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:30.251996 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:30.252005 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:30.252007 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:30.252198 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:30.252710 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:30.252715 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:30.252717 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:30.253396 (+ 679us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:30.253801 (+ 405us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:30.254192 (+ 391us) server_negotiation.cc:299] Negotiation successful
0807 04:16:30.254498 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":280,"threads_started":1}
I20260807 04:16:30.256403 14393 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:30.340415 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 14260
I20260807 04:16:30.360103 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 14405
Aug 07 04:16:30 dist-test-slave-qg60 krb5kdc[13994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076190, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.195@KRBTEST.COM
I20260807 04:16:30.377490 14566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:30.361257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55998 (local address 127.7.200.195:34863)
0807 04:16:30.362024 (+ 767us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:30.362032 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:30.362065 (+ 33us) server_negotiation.cc:407] Connection header received
0807 04:16:30.362133 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:30.362140 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:30.362372 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:30.362606 (+ 234us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:30.363844 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:30.365059 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:30.366429 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:30.367055 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:30.367210 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:30.371561 (+ 4351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:30.371573 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:30.371588 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:30.371625 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:30.374791 (+ 3166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:30.375504 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:30.375512 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:30.375514 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:30.375652 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:30.376009 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:30.376012 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:30.376014 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:30.376378 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:30.376635 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:30.376966 (+ 331us) server_negotiation.cc:299] Negotiation successful
0807 04:16:30.377184 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":400,"threads_started":1}
I20260807 04:16:30.378825 14535 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:30.464366 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 14405
I20260807 04:16:30.483336 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 14009
I20260807 04:16:30.484582 14079 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:30.592244 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 14009
2026-08-07T04:16:30Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4284 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:16:30 dist-test-slave-qg60 krb5kdc[14573](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:16:30 dist-test-slave-qg60 krb5kdc[14573](info): set up 2 sockets
Aug 07 04:16:30 dist-test-slave-qg60 krb5kdc[14573](info): commencing operation
krb5kdc: starting...
W20260807 04:16:31.737709 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.001s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:16:31 dist-test-slave-qg60 krb5kdc[14573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076191, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:16:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:16:31Z Disabled control of system clock
WARNING: no policy specified for oryx/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.254.keytab.
Entry for principal oryx/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.254.keytab.
I20260807 04:16:31.996484 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:42899
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.254.keytab
--principal=oryx/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:39251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:42899
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:32.331403 14587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:32.331691 14587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:32.331780 14587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:32.338974 14587 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:16:32.339089 14587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:32.339136 14587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:32.339195 14587 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:16:32.339239 14587 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:16:32.349478 14587 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:39251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:42899
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.254.keytab
--principal=oryx/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:42899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:32.350883 14587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:32.352211 14587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:32.364522 14592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:32.364770 14593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:32.364487 14595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:32.365944 14587 server_base.cc:1034] running on GCE node
I20260807 04:16:32.366825 14587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:32.368268 14587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:32.369517 14587 hybrid_clock.cc:648] HybridClock initialized: now 1786076192369477 us; error 42 us; skew 500 ppm
I20260807 04:16:32.369877 14587 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:32 dist-test-slave-qg60 krb5kdc[14573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076192, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:32.373152 14587 init.cc:377] Logged in from keytab as oryx/127.7.200.254@KRBTEST.COM (short username oryx)
I20260807 04:16:32.374711 14587 webserver.cc:460] Webserver started at http://127.7.200.254:38385/ using document root <none> and password file <none>
I20260807 04:16:32.375366 14587 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:32.375469 14587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:32.375726 14587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:32.378839 14587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "329b3bda2cfd475ab60e1f1c7c21478b"
format_stamp: "Formatted at 2026-08-07 04:16:32 on dist-test-slave-qg60"
server_key: "d012bcdee982cece476520cee1320454"
server_key_iv: "13c62193c277fc176ea5cac1817d9b2e"
server_key_version: "encryptionkey@0"
I20260807 04:16:32.379580 14587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "329b3bda2cfd475ab60e1f1c7c21478b"
format_stamp: "Formatted at 2026-08-07 04:16:32 on dist-test-slave-qg60"
server_key: "d012bcdee982cece476520cee1320454"
server_key_iv: "13c62193c277fc176ea5cac1817d9b2e"
server_key_version: "encryptionkey@0"
I20260807 04:16:32.385057 14587 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 04:16:32.388520 14602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:32.390241 14587 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:16:32.390475 14587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "329b3bda2cfd475ab60e1f1c7c21478b"
format_stamp: "Formatted at 2026-08-07 04:16:32 on dist-test-slave-qg60"
server_key: "d012bcdee982cece476520cee1320454"
server_key_iv: "13c62193c277fc176ea5cac1817d9b2e"
server_key_version: "encryptionkey@0"
I20260807 04:16:32.390708 14587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:32.410501 14587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:32.414918 14587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:32.415256 14587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:32.434679 14587 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:42899
I20260807 04:16:32.434723 14654 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:42899 every 8 connection(s)
I20260807 04:16:32.436141 14587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:16:32.439903 14655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:32.442561 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 14587
I20260807 04:16:32.442811 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:16:32.443506 7971 external_mini_cluster.cc:1428] Setting key fa3896f4c3a8e4e46d4f0ae4cb182e7e
I20260807 04:16:32.452459 14655 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b: Bootstrap starting.
I20260807 04:16:32.456358 14655 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:32.457741 14655 log.cc:824] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b: Log is configured to *not* fsync() on all Append() calls
Aug 07 04:16:32 dist-test-slave-qg60 krb5kdc[14573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076191, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM
I20260807 04:16:32.460911 14655 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b: No bootstrap required, opened a new log
I20260807 04:16:32.469290 14658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:32.445654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59172 (local address 127.7.200.254:42899)
0807 04:16:32.446468 (+ 814us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:32.446482 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:32.446524 (+ 42us) server_negotiation.cc:407] Connection header received
0807 04:16:32.448234 (+ 1710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:32.448257 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:32.448676 (+ 419us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:32.449112 (+ 436us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:32.451039 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:32.452317 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:32.454113 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:32.454800 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:32.454949 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:32.460171 (+ 5222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:32.460179 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:32.460193 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:32.460227 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:32.464321 (+ 4094us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:32.465186 (+ 865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:32.465195 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:32.465205 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:32.465416 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:32.465825 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:32.465830 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:32.465833 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:32.466552 (+ 719us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:32.466914 (+ 362us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:32.467287 (+ 373us) server_negotiation.cc:299] Negotiation successful
0807 04:16:32.467786 (+ 499us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":606,"thread_start_us":396,"threads_started":1}
I20260807 04:16:32.471467 14655 raft_consensus.cc:348] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } }
I20260807 04:16:32.471848 14655 raft_consensus.cc:374] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:32.471976 14655 raft_consensus.cc:729] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 329b3bda2cfd475ab60e1f1c7c21478b, State: Initialized, Role: FOLLOWER
I20260807 04:16:32.472541 14655 consensus_queue.cc:260] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } }
I20260807 04:16:32.472813 14655 raft_consensus.cc:388] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:16:32.472972 14655 raft_consensus.cc:482] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:16:32.473153 14655 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:32.475292 14655 raft_consensus.cc:504] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } }
I20260807 04:16:32.475788 14655 leader_election.cc:302] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 329b3bda2cfd475ab60e1f1c7c21478b; no voters:
I20260807 04:16:32.476480 14655 leader_election.cc:288] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:16:32.476660 14661 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:16:32.477574 14661 raft_consensus.cc:686] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [term 1 LEADER]: Becoming Leader. State: Replica: 329b3bda2cfd475ab60e1f1c7c21478b, State: Running, Role: LEADER
I20260807 04:16:32.478122 14661 consensus_queue.cc:237] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } }
I20260807 04:16:32.478816 14655 sys_catalog.cc:564] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:16:32.481001 14662 sys_catalog.cc:455] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } }
I20260807 04:16:32.481482 14662 sys_catalog.cc:458] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:32.481626 14663 sys_catalog.cc:455] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 329b3bda2cfd475ab60e1f1c7c21478b. Latest consensus state: current_term: 1 leader_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } }
I20260807 04:16:32.481935 14663 sys_catalog.cc:458] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:32.483498 14670 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:16:32.490020 14670 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:16:32.504793 14670 catalog_manager.cc:1347] Generated new cluster ID: 1c650dcb40a341629501662a324e1a80
I20260807 04:16:32.504927 14670 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:16:32.521423 14670 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:16:32.523433 14670 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:16:32.531342 14670 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b: Generated new TSK 0
I20260807 04:16:32.532482 14670 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.7.200.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.200.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.200.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.193.keytab.
Entry for principal oryx/127.7.200.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.193.keytab.
I20260807 04:16:32.609104 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:0
--local_ip_for_outbound_sockets=127.7.200.193
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:42899
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.193.keytab
--principal=oryx/127.7.200.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:39251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:32.958323 14683 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:32.958668 14683 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:32.958858 14683 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:32.966493 14683 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:32.966666 14683 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:32.966842 14683 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:16:32.977188 14683 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:39251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.193.keytab
--principal=oryx/127.7.200.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:42899
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:32.978586 14683 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:32.980047 14683 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:32.994199 14691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:32.994287 14689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:32.994248 14688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:32.994539 14683 server_base.cc:1034] running on GCE node
I20260807 04:16:32.995594 14683 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:32.996676 14683 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:32.997937 14683 hybrid_clock.cc:648] HybridClock initialized: now 1786076192997890 us; error 45 us; skew 500 ppm
I20260807 04:16:32.998318 14683 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:32 dist-test-slave-qg60 krb5kdc[14573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076192, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:33.001637 14683 init.cc:377] Logged in from keytab as oryx/127.7.200.193@KRBTEST.COM (short username oryx)
I20260807 04:16:33.003255 14683 webserver.cc:460] Webserver started at http://127.7.200.193:43385/ using document root <none> and password file <none>
I20260807 04:16:33.004010 14683 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:33.004163 14683 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:33.004494 14683 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:33.007761 14683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/data/instance:
uuid: "a4aff80e488846ed881d6b55607b03d5"
format_stamp: "Formatted at 2026-08-07 04:16:33 on dist-test-slave-qg60"
server_key: "3c6e647e55e7f49fc046e0fc48603e68"
server_key_iv: "c2a82c4480d220e4b8f6ade910b81e65"
server_key_version: "encryptionkey@0"
I20260807 04:16:33.008620 14683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance:
uuid: "a4aff80e488846ed881d6b55607b03d5"
format_stamp: "Formatted at 2026-08-07 04:16:33 on dist-test-slave-qg60"
server_key: "3c6e647e55e7f49fc046e0fc48603e68"
server_key_iv: "c2a82c4480d220e4b8f6ade910b81e65"
server_key_version: "encryptionkey@0"
I20260807 04:16:33.014304 14683 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260807 04:16:33.018226 14698 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:33.019675 14683 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:16:33.019871 14683 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "a4aff80e488846ed881d6b55607b03d5"
format_stamp: "Formatted at 2026-08-07 04:16:33 on dist-test-slave-qg60"
server_key: "3c6e647e55e7f49fc046e0fc48603e68"
server_key_iv: "c2a82c4480d220e4b8f6ade910b81e65"
server_key_version: "encryptionkey@0"
I20260807 04:16:33.020099 14683 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:33.049417 14683 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:33.053532 14683 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:33.053848 14683 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:33.054863 14683 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:16:33.056293 14683 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:33.056399 14683 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:33.056559 14683 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:33.056643 14683 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:33.091334 14683 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:43769
I20260807 04:16:33.091382 14815 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:43769 every 8 connection(s)
I20260807 04:16:33.092700 14683 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:16:33.099838 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 14683
I20260807 04:16:33.100075 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance
I20260807 04:16:33.100837 7971 external_mini_cluster.cc:1428] Setting key 16444e547fcddeb5ea6ccad6624a1442
Aug 07 04:16:33 dist-test-slave-qg60 krb5kdc[14573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076192, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM
I20260807 04:16:33.114334 14818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:33.095445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:41291 (local address 127.7.200.254:42899)
0807 04:16:33.095983 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:33.095987 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:33.097030 (+ 1043us) server_negotiation.cc:407] Connection header received
0807 04:16:33.099533 (+ 2503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:33.099539 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:33.099651 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:33.099778 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:33.101470 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:33.102367 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:33.104033 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:33.104457 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:33.104617 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:33.108331 (+ 3714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:33.108336 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:33.108339 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:33.108375 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:33.111100 (+ 2725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:33.111885 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:33.111891 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:33.111894 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:33.112018 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:33.112469 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:33.112481 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:33.112483 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:33.112814 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:33.112983 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:33.113704 (+ 721us) server_negotiation.cc:299] Negotiation successful
0807 04:16:33.113944 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":240,"threads_started":1}
I20260807 04:16:33.115383 14819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:33.096090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.7.200.193:41291)
0807 04:16:33.096871 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:33.096918 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:33.099217 (+ 2299us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:33.100038 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:33.100047 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:33.100595 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:33.101287 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:33.101306 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:33.102563 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:33.102567 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:33.103867 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:33.103880 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:33.104707 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:33.104716 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:33.104999 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:33.105732 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:33.105757 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:33.108074 (+ 2317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:33.111281 (+ 3207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:33.111291 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:33.111312 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:33.111747 (+ 435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:33.112138 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:33.112143 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:33.112147 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:33.112344 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:33.112942 (+ 598us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:33.112951 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:33.113324 (+ 373us) client_negotiation.cc:769] Sending connection context
0807 04:16:33.113592 (+ 268us) client_negotiation.cc:240] Negotiation successful
0807 04:16:33.114168 (+ 576us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":317,"threads_started":1}
I20260807 04:16:33.117125 14816 heartbeater.cc:347] Connected to a master server at 127.7.200.254:42899
I20260807 04:16:33.117443 14816 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:33.118170 14816 heartbeater.cc:511] Master 127.7.200.254:42899 requested a full tablet report, sending...
I20260807 04:16:33.120705 14620 ts_manager.cc:194] Registered new tserver with Master: a4aff80e488846ed881d6b55607b03d5 (127.7.200.193:43769)
I20260807 04:16:33.122969 14620 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.200.193@KRBTEST.COM'} at 127.7.200.193:41291
WARNING: no policy specified for oryx/127.7.200.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.200.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.200.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.194.keytab.
Entry for principal oryx/127.7.200.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.194.keytab.
I20260807 04:16:33.160185 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:0
--local_ip_for_outbound_sockets=127.7.200.194
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:42899
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.194.keytab
--principal=oryx/127.7.200.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:39251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:33.514600 14822 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:33.514998 14822 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:33.515138 14822 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:33.523161 14822 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:33.523289 14822 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:33.523485 14822 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:16:33.534538 14822 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:39251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.194.keytab
--principal=oryx/127.7.200.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:42899
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:33.536088 14822 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:33.537533 14822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:33.551995 14829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:33.552059 14828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:33.552349 14822 server_base.cc:1034] running on GCE node
W20260807 04:16:33.552035 14831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:33.553400 14822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:33.554437 14822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:33.555711 14822 hybrid_clock.cc:648] HybridClock initialized: now 1786076193555619 us; error 39 us; skew 500 ppm
I20260807 04:16:33.556103 14822 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:33 dist-test-slave-qg60 krb5kdc[14573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076193, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:33.565235 14822 init.cc:377] Logged in from keytab as oryx/127.7.200.194@KRBTEST.COM (short username oryx)
I20260807 04:16:33.566912 14822 webserver.cc:460] Webserver started at http://127.7.200.194:43013/ using document root <none> and password file <none>
I20260807 04:16:33.567628 14822 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:33.567732 14822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:33.567994 14822 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:33.571099 14822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/data/instance:
uuid: "4f08b06a155a4b898d4315ec68eb738f"
format_stamp: "Formatted at 2026-08-07 04:16:33 on dist-test-slave-qg60"
server_key: "a3413370c725b16dd0209b0386a6c1e2"
server_key_iv: "41ae0bc6176445db56ae75e5377e7656"
server_key_version: "encryptionkey@0"
I20260807 04:16:33.571828 14822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance:
uuid: "4f08b06a155a4b898d4315ec68eb738f"
format_stamp: "Formatted at 2026-08-07 04:16:33 on dist-test-slave-qg60"
server_key: "a3413370c725b16dd0209b0386a6c1e2"
server_key_iv: "41ae0bc6176445db56ae75e5377e7656"
server_key_version: "encryptionkey@0"
I20260807 04:16:33.577309 14822 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 04:16:33.581287 14838 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:33.582867 14822 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 04:16:33.583034 14822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "4f08b06a155a4b898d4315ec68eb738f"
format_stamp: "Formatted at 2026-08-07 04:16:33 on dist-test-slave-qg60"
server_key: "a3413370c725b16dd0209b0386a6c1e2"
server_key_iv: "41ae0bc6176445db56ae75e5377e7656"
server_key_version: "encryptionkey@0"
I20260807 04:16:33.583243 14822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:33.600648 14822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:33.604717 14822 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:33.605067 14822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:33.606029 14822 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:16:33.607491 14822 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:33.607604 14822 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:33.607762 14822 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:33.607836 14822 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:33.644433 14822 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:41457
I20260807 04:16:33.644520 14959 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:41457 every 8 connection(s)
I20260807 04:16:33.645802 14822 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:16:33.647835 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 14822
I20260807 04:16:33.648030 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance
I20260807 04:16:33.648551 7971 external_mini_cluster.cc:1428] Setting key 896b195aed0f9b47fa0ab129ac8cebc8
Aug 07 04:16:33 dist-test-slave-qg60 krb5kdc[14573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076193, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM
I20260807 04:16:33.668435 14962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:33.648701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:37253 (local address 127.7.200.254:42899)
0807 04:16:33.649311 (+ 610us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:33.649319 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:33.650355 (+ 1036us) server_negotiation.cc:407] Connection header received
0807 04:16:33.652382 (+ 2027us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:33.652387 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:33.652473 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:33.652604 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:33.654150 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:33.654875 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:33.656466 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:33.656976 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:33.657110 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:33.661142 (+ 4032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:33.661147 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:33.661150 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:33.661182 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:33.664705 (+ 3523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:33.665507 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:33.665515 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:33.665522 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:33.665691 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:33.666211 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:33.666219 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:33.666224 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:33.666684 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:33.666841 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:33.667657 (+ 816us) server_negotiation.cc:299] Negotiation successful
0807 04:16:33.667936 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":479,"thread_start_us":339,"threads_started":1}
I20260807 04:16:33.669209 14963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:33.649417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.7.200.194:37253)
0807 04:16:33.650189 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:33.650238 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:33.652114 (+ 1876us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:33.652872 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:33.652881 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:33.653409 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:33.653973 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:33.653990 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:33.655061 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:33.655065 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:33.656296 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:33.656308 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:33.657216 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:33.657223 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:33.657465 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:33.658191 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:33.658213 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:33.660895 (+ 2682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:33.664883 (+ 3988us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:33.664890 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:33.664904 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:33.665353 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:33.665806 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:33.665809 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:33.665811 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:33.666077 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:33.666827 (+ 750us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:33.666833 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:33.667246 (+ 413us) client_negotiation.cc:769] Sending connection context
0807 04:16:33.667491 (+ 245us) client_negotiation.cc:240] Negotiation successful
0807 04:16:33.667930 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":339,"threads_started":1}
I20260807 04:16:33.670820 14960 heartbeater.cc:347] Connected to a master server at 127.7.200.254:42899
I20260807 04:16:33.671167 14960 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:33.672114 14960 heartbeater.cc:511] Master 127.7.200.254:42899 requested a full tablet report, sending...
I20260807 04:16:33.674013 14620 ts_manager.cc:194] Registered new tserver with Master: 4f08b06a155a4b898d4315ec68eb738f (127.7.200.194:41457)
I20260807 04:16:33.674976 14620 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.200.194@KRBTEST.COM'} at 127.7.200.194:37253
WARNING: no policy specified for oryx/127.7.200.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.200.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.200.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.195.keytab.
Entry for principal oryx/127.7.200.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.195.keytab.
I20260807 04:16:33.712452 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:0
--local_ip_for_outbound_sockets=127.7.200.195
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:42899
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.195.keytab
--principal=oryx/127.7.200.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:39251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:34.089813 14966 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:34.090126 14966 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:34.090297 14966 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:34.098466 14966 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:34.098582 14966 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:34.098809 14966 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:16:34.108637 14966 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:39251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.195.keytab
--principal=oryx/127.7.200.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:42899
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:34.110039 14966 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:34.111429 14966 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:34.125488 14971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:34.125401 14972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:34.125875 14974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:34.126304 14966 server_base.cc:1034] running on GCE node
I20260807 04:16:34.126677 14816 heartbeater.cc:503] Master 127.7.200.254:42899 was elected leader, sending a full tablet report...
I20260807 04:16:34.127012 14966 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:34.128057 14966 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:34.129297 14966 hybrid_clock.cc:648] HybridClock initialized: now 1786076194129219 us; error 72 us; skew 500 ppm
I20260807 04:16:34.129657 14966 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:34 dist-test-slave-qg60 krb5kdc[14573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076194, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:34.133019 14966 init.cc:377] Logged in from keytab as oryx/127.7.200.195@KRBTEST.COM (short username oryx)
I20260807 04:16:34.134483 14966 webserver.cc:460] Webserver started at http://127.7.200.195:43201/ using document root <none> and password file <none>
I20260807 04:16:34.135205 14966 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:34.135352 14966 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:34.135672 14966 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:34.138720 14966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/data/instance:
uuid: "4943bc3d911b4582b9f211b84aa012a7"
format_stamp: "Formatted at 2026-08-07 04:16:34 on dist-test-slave-qg60"
server_key: "f207b8544fa4a0bcb8ad63859b7b5dbe"
server_key_iv: "e030e2107785e447a43bc514c9fb0fcd"
server_key_version: "encryptionkey@0"
I20260807 04:16:34.139593 14966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance:
uuid: "4943bc3d911b4582b9f211b84aa012a7"
format_stamp: "Formatted at 2026-08-07 04:16:34 on dist-test-slave-qg60"
server_key: "f207b8544fa4a0bcb8ad63859b7b5dbe"
server_key_iv: "e030e2107785e447a43bc514c9fb0fcd"
server_key_version: "encryptionkey@0"
I20260807 04:16:34.145165 14966 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 04:16:34.149256 14982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:34.150719 14966 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 04:16:34.150943 14966 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "4943bc3d911b4582b9f211b84aa012a7"
format_stamp: "Formatted at 2026-08-07 04:16:34 on dist-test-slave-qg60"
server_key: "f207b8544fa4a0bcb8ad63859b7b5dbe"
server_key_iv: "e030e2107785e447a43bc514c9fb0fcd"
server_key_version: "encryptionkey@0"
I20260807 04:16:34.151183 14966 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:34.163617 14966 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:34.167879 14966 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:34.168216 14966 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:34.169377 14966 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:16:34.170944 14966 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:34.171048 14966 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:34.171201 14966 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:34.171273 14966 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:34.207952 14966 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:46477
I20260807 04:16:34.207990 15107 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:46477 every 8 connection(s)
I20260807 04:16:34.209326 14966 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:16:34.212441 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 14966
I20260807 04:16:34.212647 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance
I20260807 04:16:34.213286 7971 external_mini_cluster.cc:1428] Setting key d82d927e658e8a96928749afb1517794
Aug 07 04:16:34 dist-test-slave-qg60 krb5kdc[14573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076194, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM
I20260807 04:16:34.231732 15110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:34.212371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:40601 (local address 127.7.200.254:42899)
0807 04:16:34.212899 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:34.212903 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:34.214252 (+ 1349us) server_negotiation.cc:407] Connection header received
0807 04:16:34.216365 (+ 2113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:34.216371 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:34.216505 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:34.216640 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:34.218194 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:34.219095 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:34.220903 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:34.221328 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:34.221474 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:34.225164 (+ 3690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:34.225169 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:34.225172 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:34.225206 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:34.228443 (+ 3237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:34.229283 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:34.229288 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:34.229292 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:34.229432 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:34.229893 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:34.229898 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:34.229901 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:34.230179 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:34.230354 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:34.231095 (+ 741us) server_negotiation.cc:299] Negotiation successful
0807 04:16:34.231316 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":280,"threads_started":1}
I20260807 04:16:34.232875 15111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:34.213125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.7.200.195:40601)
0807 04:16:34.214028 (+ 903us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:34.214105 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:34.216096 (+ 1991us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:34.216930 (+ 834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:34.216938 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:34.217470 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:34.218016 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:34.218033 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:34.219275 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:34.219280 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:34.220753 (+ 1473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:34.220768 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:34.221549 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:34.221555 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:34.221755 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:34.222408 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:34.222430 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:34.224930 (+ 2500us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:34.228585 (+ 3655us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:34.228594 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:34.228611 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:34.229149 (+ 538us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:34.229552 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:34.229557 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:34.229560 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:34.229766 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:34.230322 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:34.230331 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:34.230706 (+ 375us) client_negotiation.cc:769] Sending connection context
0807 04:16:34.230998 (+ 292us) client_negotiation.cc:240] Negotiation successful
0807 04:16:34.231541 (+ 543us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"thread_start_us":389,"threads_started":1}
I20260807 04:16:34.234481 15108 heartbeater.cc:347] Connected to a master server at 127.7.200.254:42899
I20260807 04:16:34.234854 15108 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:34.235736 15108 heartbeater.cc:511] Master 127.7.200.254:42899 requested a full tablet report, sending...
I20260807 04:16:34.237438 14620 ts_manager.cc:194] Registered new tserver with Master: 4943bc3d911b4582b9f211b84aa012a7 (127.7.200.195:46477)
I20260807 04:16:34.238368 14620 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.200.195@KRBTEST.COM'} at 127.7.200.195:40601
I20260807 04:16:34.242112 7971 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.7.200.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.200.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.200.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.253.keytab.
Entry for principal oryx/127.7.200.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.253.keytab.
I20260807 04:16:34.305231 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.253:40319
--webserver_interface=127.7.200.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.253.keytab
--principal=oryx/127.7.200.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:39251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:42899,127.7.200.253:40319
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:34.648561 15114 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:34.648996 15114 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:34.649171 15114 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:34.656893 15114 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:16:34.657032 15114 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:34.657145 15114 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:34.657248 15114 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:16:34.657323 15114 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:16:34.667410 15114 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:39251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:42899,127.7.200.253:40319
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.253.keytab
--principal=oryx/127.7.200.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.253:40319
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.200.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
W20260807 04:16:34.667832 15114 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.7.200.254:42899,127.7.200.253:40319'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 04:16:34.669008 15114 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:34.670356 15114 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 04:16:34.678151 14960 heartbeater.cc:503] Master 127.7.200.254:42899 was elected leader, sending a full tablet report...
W20260807 04:16:34.682991 15122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:34.683035 15119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:34.683063 15120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:34.683909 15114 server_base.cc:1034] running on GCE node
I20260807 04:16:34.684680 15114 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:34.686157 15114 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:34.687448 15114 hybrid_clock.cc:648] HybridClock initialized: now 1786076194687366 us; error 47 us; skew 500 ppm
I20260807 04:16:34.687824 15114 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:34 dist-test-slave-qg60 krb5kdc[14573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076194, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:34.691066 15114 init.cc:377] Logged in from keytab as oryx/127.7.200.253@KRBTEST.COM (short username oryx)
I20260807 04:16:34.692453 15114 webserver.cc:460] Webserver started at http://127.7.200.253:44133/ using document root <none> and password file <none>
I20260807 04:16:34.693197 15114 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:34.693322 15114 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:34.693660 15114 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:34.696859 15114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-1/data/instance:
uuid: "56fb5f1c90f44bafb30c535276eefd83"
format_stamp: "Formatted at 2026-08-07 04:16:34 on dist-test-slave-qg60"
server_key: "fac8297e220f0150e457e4c2675d6d8a"
server_key_iv: "6e63c2866a2f2fcf38f84a6bb78a163f"
server_key_version: "encryptionkey@0"
I20260807 04:16:34.697659 15114 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-1/wal/instance:
uuid: "56fb5f1c90f44bafb30c535276eefd83"
format_stamp: "Formatted at 2026-08-07 04:16:34 on dist-test-slave-qg60"
server_key: "fac8297e220f0150e457e4c2675d6d8a"
server_key_iv: "6e63c2866a2f2fcf38f84a6bb78a163f"
server_key_version: "encryptionkey@0"
I20260807 04:16:34.702732 15114 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260807 04:16:34.706187 15129 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:34.707489 15114 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260807 04:16:34.707679 15114 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-1/wal
uuid: "56fb5f1c90f44bafb30c535276eefd83"
format_stamp: "Formatted at 2026-08-07 04:16:34 on dist-test-slave-qg60"
server_key: "fac8297e220f0150e457e4c2675d6d8a"
server_key_iv: "6e63c2866a2f2fcf38f84a6bb78a163f"
server_key_version: "encryptionkey@0"
I20260807 04:16:34.707921 15114 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:34.733155 15114 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:34.737304 15114 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:34.737658 15114 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:34.759943 15114 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.253:40319
I20260807 04:16:34.759950 15187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.253:40319 every 8 connection(s)
I20260807 04:16:34.761372 15114 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-1/data/info.pb
I20260807 04:16:34.765288 15188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:34.771289 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 15114
I20260807 04:16:34.771905 15188 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 04:16:34 dist-test-slave-qg60 krb5kdc[14573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076194, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.253@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM
Aug 07 04:16:34 dist-test-slave-qg60 krb5kdc[14573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076191, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.200.253@KRBTEST.COM
I20260807 04:16:34.793800 15193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:34.774838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38168 (local address 127.7.200.254:42899)
0807 04:16:34.775417 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:34.775422 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:34.775634 (+ 212us) server_negotiation.cc:407] Connection header received
0807 04:16:34.777265 (+ 1631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:34.777271 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:34.777370 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:34.777476 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:34.779388 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:34.780588 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:34.782881 (+ 2293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:34.783344 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:34.783498 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:34.787199 (+ 3701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:34.787204 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:34.787207 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:34.787282 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:34.790624 (+ 3342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:34.791392 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:34.791398 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:34.791401 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:34.791531 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:34.791967 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:34.791972 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:34.791976 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:34.792304 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:34.792461 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:34.793221 (+ 760us) server_negotiation.cc:299] Negotiation successful
0807 04:16:34.793447 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":490,"thread_start_us":381,"threads_started":1}
I20260807 04:16:34.794911 15191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:34.773670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46322 (local address 127.7.200.253:40319)
0807 04:16:34.774435 (+ 765us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:34.774448 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:34.774500 (+ 52us) server_negotiation.cc:407] Connection header received
0807 04:16:34.776952 (+ 2452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:34.776972 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:34.777242 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:34.777460 (+ 218us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:34.779656 (+ 2196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:34.781299 (+ 1643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:34.783284 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:34.783999 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:34.784158 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:34.788927 (+ 4769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:34.788935 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:34.788946 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:34.788980 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:34.791781 (+ 2801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:34.792473 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:34.792480 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:34.792482 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:34.792610 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:34.793042 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:34.793051 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:34.793053 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:34.793349 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:34.793678 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:34.794009 (+ 331us) server_negotiation.cc:299] Negotiation successful
0807 04:16:34.794255 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":566,"thread_start_us":379,"threads_started":1}
I20260807 04:16:34.794940 15192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:34.774775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.0.0.1:38168)
0807 04:16:34.775489 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:34.775537 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:34.776976 (+ 1439us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:34.777572 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:34.777581 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:34.778582 (+ 1001us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:34.779197 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:34.779223 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:34.780823 (+ 1600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:34.780827 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:34.782733 (+ 1906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:34.782749 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:34.783638 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:34.783646 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:34.783959 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:34.784708 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:34.784772 (+ 64us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:34.786999 (+ 2227us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:34.790751 (+ 3752us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:34.790764 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:34.790776 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:34.791267 (+ 491us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:34.791656 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:34.791660 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:34.791664 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:34.791848 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:34.792433 (+ 585us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:34.792440 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:34.792850 (+ 410us) client_negotiation.cc:769] Sending connection context
0807 04:16:34.793128 (+ 278us) client_negotiation.cc:240] Negotiation successful
0807 04:16:34.793630 (+ 502us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"mutex_wait_us":56,"thread_start_us":354,"threads_started":1}
I20260807 04:16:34.797832 15188 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 04:16:34 dist-test-slave-qg60 krb5kdc[14573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076194, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.253@KRBTEST.COM for oryx/127.7.200.253@KRBTEST.COM
I20260807 04:16:34.810068 15192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:34.798672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:40319 (local address 127.0.0.1:46332)
0807 04:16:34.798873 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:34.798888 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:34.798976 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:34.799242 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:34.799245 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:34.799575 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:34.799730 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:34.799738 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:34.800693 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:34.800697 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:34.801618 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:34.801638 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:34.802256 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:34.802260 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:34.802391 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:34.802932 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:34.802949 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:34.805032 (+ 2083us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:34.807953 (+ 2921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:34.807957 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:34.807959 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:34.808312 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:34.808604 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:34.808607 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:34.808609 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:34.808806 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:34.809316 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:34.809319 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:34.809439 (+ 120us) client_negotiation.cc:769] Sending connection context
0807 04:16:34.809544 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 04:16:34.809787 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260807 04:16:34.810189 15191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:34.798737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46332 (local address 127.7.200.253:40319)
0807 04:16:34.798919 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:34.798923 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:34.798937 (+ 14us) server_negotiation.cc:407] Connection header received
0807 04:16:34.799069 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:34.799072 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:34.799127 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:34.799199 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:34.799847 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:34.800542 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:34.801757 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:34.802135 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:34.802227 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:34.805197 (+ 2970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:34.805201 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:34.805204 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:34.805232 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:34.807838 (+ 2606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:34.808407 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:34.808410 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:34.808413 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:34.808514 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:34.808896 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:34.808899 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:34.808901 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:34.809194 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:34.809306 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:34.809668 (+ 362us) server_negotiation.cc:299] Negotiation successful
0807 04:16:34.809890 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":56,"server-negotiator.queue_time_us":65}
I20260807 04:16:34.815182 15188 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83: Bootstrap starting.
I20260807 04:16:34.818243 15188 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:34.819258 15188 log.cc:824] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83: Log is configured to *not* fsync() on all Append() calls
I20260807 04:16:34.821938 15188 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83: No bootstrap required, opened a new log
I20260807 04:16:34.829252 15188 raft_consensus.cc:348] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } }
I20260807 04:16:34.829653 15188 raft_consensus.cc:374] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:34.829775 15188 raft_consensus.cc:729] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56fb5f1c90f44bafb30c535276eefd83, State: Initialized, Role: FOLLOWER
I20260807 04:16:34.830422 15188 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } }
I20260807 04:16:34.831343 15195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } } }
I20260807 04:16:34.831648 15195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 04:16:34.832366 15188 sys_catalog.cc:564] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 04:16:34.841565 15206 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 04:16:34.841732 15206 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 04:16:34.845299 15114 master_runner.cc:428] Detected that this master 56fb5f1c90f44bafb30c535276eefd83 is joining an existing cluster
I20260807 04:16:34.845422 15114 master_runner.cc:432] Initiating AddMaster RPC to add 127.7.200.253:40319
I20260807 04:16:34.867635 15191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:34.849902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46348 (local address 127.7.200.253:40319)
0807 04:16:34.850106 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:34.850114 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:34.850832 (+ 718us) server_negotiation.cc:407] Connection header received
0807 04:16:34.851060 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:34.851067 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:34.851140 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:34.851208 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:34.852814 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:34.854009 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:34.856142 (+ 2133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:34.857137 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:34.857277 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:34.860115 (+ 2838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:34.860123 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:34.860130 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:34.860170 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:34.864464 (+ 4294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:34.865336 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:34.865341 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:34.865344 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:34.865485 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:34.865978 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:34.865983 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:34.865986 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:34.866409 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:34.866567 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:34.867017 (+ 450us) server_negotiation.cc:299] Negotiation successful
0807 04:16:34.867247 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":69}
I20260807 04:16:34.868703 15212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:34.850042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:40319 (local address 127.0.0.1:46348)
0807 04:16:34.850738 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:34.850759 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:34.850931 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:34.851408 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:34.851415 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:34.852183 (+ 768us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:34.852627 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:34.852643 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:34.854284 (+ 1641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:34.854290 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:34.855950 (+ 1660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:34.855967 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:34.857543 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:34.857551 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:34.857782 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:34.858492 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:34.858520 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:34.859851 (+ 1331us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:34.864628 (+ 4777us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:34.864635 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:34.864639 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:34.865202 (+ 563us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:34.865656 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:34.865662 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:34.865667 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:34.865863 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:34.866523 (+ 660us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:34.866528 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:34.866709 (+ 181us) client_negotiation.cc:769] Sending connection context
0807 04:16:34.867877 (+ 1168us) client_negotiation.cc:240] Negotiation successful
0807 04:16:34.868149 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":6066,"threads_started":1}
I20260807 04:16:34.878702 15193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:34.850574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38174 (local address 127.7.200.254:42899)
0807 04:16:34.850784 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:34.850790 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:34.864777 (+ 13987us) server_negotiation.cc:407] Connection header received
0807 04:16:34.864979 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:34.864986 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:34.865102 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:34.865179 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:34.867109 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:34.868149 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:34.870166 (+ 2017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:34.870768 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:34.870843 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:34.872800 (+ 1957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:34.872807 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:34.872811 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:34.872852 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:34.875451 (+ 2599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:34.876557 (+ 1106us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:34.876561 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:34.876563 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:34.876699 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:34.877108 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:34.877116 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:34.877119 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:34.877441 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:34.877614 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:34.878104 (+ 490us) server_negotiation.cc:299] Negotiation successful
0807 04:16:34.878337 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260807 04:16:34.878816 15213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:34.856951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.0.0.1:38174)
0807 04:16:34.864622 (+ 7671us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:34.864640 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:34.864790 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:34.865405 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:34.865412 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:34.866110 (+ 698us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:34.866929 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:34.866941 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:34.868353 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:34.868358 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:34.869977 (+ 1619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:34.869990 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:34.871067 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:34.871072 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:34.871206 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:34.871789 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:34.871805 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:34.872538 (+ 733us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:34.875585 (+ 3047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:34.875591 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:34.875594 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:34.876140 (+ 546us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:34.876850 (+ 710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:34.876855 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:34.876858 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:34.876996 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:34.877684 (+ 688us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:34.877687 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:34.877839 (+ 152us) client_negotiation.cc:769] Sending connection context
0807 04:16:34.877988 (+ 149us) client_negotiation.cc:240] Negotiation successful
0807 04:16:34.878321 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7471,"mutex_wait_us":3,"thread_start_us":7212,"threads_started":1}
WARNING: no policy specified for oryx/127.7.200.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.200.252@KRBTEST.COM" created.
Aug 07 04:16:34 dist-test-slave-qg60 krb5kdc[14573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076192, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.254@KRBTEST.COM for oryx/127.7.200.253@KRBTEST.COM
I20260807 04:16:34.903931 15191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:34.885275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46364 (local address 127.7.200.253:40319)
0807 04:16:34.885461 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:34.885527 (+ 66us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:34.886104 (+ 577us) server_negotiation.cc:407] Connection header received
0807 04:16:34.886395 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:34.886403 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:34.886516 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:34.886620 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:34.888372 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:34.889629 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:34.891690 (+ 2061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:34.892501 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:34.892652 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:34.897703 (+ 5051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:34.897712 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:34.897720 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:34.897769 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:34.900980 (+ 3211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:34.901743 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:34.901750 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:34.901754 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:34.901902 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:34.902356 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:34.902361 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:34.902364 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:34.902662 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:34.902815 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:34.903310 (+ 495us) server_negotiation.cc:299] Negotiation successful
0807 04:16:34.903556 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 04:16:34.904034 15215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:34.885283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:40319 (local address 127.0.0.1:46364)
0807 04:16:34.885918 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:34.886017 (+ 99us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:34.886211 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:34.886850 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:34.886860 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:34.887797 (+ 937us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:34.888151 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:34.888169 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:34.889832 (+ 1663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:34.889839 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:34.891507 (+ 1668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:34.891525 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:34.892997 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:34.893003 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:34.893232 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:34.894072 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:34.894098 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:34.897438 (+ 3340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:34.901178 (+ 3740us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:34.901193 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:34.901202 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:34.901618 (+ 416us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:34.902049 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:34.902054 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:34.902058 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:34.902237 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:34.902813 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:34.902822 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:34.902996 (+ 174us) client_negotiation.cc:769] Sending connection context
0807 04:16:34.903201 (+ 205us) client_negotiation.cc:240] Negotiation successful
0807 04:16:34.903560 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":317,"threads_started":1}
I20260807 04:16:34.906191 14620 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.7.200.253:40319: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83"
member_type: NON_VOTER
last_known_addr {
host: "127.7.200.253"
port: 40319
}
attrs {
promote: true
}
}
dest_uuid: "329b3bda2cfd475ab60e1f1c7c21478b"
cas_config_opid_index: -1
I20260807 04:16:34.907186 14620 consensus_queue.cc:237] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: NON_VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: true } }
I20260807 04:16:34.917793 15218 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 56fb5f1c90f44bafb30c535276eefd83 (127.7.200.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: NON_VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: true } } }
I20260807 04:16:34.919273 15158 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:34.922802 15218 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.7.200.253:40319
I20260807 04:16:34.922938 15158 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [term 1 FOLLOWER]: Refusing update from remote peer 329b3bda2cfd475ab60e1f1c7c21478b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 04:16:34.923439 15219 sys_catalog.cc:455] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: NON_VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: true } } }
I20260807 04:16:34.923825 15219 sys_catalog.cc:458] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:34.923925 15114 master.cc:537] Master@127.7.200.253:40319 shutting down...
I20260807 04:16:34.925558 15219 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: NON_VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.002s
W20260807 04:16:34.930635 14605 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.200.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.252.keytab.
Entry for principal oryx/127.7.200.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.252.keytab.
I20260807 04:16:34.934355 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.252:46569
--webserver_interface=127.7.200.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.252.keytab
--principal=oryx/127.7.200.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:39251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:42899,127.7.200.253:40319,127.7.200.252:46569
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:34.935464 14605 consensus_peers.cc:487] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b -> Peer 56fb5f1c90f44bafb30c535276eefd83 (127.7.200.253:40319): Couldn't send request to peer 56fb5f1c90f44bafb30c535276eefd83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 04:16:34.944514 15114 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:16:34.945262 15114 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:16:34.945444 15114 tablet_replica.cc:330] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83: stopping tablet replica
I20260807 04:16:34.952930 15114 master.cc:552] Master@127.7.200.253:40319 shutdown complete.
I20260807 04:16:34.953071 15114 master_runner.cc:305] Clearing existing system tablet
I20260807 04:16:34.953634 15114 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:34.953758 15114 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:34.960409 15114 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 04:16:34.969148 15225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:34.969559 15114 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:34.970091 15114 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.002s sys 0.006s
I20260807 04:16:34.970269 15114 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-1/wal
uuid: "56fb5f1c90f44bafb30c535276eefd83"
format_stamp: "Formatted at 2026-08-07 04:16:34 on dist-test-slave-qg60"
server_key: "fac8297e220f0150e457e4c2675d6d8a"
server_key_iv: "6e63c2866a2f2fcf38f84a6bb78a163f"
server_key_version: "encryptionkey@0"
I20260807 04:16:34.975669 15114 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:16:34.983021 15114 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 04:16:34.983279 15114 log.cc:1196] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260807 04:16:34.983788 15114 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83: Deleting consensus metadata
I20260807 04:16:34.984103 15114 master_runner.cc:315] Copying system tablet from 127.7.200.254:42899
I20260807 04:16:34.993256 15114 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83: tablet copy: Beginning tablet copy session from remote peer at address 127.7.200.254:42899
I20260807 04:16:35.010812 15231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:34.994089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.0.0.1:38184)
0807 04:16:34.994828 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:34.994854 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:34.995093 (+ 239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:34.995762 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:34.995771 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:34.996375 (+ 604us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:34.996677 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:34.996691 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:34.998257 (+ 1566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:34.998262 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:34.999760 (+ 1498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:34.999775 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.000929 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.000936 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:35.001131 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:35.001885 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:35.001909 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:35.003076 (+ 1167us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:35.007627 (+ 4551us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:35.007633 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:35.007638 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:35.008209 (+ 571us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:35.008663 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:35.008668 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:35.008672 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:35.008890 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:35.009597 (+ 707us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:35.009603 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:35.009798 (+ 195us) client_negotiation.cc:769] Sending connection context
0807 04:16:35.009960 (+ 162us) client_negotiation.cc:240] Negotiation successful
0807 04:16:35.010302 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":430,"threads_started":1}
I20260807 04:16:35.011080 15193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:34.994189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38184 (local address 127.7.200.254:42899)
0807 04:16:34.994408 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:34.994414 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:34.994960 (+ 546us) server_negotiation.cc:407] Connection header received
0807 04:16:34.995288 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:34.995294 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:34.995395 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:34.995488 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:34.996910 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:34.998035 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:34.999942 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.000612 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.000744 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:35.003333 (+ 2589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:35.003339 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:35.003343 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:35.003385 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:35.007450 (+ 4065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:35.008358 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:35.008363 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:35.008367 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:35.008534 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:35.009020 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:35.009025 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:35.009028 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:35.009445 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:35.009613 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:35.010109 (+ 496us) server_negotiation.cc:299] Negotiation successful
0807 04:16:35.010425 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260807 04:16:35.012113 14640 tablet_copy_service.cc:140] P 329b3bda2cfd475ab60e1f1c7c21478b: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 56fb5f1c90f44bafb30c535276eefd83 ({username='oryx', principal='oryx/127.7.200.253@KRBTEST.COM'} at 127.0.0.1:38184)
I20260807 04:16:35.012501 14640 tablet_copy_service.cc:161] P 329b3bda2cfd475ab60e1f1c7c21478b: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 56fb5f1c90f44bafb30c535276eefd83 at {username='oryx', principal='oryx/127.7.200.253@KRBTEST.COM'} at 127.0.0.1:38184: session id = 56fb5f1c90f44bafb30c535276eefd83-00000000000000000000000000000000
I20260807 04:16:35.017879 14640 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 04:16:35.020341 15114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 04:16:35.027508 15114 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83: tablet copy: Starting download of 0 data blocks...
I20260807 04:16:35.027844 15114 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83: tablet copy: Starting download of 1 WAL segments...
I20260807 04:16:35.030857 15114 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 04:16:35.035418 14640 tablet_copy_service.cc:342] P 329b3bda2cfd475ab60e1f1c7c21478b: Request end of tablet copy session 56fb5f1c90f44bafb30c535276eefd83-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.7.200.253@KRBTEST.COM'} at 127.0.0.1:38184
I20260807 04:16:35.035640 14640 tablet_copy_service.cc:433] P 329b3bda2cfd475ab60e1f1c7c21478b: ending tablet copy session 56fb5f1c90f44bafb30c535276eefd83-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 56fb5f1c90f44bafb30c535276eefd83
I20260807 04:16:35.049310 15114 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:35.052300 15232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:35.054286 15233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:35.064926 15235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:35.065222 15114 server_base.cc:1034] running on GCE node
I20260807 04:16:35.065655 15114 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:35.066480 15114 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:35.067732 15114 hybrid_clock.cc:648] HybridClock initialized: now 1786076195067640 us; error 40 us; skew 500 ppm
I20260807 04:16:35.067967 15114 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:35 dist-test-slave-qg60 krb5kdc[14573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076195, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:35.070418 15114 init.cc:377] Logged in from keytab as oryx/127.7.200.253@KRBTEST.COM (short username oryx)
I20260807 04:16:35.071790 15114 webserver.cc:460] Webserver started at http://127.7.200.253:43667/ using document root <none> and password file <none>
I20260807 04:16:35.072158 15114 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:35.072242 15114 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:35.075500 15114 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.001s
I20260807 04:16:35.078243 15243 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:35.078830 15114 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 04:16:35.078991 15114 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-1/wal
uuid: "56fb5f1c90f44bafb30c535276eefd83"
format_stamp: "Formatted at 2026-08-07 04:16:34 on dist-test-slave-qg60"
server_key: "fac8297e220f0150e457e4c2675d6d8a"
server_key_iv: "6e63c2866a2f2fcf38f84a6bb78a163f"
server_key_version: "encryptionkey@0"
I20260807 04:16:35.079156 15114 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:35.095391 15114 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:35.099655 15114 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:35.133692 15114 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.253:40319
I20260807 04:16:35.133751 15297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.253:40319 every 8 connection(s)
I20260807 04:16:35.134729 15114 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-1/data/info.pb
I20260807 04:16:35.140823 15298 sys_catalog.cc:263] Verifying existing consensus state
I20260807 04:16:35.145268 15298 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83: Bootstrap starting.
I20260807 04:16:35.165649 15298 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 04:16:35.166416 15298 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83: Bootstrap complete.
I20260807 04:16:35.168037 15298 raft_consensus.cc:348] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: NON_VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: true } }
I20260807 04:16:35.168460 15298 raft_consensus.cc:729] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 56fb5f1c90f44bafb30c535276eefd83, State: Initialized, Role: LEARNER
I20260807 04:16:35.168895 15298 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: NON_VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: true } }
I20260807 04:16:35.169971 15301 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: NON_VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: true } } }
I20260807 04:16:35.170419 15298 sys_catalog.cc:564] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:16:35.170444 15301 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [sys.catalog]: This master's current role is: LEARNER
I20260807 04:16:35.183826 15314 catalog_manager.cc:1259] Loaded cluster ID: 1c650dcb40a341629501662a324e1a80
I20260807 04:16:35.183959 15314 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83: loading cluster ID for follower catalog manager: success
I20260807 04:16:35.187611 15314 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83: acquiring CA information for follower catalog manager: success
I20260807 04:16:35.190307 15314 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 04:16:35.241732 15108 heartbeater.cc:503] Master 127.7.200.254:42899 was elected leader, sending a full tablet report...
W20260807 04:16:35.358297 15223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:35.358588 15223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:35.358764 15223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:35.366465 15223 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:16:35.366571 15223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:35.366672 15223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:35.366770 15223 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:16:35.366847 15223 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:16:35.377563 15223 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:39251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:42899,127.7.200.253:40319,127.7.200.252:46569
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.252.keytab
--principal=oryx/127.7.200.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.252:46569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.200.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:35.379056 15223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:35.380618 15223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:35.394068 15320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:35.394177 15319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:35.394156 15322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:35.396090 15223 server_base.cc:1034] running on GCE node
I20260807 04:16:35.397014 15223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:35.398487 15223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:35.399695 15223 hybrid_clock.cc:648] HybridClock initialized: now 1786076195399653 us; error 40 us; skew 500 ppm
I20260807 04:16:35.400048 15223 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:35 dist-test-slave-qg60 krb5kdc[14573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076195, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:35.403445 15223 init.cc:377] Logged in from keytab as oryx/127.7.200.252@KRBTEST.COM (short username oryx)
I20260807 04:16:35.405097 15223 webserver.cc:460] Webserver started at http://127.7.200.252:36827/ using document root <none> and password file <none>
I20260807 04:16:35.405783 15223 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:35.405921 15223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:35.406248 15223 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:35.409327 15223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-2/data/instance:
uuid: "56970c659fbc4e81994f4331243d3151"
format_stamp: "Formatted at 2026-08-07 04:16:35 on dist-test-slave-qg60"
server_key: "8c1979fbcea19345e6249fe286b0f49a"
server_key_iv: "2f33ae9f332c489552a89068d539d0f5"
server_key_version: "encryptionkey@0"
I20260807 04:16:35.410115 15223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-2/wal/instance:
uuid: "56970c659fbc4e81994f4331243d3151"
format_stamp: "Formatted at 2026-08-07 04:16:35 on dist-test-slave-qg60"
server_key: "8c1979fbcea19345e6249fe286b0f49a"
server_key_iv: "2f33ae9f332c489552a89068d539d0f5"
server_key_version: "encryptionkey@0"
I20260807 04:16:35.415144 15223 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 04:16:35.418550 15329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:35.419821 15223 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 04:16:35.420001 15223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-2/wal
uuid: "56970c659fbc4e81994f4331243d3151"
format_stamp: "Formatted at 2026-08-07 04:16:35 on dist-test-slave-qg60"
server_key: "8c1979fbcea19345e6249fe286b0f49a"
server_key_iv: "2f33ae9f332c489552a89068d539d0f5"
server_key_version: "encryptionkey@0"
I20260807 04:16:35.420202 15223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:35.436879 15223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:35.441572 15223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:35.441877 15223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:35.462019 15223 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.252:46569
I20260807 04:16:35.462064 15383 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.252:46569 every 8 connection(s)
I20260807 04:16:35.463510 15223 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-2/data/info.pb
I20260807 04:16:35.467283 15384 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:35.471271 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 15223
I20260807 04:16:35.474788 15384 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 04:16:35 dist-test-slave-qg60 krb5kdc[14573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076191, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.200.252@KRBTEST.COM
Aug 07 04:16:35 dist-test-slave-qg60 krb5kdc[14573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076195, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.252@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM
I20260807 04:16:35.495625 15193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:35.479293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38190 (local address 127.7.200.254:42899)
0807 04:16:35.479526 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:35.479532 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:35.480353 (+ 821us) server_negotiation.cc:407] Connection header received
0807 04:16:35.480548 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:35.480554 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:35.480633 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:35.480764 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:35.481926 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.482715 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.484335 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.484808 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.484940 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:35.489181 (+ 4241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:35.489185 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:35.489188 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:35.489220 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:35.492289 (+ 3069us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:35.493187 (+ 898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:35.493191 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:35.493194 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:35.493321 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:35.493768 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:35.493771 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:35.493773 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:35.494062 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:35.494177 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:35.494988 (+ 811us) server_negotiation.cc:299] Negotiation successful
0807 04:16:35.495252 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 04:16:35.497067 15387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:35.473616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38228 (local address 127.7.200.252:46569)
0807 04:16:35.474495 (+ 879us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:35.474508 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:35.474552 (+ 44us) server_negotiation.cc:407] Connection header received
0807 04:16:35.476285 (+ 1733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:35.476308 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:35.476783 (+ 475us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:35.477205 (+ 422us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:35.479244 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.481292 (+ 2048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.482607 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.483529 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.483739 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:35.488616 (+ 4877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:35.488628 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:35.488645 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:35.488683 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:35.492418 (+ 3735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:35.493159 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:35.493170 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:35.493173 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:35.493386 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:35.493758 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:35.493766 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:35.493771 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:35.494549 (+ 778us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:35.494998 (+ 449us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:35.495265 (+ 267us) server_negotiation.cc:299] Negotiation successful
0807 04:16:35.495634 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":157,"server-negotiator.queue_time_us":616,"spinlock_wait_cycles":21888,"thread_start_us":393,"threads_started":1}
I20260807 04:16:35.497095 15388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:35.479202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.0.0.1:38190)
0807 04:16:35.480206 (+ 1004us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:35.480250 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:35.480411 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:35.480867 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:35.480872 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:35.481494 (+ 622us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:35.481767 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:35.481776 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.482874 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.482880 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:35.484198 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:35.484211 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.485049 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.485056 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:35.485227 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:35.485868 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:35.485947 (+ 79us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:35.488969 (+ 3022us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:35.492424 (+ 3455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:35.492434 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:35.492448 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:35.493058 (+ 610us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:35.493434 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:35.493441 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:35.493447 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:35.493651 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:35.494203 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:35.494211 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:35.494513 (+ 302us) client_negotiation.cc:769] Sending connection context
0807 04:16:35.494872 (+ 359us) client_negotiation.cc:240] Negotiation successful
0807 04:16:35.495442 (+ 570us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":718,"mutex_wait_us":4,"thread_start_us":571,"threads_started":1}
I20260807 04:16:35.498780 15384 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 04:16:35 dist-test-slave-qg60 krb5kdc[14573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076195, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.252@KRBTEST.COM for oryx/127.7.200.253@KRBTEST.COM
I20260807 04:16:35.512261 15388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:35.499804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:40319 (local address 127.0.0.1:46380)
0807 04:16:35.500027 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:35.500048 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:35.500175 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:35.500806 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:35.500811 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:35.501181 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:35.501316 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:35.501324 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.502608 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.502616 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:35.503540 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:35.503567 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.504280 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.504284 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:35.504421 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:35.505048 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:35.505064 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:35.507089 (+ 2025us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:35.510164 (+ 3075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:35.510169 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:35.510171 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:35.510596 (+ 425us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:35.510946 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:35.510951 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:35.510954 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:35.511087 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:35.511533 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:35.511537 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:35.511666 (+ 129us) client_negotiation.cc:769] Sending connection context
0807 04:16:35.511783 (+ 117us) client_negotiation.cc:240] Negotiation successful
0807 04:16:35.512017 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260807 04:16:35.512283 15390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:35.499796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46380 (local address 127.7.200.253:40319)
0807 04:16:35.500467 (+ 671us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:35.500472 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:35.500487 (+ 15us) server_negotiation.cc:407] Connection header received
0807 04:16:35.500534 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:35.500562 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:35.500642 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:35.500787 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:35.501459 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.502468 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.503727 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.504148 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.504252 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:35.507292 (+ 3040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:35.507297 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:35.507300 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:35.507333 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:35.510031 (+ 2698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:35.510700 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:35.510704 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:35.510706 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:35.510840 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:35.511179 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:35.511182 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:35.511184 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:35.511423 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:35.511539 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:35.511874 (+ 335us) server_negotiation.cc:299] Negotiation successful
0807 04:16:35.512029 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":554,"thread_start_us":417,"threads_started":1}
I20260807 04:16:35.513465 15384 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.252" port: 46569 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 04:16:35 dist-test-slave-qg60 krb5kdc[14573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076195, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.252@KRBTEST.COM for oryx/127.7.200.252@KRBTEST.COM
I20260807 04:16:35.525821 15388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:35.514236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:46569 (local address 127.0.0.1:38232)
0807 04:16:35.514503 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:35.514517 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:35.514609 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:35.514867 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:35.514871 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:35.515210 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:35.515343 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:35.515350 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.516265 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.516268 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:35.517224 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:35.517236 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.517881 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.517884 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:35.518056 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:35.518631 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:35.518647 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:35.520617 (+ 1970us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:35.523421 (+ 2804us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:35.523424 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:35.523427 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:35.523829 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:35.524167 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:35.524170 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:35.524173 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:35.524326 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:35.525069 (+ 743us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:35.525073 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:35.525189 (+ 116us) client_negotiation.cc:769] Sending connection context
0807 04:16:35.525319 (+ 130us) client_negotiation.cc:240] Negotiation successful
0807 04:16:35.525524 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192}
I20260807 04:16:35.526028 15387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:35.514228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38232 (local address 127.7.200.252:46569)
0807 04:16:35.514409 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:35.514414 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:35.514587 (+ 173us) server_negotiation.cc:407] Connection header received
0807 04:16:35.514696 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:35.514699 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:35.514755 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:35.514829 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:35.515463 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.516151 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.517348 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.517758 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.517858 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:35.520842 (+ 2984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:35.520846 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:35.520850 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:35.520876 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:35.523273 (+ 2397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:35.523937 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:35.523941 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:35.523943 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:35.524057 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:35.524530 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:35.524535 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:35.524538 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:35.524966 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:35.525076 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:35.525412 (+ 336us) server_negotiation.cc:299] Negotiation successful
0807 04:16:35.525680 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":64,"server-negotiator.queue_time_us":75}
I20260807 04:16:35.530789 15384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151: Bootstrap starting.
I20260807 04:16:35.533965 15384 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:35.535013 15384 log.cc:824] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151: Log is configured to *not* fsync() on all Append() calls
I20260807 04:16:35.537715 15384 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151: No bootstrap required, opened a new log
I20260807 04:16:35.544694 15384 raft_consensus.cc:348] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 46569 } }
I20260807 04:16:35.545123 15384 raft_consensus.cc:374] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:35.545276 15384 raft_consensus.cc:729] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56970c659fbc4e81994f4331243d3151, State: Initialized, Role: FOLLOWER
I20260807 04:16:35.545843 15384 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 46569 } }
I20260807 04:16:35.546692 15392 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 46569 } } }
I20260807 04:16:35.547107 15392 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 04:16:35.547706 15384 sys_catalog.cc:564] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 04:16:35.558599 15403 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 04:16:35.558840 15403 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 04:16:35.562347 15223 master_runner.cc:428] Detected that this master 56970c659fbc4e81994f4331243d3151 is joining an existing cluster
I20260807 04:16:35.562482 15223 master_runner.cc:432] Initiating AddMaster RPC to add 127.7.200.252:46569
I20260807 04:16:35.565495 15407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:35.556454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:40319 (local address 127.0.0.1:46388)
0807 04:16:35.557691 (+ 1237us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:35.557711 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:35.557912 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:35.558595 (+ 683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:35.558600 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:35.558627 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:16:35.558844 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:35.558859 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.560225 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.560232 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:35.562353 (+ 2121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:35.562371 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.564533 (+ 2162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.564539 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:35.564808 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:35.564870 (+ 62us) client_negotiation.cc:769] Sending connection context
0807 04:16:35.564974 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 04:16:35.565169 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1114,"thread_start_us":528,"threads_started":1}
I20260807 04:16:35.565518 15390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:35.556611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46388 (local address 127.7.200.253:40319)
0807 04:16:35.556839 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:35.556846 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:35.557798 (+ 952us) server_negotiation.cc:407] Connection header received
0807 04:16:35.558071 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:35.558076 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:35.558215 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:35.558321 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:16:35.559017 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.560069 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.562632 (+ 2563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.563970 (+ 1338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.564162 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:35.564410 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:35.565089 (+ 679us) server_negotiation.cc:299] Negotiation successful
0807 04:16:35.565271 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 04:16:35.568514 15273 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260807 04:16:35.569514 15301 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 329b3bda2cfd475ab60e1f1c7c21478b. Latest consensus state: current_term: 1 leader_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: NON_VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: true } } }
I20260807 04:16:35.569850 15301 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [sys.catalog]: This master's current role is: LEARNER
I20260807 04:16:35.595973 15412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:35.567365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:46569 (local address 127.0.0.1:38248)
0807 04:16:35.578315 (+ 10950us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:35.578350 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:35.578613 (+ 263us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:35.579156 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:35.579160 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:35.580108 (+ 948us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:35.580763 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:35.580780 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.582405 (+ 1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.582409 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:35.584122 (+ 1713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:35.584142 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.585618 (+ 1476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.585624 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:35.585823 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:35.586618 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:35.586657 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:35.588188 (+ 1531us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:35.592899 (+ 4711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:35.592903 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:35.592917 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:35.593391 (+ 474us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:35.593816 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:35.593822 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:35.593825 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:35.594014 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:35.594768 (+ 754us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:35.594772 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:35.594939 (+ 167us) client_negotiation.cc:769] Sending connection context
0807 04:16:35.595128 (+ 189us) client_negotiation.cc:240] Negotiation successful
0807 04:16:35.595447 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10720,"thread_start_us":10544,"threads_started":1}
I20260807 04:16:35.597126 15387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:35.567804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38248 (local address 127.7.200.252:46569)
0807 04:16:35.567947 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:35.567952 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:35.578481 (+ 10529us) server_negotiation.cc:407] Connection header received
0807 04:16:35.578797 (+ 316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:35.578802 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:35.578872 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:35.578995 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:35.580947 (+ 1952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.582173 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.584301 (+ 2128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.585198 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.585320 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:35.588425 (+ 3105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:35.588432 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:35.588436 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:35.588473 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:35.592747 (+ 4274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:35.593508 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:35.593514 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:35.593518 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:35.593674 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:35.594178 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:35.594182 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:35.594185 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:35.594570 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:35.594718 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:35.596360 (+ 1642us) server_negotiation.cc:299] Negotiation successful
0807 04:16:35.596616 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":81,"server-negotiator.queue_time_us":51}
I20260807 04:16:35.600443 15193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:35.567116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38204 (local address 127.7.200.254:42899)
0807 04:16:35.567815 (+ 699us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:35.567820 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:35.578976 (+ 11156us) server_negotiation.cc:407] Connection header received
0807 04:16:35.579263 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:35.579272 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:35.579370 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:35.579457 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:35.582137 (+ 2680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.583412 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.586269 (+ 2857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.586992 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.587087 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:35.590302 (+ 3215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:35.590311 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:35.590319 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:35.590367 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:35.595780 (+ 5413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:35.597638 (+ 1858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:35.597645 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:35.597648 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:35.597839 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:35.598440 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:35.598454 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:35.598458 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:35.598833 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:35.598990 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:35.599802 (+ 812us) server_negotiation.cc:299] Negotiation successful
0807 04:16:35.600064 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":579}
I20260807 04:16:35.600539 15413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:35.571536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.0.0.1:38204)
0807 04:16:35.578817 (+ 7281us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:35.578839 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:35.579102 (+ 263us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:35.579732 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:35.579739 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:35.581252 (+ 1513us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:35.581939 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:35.581953 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.583639 (+ 1686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.583645 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:35.586099 (+ 2454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:35.586112 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.587397 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.587406 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:35.587677 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:35.588466 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:35.588497 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:35.590033 (+ 1536us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:35.596070 (+ 6037us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:35.596078 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:35.596083 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:35.597468 (+ 1385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:35.598029 (+ 561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:35.598037 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:35.598043 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:35.598277 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:35.599079 (+ 802us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:35.599085 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:35.599440 (+ 355us) client_negotiation.cc:769] Sending connection context
0807 04:16:35.599605 (+ 165us) client_negotiation.cc:240] Negotiation successful
0807 04:16:35.599986 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7130,"mutex_wait_us":220,"spinlock_wait_cycles":2304,"thread_start_us":6987,"threads_started":1}
I20260807 04:16:35.600462 15390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:35.567405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46402 (local address 127.7.200.253:40319)
0807 04:16:35.571044 (+ 3639us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:35.571051 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:35.579072 (+ 8021us) server_negotiation.cc:407] Connection header received
0807 04:16:35.579307 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:35.579312 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:35.579444 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:35.579531 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:35.582156 (+ 2625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.583411 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.586095 (+ 2684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.586904 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.587013 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:35.592106 (+ 5093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:35.592112 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:35.592117 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:35.592168 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:35.596653 (+ 4485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:35.597806 (+ 1153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:35.597811 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:35.597814 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:35.597983 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:35.598455 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:35.598460 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:35.598464 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:35.598830 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:35.598979 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:35.599765 (+ 786us) server_negotiation.cc:299] Negotiation successful
0807 04:16:35.600025 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3488}
I20260807 04:16:35.602716 15414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:35.567442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:40319 (local address 127.0.0.1:46402)
0807 04:16:35.578933 (+ 11491us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:35.578996 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:35.579156 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:35.579763 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:35.579767 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:35.581246 (+ 1479us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:35.581941 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:35.581953 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.583658 (+ 1705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.583665 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:35.585898 (+ 2233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:35.585915 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.589419 (+ 3504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.589431 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:35.589660 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:35.590384 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:35.590422 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:35.591840 (+ 1418us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:35.596848 (+ 5008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:35.596854 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:35.596859 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:35.597662 (+ 803us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:35.598140 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:35.598144 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:35.598151 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:35.598306 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:35.599079 (+ 773us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:35.599085 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:35.599429 (+ 344us) client_negotiation.cc:769] Sending connection context
0807 04:16:35.600796 (+ 1367us) client_negotiation.cc:240] Negotiation successful
0807 04:16:35.601156 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10904,"mutex_wait_us":155,"thread_start_us":11001,"threads_started":1}
I20260807 04:16:35.604025 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 14683
Aug 07 04:16:35 dist-test-slave-qg60 krb5kdc[14573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076192, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.254@KRBTEST.COM for oryx/127.7.200.252@KRBTEST.COM
Aug 07 04:16:35 dist-test-slave-qg60 krb5kdc[14573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076191, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.200.193@KRBTEST.COM
I20260807 04:16:35.624300 15387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:35.606859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38252 (local address 127.7.200.252:46569)
0807 04:16:35.607024 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:35.607030 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:35.607181 (+ 151us) server_negotiation.cc:407] Connection header received
0807 04:16:35.607452 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:35.607458 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:35.607546 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:35.607647 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:35.608774 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.609623 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.610983 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.611556 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.611732 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:35.616002 (+ 4270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:35.616010 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:35.616016 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:35.616066 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:35.620558 (+ 4492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:35.621348 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:35.621356 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:35.621360 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:35.621555 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:35.622047 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:35.622054 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:35.622058 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:35.622389 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:35.622566 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:35.623804 (+ 1238us) server_negotiation.cc:299] Negotiation successful
0807 04:16:35.624055 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 04:16:35.624577 15407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:35.606716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:46569 (local address 127.0.0.1:38252)
0807 04:16:35.607069 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:35.607088 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:35.607241 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:35.607872 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:35.607881 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:35.608398 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:35.608548 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:35.608559 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.609788 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.609794 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:35.610822 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:35.610834 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.611990 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.611997 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:35.612203 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:35.612935 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:35.612960 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:35.615761 (+ 2801us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:35.620717 (+ 4956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:35.620723 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:35.620760 (+ 37us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:35.621210 (+ 450us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:35.621727 (+ 517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:35.621735 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:35.621740 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:35.621912 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:35.622526 (+ 614us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:35.622531 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:35.622774 (+ 243us) client_negotiation.cc:769] Sending connection context
0807 04:16:35.622977 (+ 203us) client_negotiation.cc:240] Negotiation successful
0807 04:16:35.623217 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 04:16:35.626291 14620 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.7.200.252:46569: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "56970c659fbc4e81994f4331243d3151"
member_type: NON_VOTER
last_known_addr {
host: "127.7.200.252"
port: 46569
}
attrs {
promote: true
}
}
dest_uuid: "329b3bda2cfd475ab60e1f1c7c21478b"
cas_config_opid_index: 5
I20260807 04:16:35.627526 14620 consensus_queue.cc:237] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: NON_VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: true } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: NON_VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: true } }
I20260807 04:16:35.629626 15415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:35.605049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37324 (local address 127.7.200.193:43769)
0807 04:16:35.606685 (+ 1636us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:35.606695 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:35.606728 (+ 33us) server_negotiation.cc:407] Connection header received
0807 04:16:35.607467 (+ 739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:35.607478 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:35.607808 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:35.608005 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:35.609830 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.611507 (+ 1677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.613510 (+ 2003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.614163 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.614320 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:35.620577 (+ 6257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:35.620598 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:35.620623 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:35.620685 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:35.624902 (+ 4217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:35.625868 (+ 966us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:35.625878 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:35.625881 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:35.626057 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:35.626620 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:35.626625 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:35.626628 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:35.627105 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:35.627465 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:35.628817 (+ 1352us) server_negotiation.cc:299] Negotiation successful
0807 04:16:35.629166 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1426,"thread_start_us":1241,"threads_started":1}
I20260807 04:16:35.629820 15404 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 56970c659fbc4e81994f4331243d3151 (127.7.200.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: NON_VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: true } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: NON_VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: true } } }
I20260807 04:16:35.631214 14811 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:35.635262 15404 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.7.200.252:46569
I20260807 04:16:35.637069 15223 master.cc:537] Master@127.7.200.252:46569 shutting down...
I20260807 04:16:35.638013 15273 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [term 1 LEARNER]: Refusing update from remote peer 329b3bda2cfd475ab60e1f1c7c21478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 04:16:35.643328 15417 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: NON_VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 04:16:35.657085 15416 sys_catalog.cc:455] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: NON_VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: true } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: NON_VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: true } } }
I20260807 04:16:35.658495 15416 sys_catalog.cc:458] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:35.661077 15273 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 56970c659fbc4e81994f4331243d3151 (127.7.200.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: NON_VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: true } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: NON_VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: true } } }
I20260807 04:16:35.667484 15301 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: NON_VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: true } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: NON_VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: true } } }
I20260807 04:16:35.667871 15301 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [sys.catalog]: This master's current role is: LEARNER
W20260807 04:16:35.667797 14603 consensus_peers.cc:487] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b -> Peer 56970c659fbc4e81994f4331243d3151 (127.7.200.252:46569): Couldn't send request to peer 56970c659fbc4e81994f4331243d3151. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 04:16:35.669142 15404 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b: attempting to promote NON_VOTER 56fb5f1c90f44bafb30c535276eefd83 to VOTER
I20260807 04:16:35.670291 15404 consensus_queue.cc:237] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: false } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: NON_VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: true } }
I20260807 04:16:35.673164 15273 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [term 1 LEARNER]: Refusing update from remote peer 329b3bda2cfd475ab60e1f1c7c21478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 04:16:35.673864 15416 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260807 04:16:35.674425 14603 consensus_peers.cc:487] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b -> Peer 56970c659fbc4e81994f4331243d3151 (127.7.200.252:46569): Couldn't send request to peer 56970c659fbc4e81994f4331243d3151. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 04:16:35.676775 15404 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 56fb5f1c90f44bafb30c535276eefd83 (127.7.200.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: false } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: NON_VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: true } } }
I20260807 04:16:35.683604 15223 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260807 04:16:35.684089 15223 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260807 04:16:35.684316 15223 tablet_replica.cc:330] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151: stopping tablet replica
I20260807 04:16:35.686169 15273 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 56fb5f1c90f44bafb30c535276eefd83 (127.7.200.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: false } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: NON_VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: true } } }
I20260807 04:16:35.688670 15417 sys_catalog.cc:455] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: false } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: NON_VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: true } } }
I20260807 04:16:35.689129 15417 sys_catalog.cc:458] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:35.692408 15223 master.cc:552] Master@127.7.200.252:46569 shutdown complete.
I20260807 04:16:35.692508 15223 master_runner.cc:305] Clearing existing system tablet
I20260807 04:16:35.692682 15417 sys_catalog.cc:455] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: false } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: NON_VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: true } } }
I20260807 04:16:35.693032 15223 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:35.693073 15417 sys_catalog.cc:458] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:35.693173 15223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:35.694084 15301 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: false } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: NON_VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: true } } }
I20260807 04:16:35.694350 15301 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 04:16:35.697477 15223 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.002s
I20260807 04:16:35.699210 15423 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:35.699582 15223 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:35.699879 15223 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.002s
I20260807 04:16:35.699993 15223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-2/wal
uuid: "56970c659fbc4e81994f4331243d3151"
format_stamp: "Formatted at 2026-08-07 04:16:35 on dist-test-slave-qg60"
server_key: "8c1979fbcea19345e6249fe286b0f49a"
server_key_iv: "2f33ae9f332c489552a89068d539d0f5"
server_key_version: "encryptionkey@0"
I20260807 04:16:35.705765 15223 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:16:35.713717 15223 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 04:16:35.713908 15223 log.cc:1196] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260807 04:16:35.714478 15223 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151: Deleting consensus metadata
I20260807 04:16:35.714761 15223 master_runner.cc:315] Copying system tablet from 127.7.200.254:42899
I20260807 04:16:35.717653 15223 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151: tablet copy: Beginning tablet copy session from remote peer at address 127.7.200.254:42899
I20260807 04:16:35.744408 15193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:35.718596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38214 (local address 127.7.200.254:42899)
0807 04:16:35.718837 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:35.718844 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:35.729427 (+ 10583us) server_negotiation.cc:407] Connection header received
0807 04:16:35.729617 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:35.729623 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:35.729715 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:35.729835 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:35.730939 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.732160 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.734139 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.734803 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.734952 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:35.737409 (+ 2457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:35.737416 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:35.737422 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:35.737466 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:35.741183 (+ 3717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:35.742054 (+ 871us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:35.742060 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:35.742064 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:35.742251 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:35.742725 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:35.742730 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:35.742734 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:35.743139 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:35.743297 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:35.743780 (+ 483us) server_negotiation.cc:299] Negotiation successful
0807 04:16:35.744051 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260807 04:16:35.744431 15430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:35.718510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.0.0.1:38214)
0807 04:16:35.729247 (+ 10737us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:35.729280 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:35.729464 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:35.729900 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:35.729905 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:35.730471 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:35.730750 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:35.730763 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.732323 (+ 1560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.732329 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:35.733973 (+ 1644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:35.733989 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:35.734995 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:35.735001 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:35.735167 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:35.735960 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:35.735983 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:35.737178 (+ 1195us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:35.741340 (+ 4162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:35.741346 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:35.741350 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:35.741905 (+ 555us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:35.742409 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:35.742415 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:35.742419 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:35.742598 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:35.743280 (+ 682us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:35.743285 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:35.743487 (+ 202us) client_negotiation.cc:769] Sending connection context
0807 04:16:35.743628 (+ 141us) client_negotiation.cc:240] Negotiation successful
0807 04:16:35.743978 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10588,"thread_start_us":10433,"threads_started":1}
I20260807 04:16:35.745481 14640 tablet_copy_service.cc:140] P 329b3bda2cfd475ab60e1f1c7c21478b: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 56970c659fbc4e81994f4331243d3151 ({username='oryx', principal='oryx/127.7.200.252@KRBTEST.COM'} at 127.0.0.1:38214)
I20260807 04:16:35.745669 14640 tablet_copy_service.cc:161] P 329b3bda2cfd475ab60e1f1c7c21478b: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 56970c659fbc4e81994f4331243d3151 at {username='oryx', principal='oryx/127.7.200.252@KRBTEST.COM'} at 127.0.0.1:38214: session id = 56970c659fbc4e81994f4331243d3151-00000000000000000000000000000000
I20260807 04:16:35.749495 14640 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 04:16:35.751616 15223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 04:16:35.758860 15223 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151: tablet copy: Starting download of 0 data blocks...
I20260807 04:16:35.759187 15223 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151: tablet copy: Starting download of 1 WAL segments...
I20260807 04:16:35.761839 15223 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 04:16:35.766506 14640 tablet_copy_service.cc:342] P 329b3bda2cfd475ab60e1f1c7c21478b: Request end of tablet copy session 56970c659fbc4e81994f4331243d3151-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.7.200.252@KRBTEST.COM'} at 127.0.0.1:38214
I20260807 04:16:35.766649 14640 tablet_copy_service.cc:433] P 329b3bda2cfd475ab60e1f1c7c21478b: ending tablet copy session 56970c659fbc4e81994f4331243d3151-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 56970c659fbc4e81994f4331243d3151
I20260807 04:16:35.779112 15223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:35.782747 15431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:35.786283 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 14683
W20260807 04:16:35.789950 15432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:35.817061 15223 server_base.cc:1034] running on GCE node
W20260807 04:16:35.818446 15434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:35.818629 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:43769
--local_ip_for_outbound_sockets=127.7.200.193
--tserver_master_addrs=127.7.200.254:42899
--webserver_port=43385
--webserver_interface=127.7.200.193
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.193.keytab
--principal=oryx/127.7.200.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:39251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.7.200.254:42899,127.7.200.253:40319
--tserver_master_addrs=127.7.200.254:42899,127.7.200.253:40319,127.7.200.252:46569 with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 04:16:35.819041 15223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:35.819806 15223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:35.821014 15223 hybrid_clock.cc:648] HybridClock initialized: now 1786076195820957 us; error 47 us; skew 500 ppm
I20260807 04:16:35.821271 15223 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:35 dist-test-slave-qg60 krb5kdc[14573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076195, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:35.823514 15223 init.cc:377] Logged in from keytab as oryx/127.7.200.252@KRBTEST.COM (short username oryx)
I20260807 04:16:35.829149 15223 webserver.cc:460] Webserver started at http://127.7.200.252:36029/ using document root <none> and password file <none>
I20260807 04:16:35.829519 15223 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:35.829641 15223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:35.832994 15223 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260807 04:16:35.835203 15442 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:35.835693 15223 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260807 04:16:35.835820 15223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-2/wal
uuid: "56970c659fbc4e81994f4331243d3151"
format_stamp: "Formatted at 2026-08-07 04:16:35 on dist-test-slave-qg60"
server_key: "8c1979fbcea19345e6249fe286b0f49a"
server_key_iv: "2f33ae9f332c489552a89068d539d0f5"
server_key_version: "encryptionkey@0"
I20260807 04:16:35.836042 15223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:35.874387 15223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:35.878805 15223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:35.917073 15223 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.252:46569
I20260807 04:16:35.917140 15495 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.252:46569 every 8 connection(s)
I20260807 04:16:35.918308 15223 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/master-2/data/info.pb
I20260807 04:16:35.924165 15496 sys_catalog.cc:263] Verifying existing consensus state
I20260807 04:16:35.928711 15496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151: Bootstrap starting.
I20260807 04:16:35.949319 15496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 04:16:35.949885 15496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151: Bootstrap complete.
I20260807 04:16:35.951069 15496 raft_consensus.cc:348] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: false } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: NON_VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: true } }
I20260807 04:16:35.951373 15496 raft_consensus.cc:729] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 56970c659fbc4e81994f4331243d3151, State: Initialized, Role: LEARNER
I20260807 04:16:35.951646 15496 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: false } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: NON_VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: true } }
I20260807 04:16:35.952857 15496 sys_catalog.cc:564] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:16:35.952644 15499 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: false } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: NON_VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: true } } }
I20260807 04:16:35.953310 15499 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [sys.catalog]: This master's current role is: LEARNER
I20260807 04:16:35.962657 15511 catalog_manager.cc:1259] Loaded cluster ID: 1c650dcb40a341629501662a324e1a80
I20260807 04:16:35.962792 15511 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151: loading cluster ID for follower catalog manager: success
I20260807 04:16:35.966781 15511 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151: acquiring CA information for follower catalog manager: success
I20260807 04:16:35.969765 15511 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 04:16:36.184514 15512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:36.176884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:46569 (local address 127.0.0.1:38262)
0807 04:16:36.177437 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:36.177465 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:36.177626 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:36.178271 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:36.178275 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:36.178299 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:16:36.178523 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:36.178538 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:36.180707 (+ 2169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:36.180713 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:36.182153 (+ 1440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:36.182167 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:36.183590 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:36.183596 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:36.183842 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:36.183884 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 04:16:36.184010 (+ 126us) client_negotiation.cc:240] Negotiation successful
0807 04:16:36.184155 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":268,"threads_started":1}
I20260807 04:16:36.184531 15513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:36.177063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38262 (local address 127.7.200.252:46569)
0807 04:16:36.177827 (+ 764us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:36.177834 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:36.177859 (+ 25us) server_negotiation.cc:407] Connection header received
0807 04:16:36.177938 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:36.177943 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:36.178070 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:36.178228 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:16:36.178710 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:36.180496 (+ 1786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:36.182325 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:36.183397 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:36.183552 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:36.183821 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:36.184040 (+ 219us) server_negotiation.cc:299] Negotiation successful
0807 04:16:36.184176 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":607,"thread_start_us":419,"threads_started":1}
I20260807 04:16:36.186074 15470 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260807 04:16:36.186817 15499 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 329b3bda2cfd475ab60e1f1c7c21478b. Latest consensus state: current_term: 1 leader_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: false } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: NON_VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: true } } }
I20260807 04:16:36.187124 15499 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [sys.catalog]: This master's current role is: LEARNER
W20260807 04:16:36.207819 15439 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:36.208110 15439 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:36.208262 15439 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:36.215713 15439 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:36.215826 15439 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:36.215996 15439 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:16:36.226084 15439 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:39251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.193.keytab
--principal=oryx/127.7.200.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:43769
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=43385
--tserver_master_addrs=127.7.200.254:42899,127.7.200.253:40319,127.7.200.252:46569
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:36.227444 15439 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:36.229168 15439 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:36.243649 15518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:36.243839 15521 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:36.243866 15519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:36.244948 15439 server_base.cc:1034] running on GCE node
I20260807 04:16:36.245666 15439 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:36.246785 15439 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:36.248026 15439 hybrid_clock.cc:648] HybridClock initialized: now 1786076196247974 us; error 64 us; skew 500 ppm
I20260807 04:16:36.248355 15439 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:36 dist-test-slave-qg60 krb5kdc[14573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076196, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:36.251682 15439 init.cc:377] Logged in from keytab as oryx/127.7.200.193@KRBTEST.COM (short username oryx)
I20260807 04:16:36.253264 15439 webserver.cc:460] Webserver started at http://127.7.200.193:43385/ using document root <none> and password file <none>
I20260807 04:16:36.253948 15439 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:36.254081 15439 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:36.259544 15439 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.005s
I20260807 04:16:36.262253 15528 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:36.263616 15439 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 04:16:36.263754 15439 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "a4aff80e488846ed881d6b55607b03d5"
format_stamp: "Formatted at 2026-08-07 04:16:33 on dist-test-slave-qg60"
server_key: "3c6e647e55e7f49fc046e0fc48603e68"
server_key_iv: "c2a82c4480d220e4b8f6ade910b81e65"
server_key_version: "encryptionkey@0"
I20260807 04:16:36.264889 15439 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:36.297747 15439 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:36.302361 15439 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:36.302604 15439 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:36.303563 15439 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:16:36.304957 15439 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:36.305058 15439 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:36.305141 15439 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:36.305202 15439 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:36.373183 15439 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:43769
I20260807 04:16:36.373267 15645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:43769 every 8 connection(s)
I20260807 04:16:36.374876 15439 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:16:36.380800 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 15439
I20260807 04:16:36.381299 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 14822
Aug 07 04:16:36 dist-test-slave-qg60 krb5kdc[14573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076196, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.252@KRBTEST.COM
Aug 07 04:16:36 dist-test-slave-qg60 krb5kdc[14573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076196, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM
I20260807 04:16:36.412535 15513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:36.379412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:34657 (local address 127.7.200.252:46569)
0807 04:16:36.379665 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:36.379674 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:36.385690 (+ 6016us) server_negotiation.cc:407] Connection header received
0807 04:16:36.391112 (+ 5422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:36.391119 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:36.391221 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:36.391363 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:36.393240 (+ 1877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:36.394044 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:36.396137 (+ 2093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:36.396771 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:36.396936 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:36.402847 (+ 5911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:36.402855 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:36.402861 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:36.402906 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:36.407618 (+ 4712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:36.409484 (+ 1866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:36.409489 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:36.409493 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:36.409667 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:36.410311 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:36.410317 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:36.410320 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:36.410707 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:36.410844 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:36.411916 (+ 1072us) server_negotiation.cc:299] Negotiation successful
0807 04:16:36.412186 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260807 04:16:36.414949 15653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:36.378556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:46569 (local address 127.7.200.193:34657)
0807 04:16:36.385490 (+ 6934us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:36.385550 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:36.389400 (+ 3850us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:36.391638 (+ 2238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:36.391647 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:36.392291 (+ 644us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:36.393041 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:36.393062 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:36.394227 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:36.394232 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:36.395987 (+ 1755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:36.396000 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:36.397319 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:36.397328 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:36.397733 (+ 405us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:36.398699 (+ 966us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:36.398740 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:36.402547 (+ 3807us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:36.408482 (+ 5935us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:36.408492 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:36.408511 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:36.409318 (+ 807us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:36.409841 (+ 523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:36.409845 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:36.409848 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:36.410156 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:36.410967 (+ 811us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:36.410978 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:36.411443 (+ 465us) client_negotiation.cc:769] Sending connection context
0807 04:16:36.412834 (+ 1391us) client_negotiation.cc:240] Negotiation successful
0807 04:16:36.413436 (+ 602us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6610,"thread_start_us":30304,"threads_started":1}
I20260807 04:16:36.416851 15646 heartbeater.cc:347] Connected to a master server at 127.7.200.252:46569
I20260807 04:16:36.417178 15646 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:36.418202 15646 heartbeater.cc:511] Master 127.7.200.252:46569 requested a full tablet report, sending...
I20260807 04:16:36.418951 15654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:36.378557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.7.200.193:44829)
0807 04:16:36.397366 (+ 18809us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:36.397388 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:36.397604 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:36.398307 (+ 703us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:36.398318 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:36.399290 (+ 972us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:36.399851 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:36.399866 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:36.401705 (+ 1839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:36.401712 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:36.403641 (+ 1929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:36.403662 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:36.405101 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:36.405111 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:36.405379 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:36.406058 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:36.406086 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:36.410503 (+ 4417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:36.415555 (+ 5052us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:36.415558 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:36.415561 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:36.416101 (+ 540us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:36.416551 (+ 450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:36.416556 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:36.416559 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:36.416717 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:36.417579 (+ 862us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:36.417583 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:36.417778 (+ 195us) client_negotiation.cc:769] Sending connection context
0807 04:16:36.417946 (+ 168us) client_negotiation.cc:240] Negotiation successful
0807 04:16:36.418256 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18617,"mutex_wait_us":36,"spinlock_wait_cycles":57600,"thread_start_us":6257,"threads_started":1}
I20260807 04:16:36.418889 15651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:36.378100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:44829 (local address 127.7.200.254:42899)
0807 04:16:36.390642 (+ 12542us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:36.390647 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:36.397477 (+ 6830us) server_negotiation.cc:407] Connection header received
0807 04:16:36.397784 (+ 307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:36.397791 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:36.397883 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:36.398000 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:36.400079 (+ 2079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:36.401505 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:36.403832 (+ 2327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:36.404599 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:36.404705 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:36.410746 (+ 6041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:36.410755 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:36.410763 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:36.410808 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:36.414794 (+ 3986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:36.416218 (+ 1424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:36.416227 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:36.416234 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:36.416398 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:36.417102 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:36.417106 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:36.417109 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:36.417441 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:36.417595 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:36.418094 (+ 499us) server_negotiation.cc:299] Negotiation successful
0807 04:16:36.418373 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12424,"thread_start_us":12309,"threads_started":1}
Aug 07 04:16:36 dist-test-slave-qg60 krb5kdc[14573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076196, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.253@KRBTEST.COM
I20260807 04:16:36.419890 15647 heartbeater.cc:347] Connected to a master server at 127.7.200.254:42899
I20260807 04:16:36.420020 15647 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:36.420445 15647 heartbeater.cc:511] Master 127.7.200.254:42899 requested a full tablet report, sending...
I20260807 04:16:36.421765 15460 ts_manager.cc:194] Registered new tserver with Master: a4aff80e488846ed881d6b55607b03d5 (127.7.200.193:43769)
I20260807 04:16:36.421801 14620 ts_manager.cc:194] Re-registered known tserver with Master: a4aff80e488846ed881d6b55607b03d5 (127.7.200.193:43769)
I20260807 04:16:36.423032 14620 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.200.193@KRBTEST.COM'} at 127.7.200.193:44829
Aug 07 04:16:36 dist-test-slave-qg60 krb5kdc[14573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076191, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.200.194@KRBTEST.COM
I20260807 04:16:36.428475 15652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:36.380020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:40319 (local address 127.7.200.193:52631)
0807 04:16:36.409333 (+ 29313us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:36.409353 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:36.409572 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:36.410219 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:36.410224 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:36.410849 (+ 625us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:36.411112 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:36.411121 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:36.412698 (+ 1577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:36.412706 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:36.414467 (+ 1761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:36.414486 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:36.416366 (+ 1880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:36.416372 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:36.416588 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:36.417168 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:36.417196 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:36.421740 (+ 4544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:36.426094 (+ 4354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:36.426098 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:36.426100 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:36.426463 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:36.426940 (+ 477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:36.426944 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:36.426946 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:36.427093 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:36.427723 (+ 630us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:36.427727 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:36.427837 (+ 110us) client_negotiation.cc:769] Sending connection context
0807 04:16:36.427945 (+ 108us) client_negotiation.cc:240] Negotiation successful
0807 04:16:36.428183 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29162,"thread_start_us":16931,"threads_started":1}
I20260807 04:16:36.428813 15650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:36.377811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:52631 (local address 127.7.200.253:40319)
0807 04:16:36.390939 (+ 13128us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:36.390944 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:36.409459 (+ 18515us) server_negotiation.cc:407] Connection header received
0807 04:16:36.409734 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:36.409741 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:36.409839 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:36.409938 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:36.411275 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:36.412505 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:36.414664 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:36.415306 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:36.415407 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:36.422073 (+ 6666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:36.422081 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:36.422085 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:36.422128 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:36.425952 (+ 3824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:36.426601 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:36.426607 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:36.426610 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:36.426811 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:36.427221 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:36.427226 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:36.427228 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:36.427607 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:36.427776 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:36.428100 (+ 324us) server_negotiation.cc:299] Negotiation successful
0807 04:16:36.428340 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13022,"thread_start_us":12947,"threads_started":1}
I20260807 04:16:36.429850 15648 heartbeater.cc:347] Connected to a master server at 127.7.200.253:40319
I20260807 04:16:36.430027 15648 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:36.430562 15648 heartbeater.cc:511] Master 127.7.200.253:40319 requested a full tablet report, sending...
I20260807 04:16:36.432379 15656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:36.382942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38904 (local address 127.7.200.194:41457)
0807 04:16:36.407373 (+ 24431us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:36.407387 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:36.407424 (+ 37us) server_negotiation.cc:407] Connection header received
0807 04:16:36.407537 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:36.407549 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:36.407943 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:36.408184 (+ 241us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:36.410347 (+ 2163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:36.412877 (+ 2530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:36.414747 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:36.415626 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:36.415760 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:36.424766 (+ 9006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:36.424786 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:36.424806 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:36.424859 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:36.428582 (+ 3723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:36.429657 (+ 1075us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:36.429667 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:36.429671 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:36.429880 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:36.430506 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:36.430511 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:36.430515 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:36.431019 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:36.431351 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:36.431666 (+ 315us) server_negotiation.cc:299] Negotiation successful
0807 04:16:36.431948 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24184,"thread_start_us":26346,"threads_started":1}
I20260807 04:16:36.432415 15262 ts_manager.cc:194] Registered new tserver with Master: a4aff80e488846ed881d6b55607b03d5 (127.7.200.193:43769)
I20260807 04:16:36.433836 14955 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:36.520123 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 14822
I20260807 04:16:36.540298 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:41457
--local_ip_for_outbound_sockets=127.7.200.194
--tserver_master_addrs=127.7.200.254:42899
--webserver_port=43013
--webserver_interface=127.7.200.194
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.194.keytab
--principal=oryx/127.7.200.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:39251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.7.200.254:42899,127.7.200.253:40319
--tserver_master_addrs=127.7.200.254:42899,127.7.200.253:40319,127.7.200.252:46569 with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 04:16:36.659025 15416 sys_catalog.cc:455] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: false } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: NON_VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: true } } }
I20260807 04:16:36.659477 15416 sys_catalog.cc:458] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:36.660985 15659 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b: attempting to promote NON_VOTER 56970c659fbc4e81994f4331243d3151 to VOTER
I20260807 04:16:36.661720 15659 consensus_queue.cc:237] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: false } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: false } }
I20260807 04:16:36.663889 15273 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [term 1 FOLLOWER]: Refusing update from remote peer 329b3bda2cfd475ab60e1f1c7c21478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 04:16:36.663993 15470 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [term 1 LEARNER]: Refusing update from remote peer 329b3bda2cfd475ab60e1f1c7c21478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 04:16:36.664494 15404 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 04:16:36.664937 15659 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 04:16:36.667488 15404 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 56970c659fbc4e81994f4331243d3151 (127.7.200.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: false } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: false } } }
I20260807 04:16:36.668074 15273 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 56970c659fbc4e81994f4331243d3151 (127.7.200.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: false } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: false } } }
I20260807 04:16:36.673444 15659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: false } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: false } } }
I20260807 04:16:36.673821 15659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:36.673609 15404 sys_catalog.cc:455] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: false } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: false } } }
I20260807 04:16:36.674171 15404 sys_catalog.cc:458] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:36.675201 15663 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: false } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: false } } }
I20260807 04:16:36.675747 15663 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 04:16:36.676236 15659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: false } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: false } } }
I20260807 04:16:36.676496 15659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:36.677031 15470 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 56970c659fbc4e81994f4331243d3151 (127.7.200.252) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: false } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: false } } }
I20260807 04:16:36.681690 15499 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: false } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: false } } }
I20260807 04:16:36.681986 15499 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [sys.catalog]: This master's current role is: FOLLOWER
W20260807 04:16:36.893520 15658 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:36.893814 15658 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:36.893994 15658 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:36.901731 15658 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:36.901861 15658 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:36.902060 15658 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:16:36.912382 15658 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:39251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.194.keytab
--principal=oryx/127.7.200.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:41457
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=43013
--tserver_master_addrs=127.7.200.254:42899,127.7.200.253:40319,127.7.200.252:46569
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:36.913844 15658 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:36.915228 15658 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:36.928970 15668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:36.929008 15669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:36.929296 15671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:36.930150 15658 server_base.cc:1034] running on GCE node
I20260807 04:16:36.930751 15658 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:36.931694 15658 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:36.932921 15658 hybrid_clock.cc:648] HybridClock initialized: now 1786076196932868 us; error 46 us; skew 500 ppm
I20260807 04:16:36.933239 15658 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:36 dist-test-slave-qg60 krb5kdc[14573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076196, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:36.936491 15658 init.cc:377] Logged in from keytab as oryx/127.7.200.194@KRBTEST.COM (short username oryx)
I20260807 04:16:36.938016 15658 webserver.cc:460] Webserver started at http://127.7.200.194:43013/ using document root <none> and password file <none>
I20260807 04:16:36.938988 15658 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:36.939127 15658 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:36.944669 15658 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:16:36.947846 15679 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:36.949301 15658 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:16:36.949447 15658 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "4f08b06a155a4b898d4315ec68eb738f"
format_stamp: "Formatted at 2026-08-07 04:16:33 on dist-test-slave-qg60"
server_key: "a3413370c725b16dd0209b0386a6c1e2"
server_key_iv: "41ae0bc6176445db56ae75e5377e7656"
server_key_version: "encryptionkey@0"
I20260807 04:16:36.950399 15658 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:36.988154 15658 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:36.992775 15658 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:36.993026 15658 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:36.994030 15658 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:16:36.995527 15658 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:36.995627 15658 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:36.995713 15658 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:36.995822 15658 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:37.032831 15658 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:41457
I20260807 04:16:37.032963 15801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:41457 every 8 connection(s)
I20260807 04:16:37.034505 15658 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:16:37.038519 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 15658
I20260807 04:16:37.038846 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 14966
Aug 07 04:16:37 dist-test-slave-qg60 krb5kdc[14573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076196, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.253@KRBTEST.COM
I20260807 04:16:37.071421 15808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:37.038603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:40319 (local address 127.7.200.194:52293)
0807 04:16:37.039644 (+ 1041us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:37.039702 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:37.042955 (+ 3253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:37.046684 (+ 3729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:37.046706 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:37.047808 (+ 1102us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:37.050260 (+ 2452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:37.050306 (+ 46us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.052715 (+ 2409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.052743 (+ 28us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:37.055728 (+ 2985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:37.055767 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.057654 (+ 1887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.057664 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:37.058091 (+ 427us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:37.059124 (+ 1033us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:37.059170 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:37.062743 (+ 3573us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:37.066389 (+ 3646us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:37.066399 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:37.066416 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:37.066890 (+ 474us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:37.067310 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:37.067315 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:37.067319 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:37.067575 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:37.068168 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:37.068175 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:37.068713 (+ 538us) client_negotiation.cc:769] Sending connection context
0807 04:16:37.069094 (+ 381us) client_negotiation.cc:240] Negotiation successful
0807 04:16:37.069736 (+ 642us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":656,"thread_start_us":3379,"threads_started":1}
I20260807 04:16:37.072767 15814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:37.040133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:52293 (local address 127.7.200.253:40319)
0807 04:16:37.045775 (+ 5642us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:37.045785 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:37.045816 (+ 31us) server_negotiation.cc:407] Connection header received
0807 04:16:37.045904 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:37.045912 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:37.046044 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:37.050597 (+ 4553us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:37.050879 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.052424 (+ 1545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.056043 (+ 3619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.056989 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.057156 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:37.063035 (+ 5879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:37.063040 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:37.063043 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:37.063094 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:37.066242 (+ 3148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:37.067027 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:37.067033 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:37.067036 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:37.067177 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:37.067704 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:37.067709 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:37.067718 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:37.067997 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:37.068179 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:37.072081 (+ 3902us) server_negotiation.cc:299] Negotiation successful
0807 04:16:37.072359 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5467,"thread_start_us":5321,"threads_started":1}
I20260807 04:16:37.075111 15804 heartbeater.cc:347] Connected to a master server at 127.7.200.253:40319
I20260807 04:16:37.075489 15804 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:37.076628 15804 heartbeater.cc:511] Master 127.7.200.253:40319 requested a full tablet report, sending...
I20260807 04:16:37.079071 15262 ts_manager.cc:194] Registered new tserver with Master: 4f08b06a155a4b898d4315ec68eb738f (127.7.200.194:41457)
Aug 07 04:16:37 dist-test-slave-qg60 krb5kdc[14573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076196, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM
Aug 07 04:16:37 dist-test-slave-qg60 krb5kdc[14573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076191, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.200.195@KRBTEST.COM
Aug 07 04:16:37 dist-test-slave-qg60 krb5kdc[14573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076196, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.252@KRBTEST.COM
I20260807 04:16:37.087893 15809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:37.039350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.7.200.194:36827)
0807 04:16:37.067618 (+ 28268us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:37.067644 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:37.067793 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:37.069711 (+ 1918us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:37.069716 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:37.070431 (+ 715us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:37.070816 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:37.070829 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.072437 (+ 1608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.072443 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:37.074120 (+ 1677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:37.074136 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.075407 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.075415 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:37.075796 (+ 381us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:37.076873 (+ 1077us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:37.076905 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:37.080786 (+ 3881us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:37.084695 (+ 3909us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:37.084702 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:37.084706 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:37.085218 (+ 512us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:37.085641 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:37.085646 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:37.085649 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:37.085813 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:37.086750 (+ 937us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:37.086778 (+ 28us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:37.086950 (+ 172us) client_negotiation.cc:769] Sending connection context
0807 04:16:37.087105 (+ 155us) client_negotiation.cc:240] Negotiation successful
0807 04:16:37.087417 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28075,"mutex_wait_us":81,"spinlock_wait_cycles":14592,"thread_start_us":27862,"threads_started":1}
I20260807 04:16:37.087926 15807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:37.038097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:36827 (local address 127.7.200.254:42899)
0807 04:16:37.069173 (+ 31076us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:37.069179 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:37.069199 (+ 20us) server_negotiation.cc:407] Connection header received
0807 04:16:37.069259 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:37.069264 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:37.069358 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:37.070981 (+ 1623us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:37.071144 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.072250 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.074328 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.075114 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.075255 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:37.081021 (+ 5766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:37.081028 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:37.081039 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:37.081075 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:37.084554 (+ 3479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:37.085357 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:37.085362 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:37.085366 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:37.085517 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:37.085933 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:37.085938 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:37.085948 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:37.086336 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:37.086487 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:37.087257 (+ 770us) server_negotiation.cc:299] Negotiation successful
0807 04:16:37.087538 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30940,"thread_start_us":31368,"threads_started":1}
I20260807 04:16:37.089107 15812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:37.039792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:46569 (local address 127.7.200.194:33831)
0807 04:16:37.068362 (+ 28570us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:37.068379 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:37.068509 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:37.069262 (+ 753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:37.069266 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:37.070044 (+ 778us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:37.070475 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:37.070489 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.072151 (+ 1662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.072156 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:37.073991 (+ 1835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:37.074224 (+ 233us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.075498 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.075509 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:37.075796 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:37.076873 (+ 1077us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:37.076903 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:37.081903 (+ 5000us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:37.086087 (+ 4184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:37.086092 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:37.086095 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:37.086622 (+ 527us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:37.087047 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:37.087053 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:37.087057 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:37.087233 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:37.087972 (+ 739us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:37.087977 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:37.088135 (+ 158us) client_negotiation.cc:769] Sending connection context
0807 04:16:37.088295 (+ 160us) client_negotiation.cc:240] Negotiation successful
0807 04:16:37.088603 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28433,"mutex_wait_us":159,"spinlock_wait_cycles":304640,"thread_start_us":28268,"threads_started":1}
I20260807 04:16:37.089114 15806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:37.037691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:33831 (local address 127.7.200.252:46569)
0807 04:16:37.038757 (+ 1066us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:37.038763 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:37.068486 (+ 29723us) server_negotiation.cc:407] Connection header received
0807 04:16:37.068807 (+ 321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:37.068814 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:37.068926 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:37.069046 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:37.070671 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.071859 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.074383 (+ 2524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.075039 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.075126 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:37.082161 (+ 7035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:37.082171 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:37.082178 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:37.082221 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:37.085950 (+ 3729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:37.086765 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:37.086771 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:37.086774 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:37.086930 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:37.087374 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:37.087379 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:37.087381 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:37.087744 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:37.087877 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:37.088404 (+ 527us) server_negotiation.cc:299] Negotiation successful
0807 04:16:37.088618 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":883,"thread_start_us":519,"threads_started":1}
I20260807 04:16:37.089335 15803 heartbeater.cc:347] Connected to a master server at 127.7.200.254:42899
I20260807 04:16:37.089506 15803 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:37.089988 15803 heartbeater.cc:511] Master 127.7.200.254:42899 requested a full tablet report, sending...
I20260807 04:16:37.091123 15811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:37.039816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49448 (local address 127.7.200.195:46477)
0807 04:16:37.063260 (+ 23444us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:37.063274 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:37.063314 (+ 40us) server_negotiation.cc:407] Connection header received
0807 04:16:37.063398 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:37.063410 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:37.063756 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:37.063943 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:37.068407 (+ 4464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.070252 (+ 1845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.072437 (+ 2185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.073887 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.074040 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:37.081848 (+ 7808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:37.081866 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:37.081884 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:37.081943 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:37.086687 (+ 4744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:37.087619 (+ 932us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:37.087629 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:37.087633 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:37.087803 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:37.089325 (+ 1522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:37.089337 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:37.089359 (+ 22us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:37.089773 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:37.090014 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:37.090402 (+ 388us) server_negotiation.cc:299] Negotiation successful
0807 04:16:37.090708 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23197,"thread_start_us":24366,"threads_started":1}
I20260807 04:16:37.091401 14620 ts_manager.cc:194] Re-registered known tserver with Master: 4f08b06a155a4b898d4315ec68eb738f (127.7.200.194:41457)
I20260807 04:16:37.092391 14620 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.200.194@KRBTEST.COM'} at 127.7.200.194:36827
I20260807 04:16:37.092509 15103 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:37.095925 15802 heartbeater.cc:347] Connected to a master server at 127.7.200.252:46569
I20260807 04:16:37.096127 15802 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:37.096515 15802 heartbeater.cc:511] Master 127.7.200.252:46569 requested a full tablet report, sending...
I20260807 04:16:37.097759 15460 ts_manager.cc:194] Registered new tserver with Master: 4f08b06a155a4b898d4315ec68eb738f (127.7.200.194:41457)
I20260807 04:16:37.178891 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 14966
I20260807 04:16:37.199079 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:46477
--local_ip_for_outbound_sockets=127.7.200.195
--tserver_master_addrs=127.7.200.254:42899
--webserver_port=43201
--webserver_interface=127.7.200.195
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.195.keytab
--principal=oryx/127.7.200.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:39251
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.7.200.254:42899,127.7.200.253:40319
--tserver_master_addrs=127.7.200.254:42899,127.7.200.253:40319,127.7.200.252:46569 with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 04:16:37.426046 15647 heartbeater.cc:503] Master 127.7.200.254:42899 was elected leader, sending a full tablet report...
W20260807 04:16:37.561663 15816 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:37.562057 15816 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:37.562259 15816 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:37.570472 15816 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:37.570587 15816 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:37.570710 15816 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:16:37.581485 15816 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:39251
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.195.keytab
--principal=oryx/127.7.200.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:46477
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=43201
--tserver_master_addrs=127.7.200.254:42899,127.7.200.253:40319,127.7.200.252:46569
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:37.582945 15816 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:37.584363 15816 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:37.598977 15822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:37.599067 15821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:37.599089 15824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:37.599992 15816 server_base.cc:1034] running on GCE node
I20260807 04:16:37.600572 15816 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:37.601564 15816 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:37.602810 15816 hybrid_clock.cc:648] HybridClock initialized: now 1786076197602753 us; error 47 us; skew 500 ppm
I20260807 04:16:37.603139 15816 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:37 dist-test-slave-qg60 krb5kdc[14573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076197, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:37.606762 15816 init.cc:377] Logged in from keytab as oryx/127.7.200.195@KRBTEST.COM (short username oryx)
I20260807 04:16:37.608253 15816 webserver.cc:460] Webserver started at http://127.7.200.195:43201/ using document root <none> and password file <none>
I20260807 04:16:37.609056 15816 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:37.609257 15816 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:37.615013 15816 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 04:16:37.618013 15832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:37.619514 15816 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260807 04:16:37.619722 15816 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "4943bc3d911b4582b9f211b84aa012a7"
format_stamp: "Formatted at 2026-08-07 04:16:34 on dist-test-slave-qg60"
server_key: "f207b8544fa4a0bcb8ad63859b7b5dbe"
server_key_iv: "e030e2107785e447a43bc514c9fb0fcd"
server_key_version: "encryptionkey@0"
I20260807 04:16:37.620963 15816 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:37.660156 15816 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:37.665170 15816 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:37.665520 15816 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:37.666615 15816 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:16:37.668439 15816 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:37.668570 15816 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:37.668720 15816 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:37.668848 15816 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260807 04:16:37.706832 15816 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:46477
I20260807 04:16:37.706923 15950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:46477 every 8 connection(s)
I20260807 04:16:37.708398 15816 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:16:37.716704 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 15816
Aug 07 04:16:37 dist-test-slave-qg60 krb5kdc[14573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076197, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM
Aug 07 04:16:37 dist-test-slave-qg60 krb5kdc[14573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076197, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.252@KRBTEST.COM
Aug 07 04:16:37 dist-test-slave-qg60 krb5kdc[14573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076197, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.253@KRBTEST.COM
I20260807 04:16:37.764256 15957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:37.711432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:41497 (local address 127.7.200.253:40319)
0807 04:16:37.727625 (+ 16193us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:37.727634 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:37.731102 (+ 3468us) server_negotiation.cc:407] Connection header received
0807 04:16:37.731278 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:37.731288 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:37.731389 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:37.731508 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:37.735213 (+ 3705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.736140 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.746099 (+ 9959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.746902 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.747024 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:37.752100 (+ 5076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:37.752111 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:37.752119 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:37.752178 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:37.758763 (+ 6585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:37.760398 (+ 1635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:37.760408 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:37.760415 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:37.760634 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:37.761339 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:37.761348 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:37.761354 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:37.761825 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:37.762003 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:37.763352 (+ 1349us) server_negotiation.cc:299] Negotiation successful
0807 04:16:37.763633 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16017,"thread_start_us":15878,"threads_started":1}
I20260807 04:16:37.765762 15960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:37.714043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:40319 (local address 127.7.200.195:41497)
0807 04:16:37.730981 (+ 16938us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:37.730996 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:37.731144 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:37.732035 (+ 891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:37.732050 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:37.733700 (+ 1650us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:37.735013 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:37.735036 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.736382 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.736391 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:37.745837 (+ 9446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:37.745861 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.747461 (+ 1600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.747477 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:37.747683 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:37.748427 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:37.748460 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:37.751748 (+ 3288us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:37.759265 (+ 7517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:37.759279 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:37.759306 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:37.760203 (+ 897us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:37.760833 (+ 630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:37.760842 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:37.760849 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:37.761166 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:37.762099 (+ 933us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:37.762113 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:37.762748 (+ 635us) client_negotiation.cc:769] Sending connection context
0807 04:16:37.763232 (+ 484us) client_negotiation.cc:240] Negotiation successful
0807 04:16:37.763972 (+ 740us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16848,"mutex_wait_us":213,"spinlock_wait_cycles":22656,"thread_start_us":16043,"threads_started":1}
I20260807 04:16:37.765877 15959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:37.713053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:52923 (local address 127.7.200.252:46569)
0807 04:16:37.731610 (+ 18557us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:37.731616 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:37.731637 (+ 21us) server_negotiation.cc:407] Connection header received
0807 04:16:37.731706 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:37.731711 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:37.731796 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:37.731912 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:37.735248 (+ 3336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.736336 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.739678 (+ 3342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.740590 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.740722 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:37.756546 (+ 15824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:37.756557 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:37.756562 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:37.756615 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:37.761330 (+ 4715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:37.762425 (+ 1095us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:37.762430 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:37.762434 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:37.762594 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:37.763869 (+ 1275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:37.763875 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:37.763879 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:37.764283 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:37.764456 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:37.765124 (+ 668us) server_negotiation.cc:299] Negotiation successful
0807 04:16:37.765404 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18423,"thread_start_us":18301,"threads_started":1}
I20260807 04:16:37.767712 15962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:37.713499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:46569 (local address 127.7.200.195:52923)
0807 04:16:37.730388 (+ 16889us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:37.730419 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:37.730550 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:37.732097 (+ 1547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:37.732101 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:37.733700 (+ 1599us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:37.735014 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:37.735041 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.736535 (+ 1494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.736542 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:37.739445 (+ 2903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:37.739466 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.741215 (+ 1749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.741225 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:37.741665 (+ 440us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:37.744085 (+ 2420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:37.744125 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:37.756048 (+ 11923us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:37.761515 (+ 5467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:37.761521 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:37.761525 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:37.762255 (+ 730us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:37.763534 (+ 1279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:37.763541 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:37.763546 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:37.763720 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:37.764553 (+ 833us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:37.764558 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:37.764749 (+ 191us) client_negotiation.cc:769] Sending connection context
0807 04:16:37.766612 (+ 1863us) client_negotiation.cc:240] Negotiation successful
0807 04:16:37.766980 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16732,"mutex_wait_us":160,"spinlock_wait_cycles":36608,"thread_start_us":17213,"threads_started":1}
I20260807 04:16:37.767992 15953 heartbeater.cc:347] Connected to a master server at 127.7.200.253:40319
I20260807 04:16:37.768380 15953 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:37.768867 15951 heartbeater.cc:347] Connected to a master server at 127.7.200.252:46569
I20260807 04:16:37.769071 15951 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:37.769716 15953 heartbeater.cc:511] Master 127.7.200.253:40319 requested a full tablet report, sending...
I20260807 04:16:37.771005 15951 heartbeater.cc:511] Master 127.7.200.252:46569 requested a full tablet report, sending...
I20260807 04:16:37.771535 15958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:37.712148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.7.200.195:33409)
0807 04:16:37.721741 (+ 9593us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:37.721795 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:37.729156 (+ 7361us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:37.732491 (+ 3335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:37.732499 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:37.733703 (+ 1204us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:37.736961 (+ 3258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:37.736979 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.738830 (+ 1851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.738840 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:37.741076 (+ 2236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:37.741098 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.742798 (+ 1700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.742808 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:37.743109 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:37.743934 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:37.743995 (+ 61us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:37.757678 (+ 13683us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:37.762744 (+ 5066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:37.762749 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:37.762753 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:37.763390 (+ 637us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:37.766157 (+ 2767us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:37.766165 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:37.766169 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:37.766379 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:37.770095 (+ 3716us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:37.770100 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:37.770328 (+ 228us) client_negotiation.cc:769] Sending connection context
0807 04:16:37.770504 (+ 176us) client_negotiation.cc:240] Negotiation successful
0807 04:16:37.770883 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9240,"mutex_wait_us":124,"spinlock_wait_cycles":54400,"thread_start_us":8972,"threads_started":1}
I20260807 04:16:37.771864 15955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:37.711287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:33409 (local address 127.7.200.254:42899)
0807 04:16:37.731875 (+ 20588us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:37.731885 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:37.731910 (+ 25us) server_negotiation.cc:407] Connection header received
0807 04:16:37.731986 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:37.731991 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:37.732083 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:37.732215 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:37.737190 (+ 4975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.738459 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.741321 (+ 2862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.742261 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.742435 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:37.757943 (+ 15508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:37.757954 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:37.757962 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:37.758023 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:37.762431 (+ 4408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:37.765035 (+ 2604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:37.765042 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:37.765045 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:37.765232 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:37.768143 (+ 2911us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:37.768149 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:37.768153 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:37.769960 (+ 1807us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:37.770136 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:37.771131 (+ 995us) server_negotiation.cc:299] Negotiation successful
0807 04:16:37.771396 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20423,"thread_start_us":21628,"threads_started":1}
I20260807 04:16:37.772768 15460 ts_manager.cc:194] Registered new tserver with Master: 4943bc3d911b4582b9f211b84aa012a7 (127.7.200.195:46477)
I20260807 04:16:37.773204 15952 heartbeater.cc:347] Connected to a master server at 127.7.200.254:42899
I20260807 04:16:37.773350 15952 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:37.773875 15952 heartbeater.cc:511] Master 127.7.200.254:42899 requested a full tablet report, sending...
I20260807 04:16:37.774731 15262 ts_manager.cc:194] Registered new tserver with Master: 4943bc3d911b4582b9f211b84aa012a7 (127.7.200.195:46477)
I20260807 04:16:37.774958 14620 ts_manager.cc:194] Re-registered known tserver with Master: 4943bc3d911b4582b9f211b84aa012a7 (127.7.200.195:46477)
I20260807 04:16:37.776682 14620 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.200.195@KRBTEST.COM'} at 127.7.200.195:33409
I20260807 04:16:37.788146 15957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:37.736316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46406 (local address 127.7.200.253:40319)
0807 04:16:37.764649 (+ 28333us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:37.764655 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:37.764674 (+ 19us) server_negotiation.cc:407] Connection header received
0807 04:16:37.764768 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:37.764774 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:37.764859 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:37.768796 (+ 3937us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:37.768986 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.772243 (+ 3257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.774660 (+ 2417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.775444 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.776300 (+ 856us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:37.780483 (+ 4183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:37.780489 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:37.780492 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:37.780557 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:37.784266 (+ 3709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:37.785149 (+ 883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:37.785156 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:37.785162 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:37.785318 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:37.785837 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:37.785847 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:37.785853 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:37.786237 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:37.786562 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:37.787374 (+ 812us) server_negotiation.cc:299] Negotiation successful
0807 04:16:37.787663 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28222,"thread_start_us":43197,"threads_started":1}
I20260807 04:16:37.797132 15972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:37.748935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38228 (local address 127.7.200.254:42899)
0807 04:16:37.758249 (+ 9314us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:37.758255 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:37.779393 (+ 21138us) server_negotiation.cc:407] Connection header received
0807 04:16:37.779459 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:37.779464 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:37.779541 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:37.779661 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:37.782479 (+ 2818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.783343 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.785102 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.785731 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.785908 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:37.789993 (+ 4085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:37.790010 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:37.790017 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:37.790070 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:37.793703 (+ 3633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:37.794454 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:37.794460 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:37.794464 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:37.794618 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:37.795217 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:37.795225 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:37.795230 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:37.795674 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:37.795957 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:37.796523 (+ 566us) server_negotiation.cc:299] Negotiation successful
0807 04:16:37.796835 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9134,"thread_start_us":9317,"threads_started":1}
I20260807 04:16:37.798418 15970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:37.736832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38270 (local address 127.7.200.252:46569)
0807 04:16:37.756251 (+ 19419us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:37.756258 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:37.777267 (+ 21009us) server_negotiation.cc:407] Connection header received
0807 04:16:37.777589 (+ 322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:37.777598 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:37.777713 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:37.777821 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:37.781827 (+ 4006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.783310 (+ 1483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.786783 (+ 3473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.787545 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.787688 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:37.791339 (+ 3651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:37.791345 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:37.791348 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:37.791386 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:37.795029 (+ 3643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:37.796050 (+ 1021us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:37.796057 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:37.796060 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:37.796242 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:37.796805 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:37.796813 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:37.796816 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:37.797145 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:37.797447 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:37.797808 (+ 361us) server_negotiation.cc:299] Negotiation successful
0807 04:16:37.798030 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19257,"thread_start_us":19454,"threads_started":1}
I20260807 04:16:37.801740 14620 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38228:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:16:37.809576 14620 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:16:37.855026 15987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:37.833118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38906 (local address 127.7.200.194:41457)
0807 04:16:37.841182 (+ 8064us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:37.841194 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:37.841231 (+ 37us) server_negotiation.cc:407] Connection header received
0807 04:16:37.841350 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:37.841359 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:37.841713 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:37.841985 (+ 272us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:16:37.843298 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.845565 (+ 2267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.849086 (+ 3521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.851394 (+ 2308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.851600 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:37.851855 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:37.853040 (+ 1185us) server_negotiation.cc:299] Negotiation successful
0807 04:16:37.853924 (+ 884us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7879,"thread_start_us":7764,"threads_started":1}
I20260807 04:16:37.855636 15986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:37.832510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:41457 (local address 127.0.0.1:38906)
0807 04:16:37.840953 (+ 8443us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:37.840981 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:37.841131 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:37.842327 (+ 1196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:37.842336 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:37.842376 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:16:37.843033 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:37.843055 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.845819 (+ 2764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.845828 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:37.848799 (+ 2971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:37.848818 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.852026 (+ 3208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.852033 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:37.852274 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:37.852363 (+ 89us) client_negotiation.cc:769] Sending connection context
0807 04:16:37.852606 (+ 243us) client_negotiation.cc:240] Negotiation successful
0807 04:16:37.853267 (+ 661us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8253,"mutex_wait_us":4,"spinlock_wait_cycles":2816,"thread_start_us":8024,"threads_started":1}
I20260807 04:16:37.856973 15989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:37.833385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49450 (local address 127.7.200.195:46477)
0807 04:16:37.837694 (+ 4309us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:37.837709 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:37.841289 (+ 3580us) server_negotiation.cc:407] Connection header received
0807 04:16:37.841388 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:37.841394 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:37.841715 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:37.841942 (+ 227us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:16:37.843503 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.845975 (+ 2472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.850139 (+ 4164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.853307 (+ 3168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.853581 (+ 274us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:37.854887 (+ 1306us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:37.854994 (+ 107us) server_negotiation.cc:299] Negotiation successful
0807 04:16:37.856225 (+ 1231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3884,"thread_start_us":3580,"threads_started":1}
I20260807 04:16:37.857321 15988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:37.833018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:46477 (local address 127.0.0.1:49450)
0807 04:16:37.840990 (+ 7972us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:37.841012 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:37.841153 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:37.842364 (+ 1211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:37.842373 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:37.842412 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:16:37.843200 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:37.843221 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.846226 (+ 3005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.846236 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:37.849865 (+ 3629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:37.849890 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.853808 (+ 3918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.853818 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:37.854133 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:37.854191 (+ 58us) client_negotiation.cc:769] Sending connection context
0807 04:16:37.854298 (+ 107us) client_negotiation.cc:240] Negotiation successful
0807 04:16:37.855668 (+ 1370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7820,"thread_start_us":8211,"threads_started":1}
I20260807 04:16:37.862201 15728 tablet_service.cc:1467] Processing CreateTablet for tablet 2b5ed4f1e7b9493facbf556f8b2ac0ce (DEFAULT_TABLE table=test-table [id=e508b10551a84e80bf2035556618af96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:16:37.863883 15728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b5ed4f1e7b9493facbf556f8b2ac0ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:37.864889 15881 tablet_service.cc:1467] Processing CreateTablet for tablet 2b5ed4f1e7b9493facbf556f8b2ac0ce (DEFAULT_TABLE table=test-table [id=e508b10551a84e80bf2035556618af96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:16:37.866465 15881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b5ed4f1e7b9493facbf556f8b2ac0ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:37.868124 15991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:37.841899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37338 (local address 127.7.200.193:43769)
0807 04:16:37.861570 (+ 19671us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:37.861577 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:37.861603 (+ 26us) server_negotiation.cc:407] Connection header received
0807 04:16:37.861694 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:37.861700 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:37.861884 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:37.862144 (+ 260us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:16:37.862543 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.863857 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.865738 (+ 1881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.866877 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.867058 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:37.867284 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:37.867575 (+ 291us) server_negotiation.cc:299] Negotiation successful
0807 04:16:37.867763 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19476,"thread_start_us":19351,"threads_started":1}
I20260807 04:16:37.868178 15988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:37.841614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:43769 (local address 127.0.0.1:37338)
0807 04:16:37.857789 (+ 16175us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:37.857818 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:37.857968 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:37.862117 (+ 4149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:37.862123 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:37.862156 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:16:37.862363 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:37.862376 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.864120 (+ 1744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.864124 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:37.865511 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:37.865525 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.867090 (+ 1565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.867097 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:37.867313 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:37.867358 (+ 45us) client_negotiation.cc:769] Sending connection context
0807 04:16:37.867602 (+ 244us) client_negotiation.cc:240] Negotiation successful
0807 04:16:37.867773 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16013,"thread_start_us":17163,"threads_started":1}
I20260807 04:16:37.876327 15577 tablet_service.cc:1467] Processing CreateTablet for tablet 2b5ed4f1e7b9493facbf556f8b2ac0ce (DEFAULT_TABLE table=test-table [id=e508b10551a84e80bf2035556618af96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:16:37.877705 15577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b5ed4f1e7b9493facbf556f8b2ac0ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:37.882349 15992 tablet_bootstrap.cc:492] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4f08b06a155a4b898d4315ec68eb738f: Bootstrap starting.
I20260807 04:16:37.886185 15993 tablet_bootstrap.cc:492] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7: Bootstrap starting.
I20260807 04:16:37.886719 15992 tablet_bootstrap.cc:654] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4f08b06a155a4b898d4315ec68eb738f: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:37.888202 15992 log.cc:824] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4f08b06a155a4b898d4315ec68eb738f: Log is configured to *not* fsync() on all Append() calls
I20260807 04:16:37.890027 15993 tablet_bootstrap.cc:654] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:37.891116 15993 log.cc:824] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7: Log is configured to *not* fsync() on all Append() calls
I20260807 04:16:37.891722 15992 tablet_bootstrap.cc:492] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4f08b06a155a4b898d4315ec68eb738f: No bootstrap required, opened a new log
I20260807 04:16:37.892033 15992 ts_tablet_manager.cc:1397] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4f08b06a155a4b898d4315ec68eb738f: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.007s
I20260807 04:16:37.895763 15996 tablet_bootstrap.cc:492] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P a4aff80e488846ed881d6b55607b03d5: Bootstrap starting.
I20260807 04:16:37.900060 15993 tablet_bootstrap.cc:492] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7: No bootstrap required, opened a new log
I20260807 04:16:37.900151 15996 tablet_bootstrap.cc:654] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P a4aff80e488846ed881d6b55607b03d5: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:37.900393 15993 ts_tablet_manager.cc:1397] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.004s
I20260807 04:16:37.901675 15996 log.cc:824] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P a4aff80e488846ed881d6b55607b03d5: Log is configured to *not* fsync() on all Append() calls
I20260807 04:16:37.902063 15992 raft_consensus.cc:348] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4f08b06a155a4b898d4315ec68eb738f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f08b06a155a4b898d4315ec68eb738f" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41457 } } peers { permanent_uuid: "4943bc3d911b4582b9f211b84aa012a7" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 46477 } } peers { permanent_uuid: "a4aff80e488846ed881d6b55607b03d5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43769 } }
I20260807 04:16:37.902624 15992 raft_consensus.cc:374] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4f08b06a155a4b898d4315ec68eb738f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:37.902750 15992 raft_consensus.cc:729] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4f08b06a155a4b898d4315ec68eb738f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f08b06a155a4b898d4315ec68eb738f, State: Initialized, Role: FOLLOWER
I20260807 04:16:37.903493 15992 consensus_queue.cc:260] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4f08b06a155a4b898d4315ec68eb738f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f08b06a155a4b898d4315ec68eb738f" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41457 } } peers { permanent_uuid: "4943bc3d911b4582b9f211b84aa012a7" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 46477 } } peers { permanent_uuid: "a4aff80e488846ed881d6b55607b03d5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43769 } }
I20260807 04:16:37.905498 15992 ts_tablet_manager.cc:1428] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4f08b06a155a4b898d4315ec68eb738f: Time spent starting tablet: real 0.013s user 0.013s sys 0.002s
I20260807 04:16:37.905802 15803 heartbeater.cc:503] Master 127.7.200.254:42899 was elected leader, sending a full tablet report...
I20260807 04:16:37.909469 15996 tablet_bootstrap.cc:492] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P a4aff80e488846ed881d6b55607b03d5: No bootstrap required, opened a new log
I20260807 04:16:37.909862 15996 ts_tablet_manager.cc:1397] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P a4aff80e488846ed881d6b55607b03d5: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.004s
I20260807 04:16:37.912523 15993 raft_consensus.cc:348] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f08b06a155a4b898d4315ec68eb738f" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41457 } } peers { permanent_uuid: "4943bc3d911b4582b9f211b84aa012a7" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 46477 } } peers { permanent_uuid: "a4aff80e488846ed881d6b55607b03d5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43769 } }
I20260807 04:16:37.913050 15993 raft_consensus.cc:374] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:37.913156 15993 raft_consensus.cc:729] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4943bc3d911b4582b9f211b84aa012a7, State: Initialized, Role: FOLLOWER
I20260807 04:16:37.913846 15993 consensus_queue.cc:260] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f08b06a155a4b898d4315ec68eb738f" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41457 } } peers { permanent_uuid: "4943bc3d911b4582b9f211b84aa012a7" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 46477 } } peers { permanent_uuid: "a4aff80e488846ed881d6b55607b03d5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43769 } }
I20260807 04:16:37.915899 15993 ts_tablet_manager.cc:1428] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7: Time spent starting tablet: real 0.015s user 0.017s sys 0.000s
I20260807 04:16:37.916203 15952 heartbeater.cc:503] Master 127.7.200.254:42899 was elected leader, sending a full tablet report...
I20260807 04:16:37.920851 15996 raft_consensus.cc:348] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P a4aff80e488846ed881d6b55607b03d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f08b06a155a4b898d4315ec68eb738f" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41457 } } peers { permanent_uuid: "4943bc3d911b4582b9f211b84aa012a7" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 46477 } } peers { permanent_uuid: "a4aff80e488846ed881d6b55607b03d5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43769 } }
I20260807 04:16:37.921386 15996 raft_consensus.cc:374] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P a4aff80e488846ed881d6b55607b03d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:37.921501 15996 raft_consensus.cc:729] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P a4aff80e488846ed881d6b55607b03d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4aff80e488846ed881d6b55607b03d5, State: Initialized, Role: FOLLOWER
I20260807 04:16:37.922205 15996 consensus_queue.cc:260] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P a4aff80e488846ed881d6b55607b03d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f08b06a155a4b898d4315ec68eb738f" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41457 } } peers { permanent_uuid: "4943bc3d911b4582b9f211b84aa012a7" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 46477 } } peers { permanent_uuid: "a4aff80e488846ed881d6b55607b03d5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43769 } }
I20260807 04:16:37.926370 15996 ts_tablet_manager.cc:1428] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P a4aff80e488846ed881d6b55607b03d5: Time spent starting tablet: real 0.016s user 0.015s sys 0.000s
I20260807 04:16:37.961237 15999 raft_consensus.cc:482] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:16:37.961704 15999 raft_consensus.cc:504] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f08b06a155a4b898d4315ec68eb738f" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41457 } } peers { permanent_uuid: "4943bc3d911b4582b9f211b84aa012a7" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 46477 } } peers { permanent_uuid: "a4aff80e488846ed881d6b55607b03d5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43769 } }
I20260807 04:16:37.963492 15999 leader_election.cc:288] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f08b06a155a4b898d4315ec68eb738f (127.7.200.194:41457), a4aff80e488846ed881d6b55607b03d5 (127.7.200.193:43769)
I20260807 04:16:37.971068 15958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:37.963797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:41457 (local address 127.7.200.195:39777)
0807 04:16:37.964490 (+ 693us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:37.964519 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:37.964665 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:37.965037 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:37.965043 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:37.965073 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:16:37.965266 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:37.965275 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.966601 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.966614 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:37.968659 (+ 2045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:37.968675 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.970313 (+ 1638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.970321 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:37.970531 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:37.970559 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 04:16:37.970635 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 04:16:37.970731 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"mutex_wait_us":555,"spinlock_wait_cycles":896}
I20260807 04:16:37.971344 15987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:37.964190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:39777 (local address 127.7.200.194:41457)
0807 04:16:37.964414 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:37.964420 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:37.964631 (+ 211us) server_negotiation.cc:407] Connection header received
0807 04:16:37.964844 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:37.964848 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:37.964904 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:37.964982 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:16:37.965405 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.966432 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.968838 (+ 2406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.970086 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.970307 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:37.970381 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:37.970924 (+ 543us) server_negotiation.cc:299] Negotiation successful
0807 04:16:37.971077 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 04:16:37.971603 15991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:37.964057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:57401 (local address 127.7.200.193:43769)
0807 04:16:37.964282 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:37.964289 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:37.964312 (+ 23us) server_negotiation.cc:407] Connection header received
0807 04:16:37.964388 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:37.964393 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:37.964484 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:37.964561 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:16:37.965186 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.966301 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.968956 (+ 2655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.970197 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.970352 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:37.970422 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:37.970994 (+ 572us) server_negotiation.cc:299] Negotiation successful
0807 04:16:37.971175 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 04:16:37.971747 15960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:37.963792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:43769 (local address 127.7.200.195:57401)
0807 04:16:37.963982 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:37.964010 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:37.964181 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:37.964617 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:37.964622 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:37.964668 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:16:37.965021 (+ 353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:37.965038 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.966487 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.966492 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:37.968783 (+ 2291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:37.968800 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:37.970571 (+ 1771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:37.970577 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:37.970811 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:37.970841 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 04:16:37.970950 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 04:16:37.971094 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"mutex_wait_us":185,"spinlock_wait_cycles":15872}
I20260807 04:16:37.972337 15751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b5ed4f1e7b9493facbf556f8b2ac0ce" candidate_uuid: "4943bc3d911b4582b9f211b84aa012a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f08b06a155a4b898d4315ec68eb738f" is_pre_election: true
I20260807 04:16:37.972678 15599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b5ed4f1e7b9493facbf556f8b2ac0ce" candidate_uuid: "4943bc3d911b4582b9f211b84aa012a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4aff80e488846ed881d6b55607b03d5" is_pre_election: true
I20260807 04:16:37.972886 15751 raft_consensus.cc:2454] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4f08b06a155a4b898d4315ec68eb738f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4943bc3d911b4582b9f211b84aa012a7 in term 0.
I20260807 04:16:37.973201 15599 raft_consensus.cc:2454] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P a4aff80e488846ed881d6b55607b03d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4943bc3d911b4582b9f211b84aa012a7 in term 0.
I20260807 04:16:37.973740 15835 leader_election.cc:302] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4943bc3d911b4582b9f211b84aa012a7, 4f08b06a155a4b898d4315ec68eb738f; no voters:
I20260807 04:16:37.974195 15999 raft_consensus.cc:2781] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:16:37.974349 15999 raft_consensus.cc:482] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:16:37.974465 15999 raft_consensus.cc:3037] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:37.976667 15999 raft_consensus.cc:504] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f08b06a155a4b898d4315ec68eb738f" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41457 } } peers { permanent_uuid: "4943bc3d911b4582b9f211b84aa012a7" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 46477 } } peers { permanent_uuid: "a4aff80e488846ed881d6b55607b03d5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43769 } }
I20260807 04:16:37.977249 15999 leader_election.cc:288] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f08b06a155a4b898d4315ec68eb738f (127.7.200.194:41457), a4aff80e488846ed881d6b55607b03d5 (127.7.200.193:43769)
I20260807 04:16:37.977767 15599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b5ed4f1e7b9493facbf556f8b2ac0ce" candidate_uuid: "4943bc3d911b4582b9f211b84aa012a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4aff80e488846ed881d6b55607b03d5"
I20260807 04:16:37.977768 15751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b5ed4f1e7b9493facbf556f8b2ac0ce" candidate_uuid: "4943bc3d911b4582b9f211b84aa012a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f08b06a155a4b898d4315ec68eb738f"
I20260807 04:16:37.977984 15751 raft_consensus.cc:3037] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4f08b06a155a4b898d4315ec68eb738f [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:37.977993 15599 raft_consensus.cc:3037] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P a4aff80e488846ed881d6b55607b03d5 [term 0 FOLLOWER]: Advancing to term 1
W20260807 04:16:37.979874 15954 tablet.cc:2369] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:16:37.981370 15751 raft_consensus.cc:2454] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4f08b06a155a4b898d4315ec68eb738f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4943bc3d911b4582b9f211b84aa012a7 in term 1.
I20260807 04:16:37.981370 15599 raft_consensus.cc:2454] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P a4aff80e488846ed881d6b55607b03d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4943bc3d911b4582b9f211b84aa012a7 in term 1.
I20260807 04:16:37.981767 15835 leader_election.cc:302] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4943bc3d911b4582b9f211b84aa012a7, 4f08b06a155a4b898d4315ec68eb738f; no voters:
I20260807 04:16:37.982117 15999 raft_consensus.cc:2781] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:16:37.982601 15999 raft_consensus.cc:686] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7 [term 1 LEADER]: Becoming Leader. State: Replica: 4943bc3d911b4582b9f211b84aa012a7, State: Running, Role: LEADER
I20260807 04:16:37.983238 15999 consensus_queue.cc:237] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f08b06a155a4b898d4315ec68eb738f" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41457 } } peers { permanent_uuid: "4943bc3d911b4582b9f211b84aa012a7" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 46477 } } peers { permanent_uuid: "a4aff80e488846ed881d6b55607b03d5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43769 } }
I20260807 04:16:37.988507 14619 catalog_manager.cc:5495] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4943bc3d911b4582b9f211b84aa012a7 (127.7.200.195). New cstate: current_term: 1 leader_uuid: "4943bc3d911b4582b9f211b84aa012a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f08b06a155a4b898d4315ec68eb738f" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4943bc3d911b4582b9f211b84aa012a7" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 46477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4aff80e488846ed881d6b55607b03d5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43769 } health_report { overall_health: UNKNOWN } } }
I20260807 04:16:38.009887 15989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:38.004643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49458 (local address 127.7.200.195:46477)
0807 04:16:38.004853 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:38.004857 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:38.004875 (+ 18us) server_negotiation.cc:407] Connection header received
0807 04:16:38.005052 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:38.005056 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:38.005174 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:38.005309 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:16:38.005647 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:38.006375 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:38.007739 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:38.008153 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:38.008244 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:38.008808 (+ 564us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:16:38.009400 (+ 592us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:16:38.009523 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:38.009595 (+ 72us) server_negotiation.cc:299] Negotiation successful
0807 04:16:38.009670 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 04:16:38.018692 15751 raft_consensus.cc:1261] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4f08b06a155a4b898d4315ec68eb738f [term 1 FOLLOWER]: Refusing update from remote peer 4943bc3d911b4582b9f211b84aa012a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:16:38.018777 15599 raft_consensus.cc:1261] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P a4aff80e488846ed881d6b55607b03d5 [term 1 FOLLOWER]: Refusing update from remote peer 4943bc3d911b4582b9f211b84aa012a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:16:38.019794 16001 consensus_queue.cc:1035] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f08b06a155a4b898d4315ec68eb738f" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:16:38.020190 15999 consensus_queue.cc:1035] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4aff80e488846ed881d6b55607b03d5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 04:16:38.047060 15805 tablet.cc:2369] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4f08b06a155a4b898d4315ec68eb738f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:16:38.059804 14619 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38228:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:16:38.060117 14619 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38228:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:16:38.070801 14619 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 329b3bda2cfd475ab60e1f1c7c21478b: Sending DeleteTablet for 3 replicas of tablet 2b5ed4f1e7b9493facbf556f8b2ac0ce
I20260807 04:16:38.072144 15728 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b5ed4f1e7b9493facbf556f8b2ac0ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:16:38 UTC) from {username='oryx', principal='oryx/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:38906
I20260807 04:16:38.072525 15727 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b5ed4f1e7b9493facbf556f8b2ac0ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:16:38 UTC) from {username='oryx', principal='oryx/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:38906
I20260807 04:16:38.072558 15577 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b5ed4f1e7b9493facbf556f8b2ac0ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:16:38 UTC) from {username='oryx', principal='oryx/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:37338
I20260807 04:16:38.073557 15881 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b5ed4f1e7b9493facbf556f8b2ac0ce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:16:38 UTC) from {username='oryx', principal='oryx/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:49450
I20260807 04:16:38.076014 16015 tablet_replica.cc:330] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P a4aff80e488846ed881d6b55607b03d5: stopping tablet replica
I20260807 04:16:38.076525 16015 raft_consensus.cc:2229] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P a4aff80e488846ed881d6b55607b03d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:16:38.077246 16015 raft_consensus.cc:2258] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P a4aff80e488846ed881d6b55607b03d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:16:38.080288 16015 ts_tablet_manager.cc:1905] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P a4aff80e488846ed881d6b55607b03d5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:16:38.084923 16016 tablet_replica.cc:330] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7: stopping tablet replica
I20260807 04:16:38.085600 16016 raft_consensus.cc:2229] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7 [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:16:38.086459 16016 raft_consensus.cc:2258] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:16:38.088413 16014 tablet_replica.cc:330] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4f08b06a155a4b898d4315ec68eb738f: stopping tablet replica
I20260807 04:16:38.089505 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 14587
I20260807 04:16:38.090227 16016 ts_tablet_manager.cc:1905] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:16:38.091797 14650 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:38.093230 16015 ts_tablet_manager.cc:1918] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P a4aff80e488846ed881d6b55607b03d5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:16:38.093425 16015 log.cc:1196] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P a4aff80e488846ed881d6b55607b03d5: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/wal/wals/2b5ed4f1e7b9493facbf556f8b2ac0ce
I20260807 04:16:38.094053 16015 ts_tablet_manager.cc:1939] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P a4aff80e488846ed881d6b55607b03d5: Deleting consensus metadata
I20260807 04:16:38.096311 16014 raft_consensus.cc:2229] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4f08b06a155a4b898d4315ec68eb738f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:16:38.096905 16014 raft_consensus.cc:2258] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4f08b06a155a4b898d4315ec68eb738f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:16:38.101169 16016 ts_tablet_manager.cc:1918] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:16:38.101289 16014 ts_tablet_manager.cc:1905] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4f08b06a155a4b898d4315ec68eb738f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:16:38.101378 16016 log.cc:1196] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/wal/wals/2b5ed4f1e7b9493facbf556f8b2ac0ce
I20260807 04:16:38.102018 16016 ts_tablet_manager.cc:1939] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4943bc3d911b4582b9f211b84aa012a7: Deleting consensus metadata
I20260807 04:16:38.109200 16014 ts_tablet_manager.cc:1918] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4f08b06a155a4b898d4315ec68eb738f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:16:38.109388 16014 log.cc:1196] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4f08b06a155a4b898d4315ec68eb738f: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/wal/wals/2b5ed4f1e7b9493facbf556f8b2ac0ce
I20260807 04:16:38.110004 16014 ts_tablet_manager.cc:1939] T 2b5ed4f1e7b9493facbf556f8b2ac0ce P 4f08b06a155a4b898d4315ec68eb738f: Deleting consensus metadata
I20260807 04:16:38.114171 15957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:38.075182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46418 (local address 127.7.200.253:40319)
0807 04:16:38.075372 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:38.075378 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:38.087591 (+ 12213us) server_negotiation.cc:407] Connection header received
0807 04:16:38.087819 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:38.087825 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:38.087925 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:38.088046 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:38.091039 (+ 2993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:38.092268 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:38.099239 (+ 6971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:38.099930 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:38.100082 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:38.107621 (+ 7539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:38.107627 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:38.107630 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:38.107670 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:38.110958 (+ 3288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:38.111876 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:38.111890 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:38.111893 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:38.112035 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:38.112466 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:38.112479 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:38.112482 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:38.112847 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:38.113132 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:38.113526 (+ 394us) server_negotiation.cc:299] Negotiation successful
0807 04:16:38.113777 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 04:16:38.132302 15970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:38.087741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38272 (local address 127.7.200.252:46569)
0807 04:16:38.088327 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:38.088334 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:38.114387 (+ 26053us) server_negotiation.cc:407] Connection header received
0807 04:16:38.114881 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:38.114887 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:38.114976 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:38.115058 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:38.117514 (+ 2456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:38.118701 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:38.120612 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:38.121347 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:38.121480 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:38.124992 (+ 3512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:38.125000 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:38.125006 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:38.125053 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:38.129167 (+ 4114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:38.130071 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:38.130077 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:38.130081 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:38.130249 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:38.130683 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:38.130688 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:38.130692 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:38.131051 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:38.131320 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:38.131689 (+ 369us) server_negotiation.cc:299] Negotiation successful
0807 04:16:38.131931 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437}
I20260807 04:16:38.231781 14605 catalog_manager.cc:4841] TS 4f08b06a155a4b898d4315ec68eb738f (127.7.200.194:41457): tablet 2b5ed4f1e7b9493facbf556f8b2ac0ce (table test-table [id=e508b10551a84e80bf2035556618af96]) successfully deleted
I20260807 04:16:38.232256 14603 catalog_manager.cc:4841] TS 4943bc3d911b4582b9f211b84aa012a7 (127.7.200.195:46477): tablet 2b5ed4f1e7b9493facbf556f8b2ac0ce (table test-table [id=e508b10551a84e80bf2035556618af96]) successfully deleted
W20260807 04:16:38.232357 14605 catalog_manager.cc:4808] TS 4f08b06a155a4b898d4315ec68eb738f (127.7.200.194:41457): delete failed for tablet 2b5ed4f1e7b9493facbf556f8b2ac0ce because the tablet was not found. No further retry: Not found: Tablet not found: 2b5ed4f1e7b9493facbf556f8b2ac0ce
I20260807 04:16:38.232554 14603 catalog_manager.cc:4841] TS a4aff80e488846ed881d6b55607b03d5 (127.7.200.193:43769): tablet 2b5ed4f1e7b9493facbf556f8b2ac0ce (table test-table [id=e508b10551a84e80bf2035556618af96]) successfully deleted
I20260807 04:16:38.232651 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 14587
I20260807 04:16:38.286051 15957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:38.262844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46426 (local address 127.7.200.253:40319)
0807 04:16:38.263282 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:38.263291 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:38.267860 (+ 4569us) server_negotiation.cc:407] Connection header received
0807 04:16:38.268375 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:38.268384 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:38.268543 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:38.268626 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:38.271779 (+ 3153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:38.272813 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:38.274409 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:38.275184 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:38.275348 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:38.279024 (+ 3676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:38.279031 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:38.279034 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:38.279086 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:38.282834 (+ 3748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:38.283844 (+ 1010us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:38.283851 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:38.283857 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:38.284031 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:38.284435 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:38.284440 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:38.284443 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:38.284826 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:38.285095 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:38.285449 (+ 354us) server_negotiation.cc:299] Negotiation successful
0807 04:16:38.285681 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277}
I20260807 04:16:38.286800 15970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:38.262842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38288 (local address 127.7.200.252:46569)
0807 04:16:38.263085 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:38.263092 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:38.267990 (+ 4898us) server_negotiation.cc:407] Connection header received
0807 04:16:38.268720 (+ 730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:38.268792 (+ 72us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:38.268918 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:38.269012 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:38.271268 (+ 2256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:38.272353 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:38.274523 (+ 2170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:38.275230 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:38.275347 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:38.278953 (+ 3606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:38.278962 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:38.278967 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:38.279021 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:38.283098 (+ 4077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:38.283878 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:38.283886 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:38.283890 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:38.284049 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:38.284968 (+ 919us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:38.284973 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:38.284977 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:38.285331 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:38.285584 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:38.286214 (+ 630us) server_negotiation.cc:299] Negotiation successful
0807 04:16:38.286466 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 04:16:39.053599 16026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.052489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.7.200.193:47425)
0807 04:16:39.053132 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.053310 (+ 178us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":338,"threads_started":1}
W20260807 04:16:39.054246 15647 heartbeater.cc:644] Failed to heartbeat to 127.7.200.254:42899 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
I20260807 04:16:39.056634 16027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.055639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.7.200.195:53567)
0807 04:16:39.056172 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.056321 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":303,"threads_started":1}
W20260807 04:16:39.057049 15952 heartbeater.cc:644] Failed to heartbeat to 127.7.200.254:42899 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
I20260807 04:16:39.073621 16028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.072539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.7.200.194:32875)
0807 04:16:39.073204 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.073373 (+ 169us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":413,"threads_started":1}
W20260807 04:16:39.074128 15803 heartbeater.cc:644] Failed to heartbeat to 127.7.200.254:42899 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
I20260807 04:16:39.571904 16029 raft_consensus.cc:482] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 329b3bda2cfd475ab60e1f1c7c21478b)
I20260807 04:16:39.572176 16029 raft_consensus.cc:504] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: false } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: false } }
I20260807 04:16:39.573657 16029 leader_election.cc:288] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 329b3bda2cfd475ab60e1f1c7c21478b (127.7.200.254:42899), 56970c659fbc4e81994f4331243d3151 (127.7.200.252:46569)
I20260807 04:16:39.574810 16030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.573702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.0.0.1:38656)
0807 04:16:39.574255 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.574469 (+ 214us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":264,"threads_started":1}
W20260807 04:16:39.575172 15247 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
I20260807 04:16:39.576889 16034 raft_consensus.cc:482] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 329b3bda2cfd475ab60e1f1c7c21478b)
I20260807 04:16:39.577250 16031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.576713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.0.0.1:38664)
0807 04:16:39.576882 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.577049 (+ 167us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260807 04:16:39.577180 16034 raft_consensus.cc:504] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: false } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: false } }
W20260807 04:16:39.577507 15247 leader_election.cc:334] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 329b3bda2cfd475ab60e1f1c7c21478b (127.7.200.254:42899): Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
I20260807 04:16:39.578605 16034 leader_election.cc:288] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 329b3bda2cfd475ab60e1f1c7c21478b (127.7.200.254:42899), 56fb5f1c90f44bafb30c535276eefd83 (127.7.200.253:40319)
I20260807 04:16:39.582415 16036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.578873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.0.0.1:38672)
0807 04:16:39.581780 (+ 2907us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.582035 (+ 255us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2797,"thread_start_us":2670,"threads_started":1}
I20260807 04:16:39.582849 16030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.573873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:46569 (local address 127.0.0.1:38292)
0807 04:16:39.575067 (+ 1194us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.575085 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:39.575249 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:39.575739 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:39.575745 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:39.575782 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:16:39.576147 (+ 365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:39.576163 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.577845 (+ 1682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.577849 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:39.579773 (+ 1924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:39.579816 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.582011 (+ 2195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.582020 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:39.582233 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:39.582269 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 04:16:39.582372 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 04:16:39.582536 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1098,"thread_start_us":1735,"threads_started":1}
W20260807 04:16:39.582777 15446 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
I20260807 04:16:39.583038 16032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.574299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38292 (local address 127.7.200.252:46569)
0807 04:16:39.574970 (+ 671us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:39.574980 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:39.575178 (+ 198us) server_negotiation.cc:407] Connection header received
0807 04:16:39.575418 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:39.575426 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:39.575541 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:39.576321 (+ 780us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:16:39.576493 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.577718 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.580332 (+ 2614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.581844 (+ 1512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.582057 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:39.582198 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:39.582454 (+ 256us) server_negotiation.cc:299] Negotiation successful
0807 04:16:39.582615 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":489,"thread_start_us":292,"threads_started":1}
I20260807 04:16:39.583673 15470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "56fb5f1c90f44bafb30c535276eefd83" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "56970c659fbc4e81994f4331243d3151" is_pre_election: true
I20260807 04:16:39.584050 15470 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56fb5f1c90f44bafb30c535276eefd83 in term 1.
I20260807 04:16:39.584530 15244 leader_election.cc:302] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56970c659fbc4e81994f4331243d3151, 56fb5f1c90f44bafb30c535276eefd83; no voters: 329b3bda2cfd475ab60e1f1c7c21478b
I20260807 04:16:39.584846 16036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.584336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.0.0.1:38678)
0807 04:16:39.584558 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.584651 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
W20260807 04:16:39.585003 15446 leader_election.cc:334] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 329b3bda2cfd475ab60e1f1c7c21478b (127.7.200.254:42899): Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
I20260807 04:16:39.585204 16029 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 04:16:39.585351 16029 raft_consensus.cc:482] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 329b3bda2cfd475ab60e1f1c7c21478b)
I20260807 04:16:39.585469 16029 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [term 1 FOLLOWER]: Advancing to term 2
I20260807 04:16:39.587620 16029 raft_consensus.cc:504] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: false } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: false } }
I20260807 04:16:39.588316 16029 leader_election.cc:288] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [CANDIDATE]: Term 2 election: Requested vote from peers 329b3bda2cfd475ab60e1f1c7c21478b (127.7.200.254:42899), 56970c659fbc4e81994f4331243d3151 (127.7.200.252:46569)
I20260807 04:16:39.588940 16030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.588417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.0.0.1:38686)
0807 04:16:39.588631 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.588710 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
I20260807 04:16:39.588810 15470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "56fb5f1c90f44bafb30c535276eefd83" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "56970c659fbc4e81994f4331243d3151"
I20260807 04:16:39.589123 15470 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [term 1 FOLLOWER]: Advancing to term 2
I20260807 04:16:39.590039 16030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.589662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.0.0.1:38698)
0807 04:16:39.589844 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.589911 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
W20260807 04:16:39.590319 15247 leader_election.cc:334] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 329b3bda2cfd475ab60e1f1c7c21478b (127.7.200.254:42899): Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
I20260807 04:16:39.590564 16035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.578856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:40319 (local address 127.0.0.1:46428)
0807 04:16:39.581095 (+ 2239us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.581119 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:39.581284 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:39.581874 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:39.581898 (+ 24us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:39.581931 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:16:39.582430 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:39.582442 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.584338 (+ 1896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.584342 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:39.586216 (+ 1874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:39.586228 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.589645 (+ 3417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.589652 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:39.589849 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:39.589891 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 04:16:39.589994 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 04:16:39.590130 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2055,"mutex_wait_us":24,"thread_start_us":1873,"threads_started":1}
I20260807 04:16:39.590608 16037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.579068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46428 (local address 127.7.200.253:40319)
0807 04:16:39.580469 (+ 1401us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:39.580477 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:39.581230 (+ 753us) server_negotiation.cc:407] Connection header received
0807 04:16:39.581417 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:39.581423 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:39.581499 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:39.581600 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:16:39.582635 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.584182 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.588027 (+ 3845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.589465 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.589606 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:39.589725 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:39.590043 (+ 318us) server_negotiation.cc:299] Negotiation successful
0807 04:16:39.590199 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1243,"thread_start_us":1030,"threads_started":1}
I20260807 04:16:39.591107 15273 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "56970c659fbc4e81994f4331243d3151" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "56fb5f1c90f44bafb30c535276eefd83" is_pre_election: true
I20260807 04:16:39.591430 15273 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56970c659fbc4e81994f4331243d3151 in current term 2: Already voted for candidate 56fb5f1c90f44bafb30c535276eefd83 in this term.
I20260807 04:16:39.592051 15445 leader_election.cc:302] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56970c659fbc4e81994f4331243d3151; no voters: 329b3bda2cfd475ab60e1f1c7c21478b, 56fb5f1c90f44bafb30c535276eefd83
I20260807 04:16:39.592290 15470 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56fb5f1c90f44bafb30c535276eefd83 in term 2.
I20260807 04:16:39.592463 16034 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 04:16:39.592887 15244 leader_election.cc:302] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56970c659fbc4e81994f4331243d3151, 56fb5f1c90f44bafb30c535276eefd83; no voters: 329b3bda2cfd475ab60e1f1c7c21478b
I20260807 04:16:39.593145 16029 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 04:16:39.593609 16029 raft_consensus.cc:686] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [term 2 LEADER]: Becoming Leader. State: Replica: 56fb5f1c90f44bafb30c535276eefd83, State: Running, Role: LEADER
I20260807 04:16:39.593977 16029 consensus_queue.cc:237] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: false } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: false } }
I20260807 04:16:39.595858 16039 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56fb5f1c90f44bafb30c535276eefd83. Latest consensus state: current_term: 2 leader_uuid: "56fb5f1c90f44bafb30c535276eefd83" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: false } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: false } } }
I20260807 04:16:39.596271 16039 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:39.597059 16041 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:16:39.601081 16041 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:16:39.602000 16041 catalog_manager.cc:1259] Loaded cluster ID: 1c650dcb40a341629501662a324e1a80
I20260807 04:16:39.602118 16041 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:16:39.603371 16041 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:16:39.604321 16041 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83: Loaded TSK: 0
I20260807 04:16:39.605283 16041 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:16:39.627583 15262 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46426:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:16:39.635622 15262 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:16:39.640262 16030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.639824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.0.0.1:38712)
0807 04:16:39.640035 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.640114 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260807 04:16:39.640462 15470 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [term 2 FOLLOWER]: Refusing update from remote peer 56fb5f1c90f44bafb30c535276eefd83: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260807 04:16:39.641319 16030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.640948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.0.0.1:38718)
0807 04:16:39.641107 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.641173 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260807 04:16:39.641371 16039 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260807 04:16:39.641698 15247 consensus_peers.cc:487] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 -> Peer 329b3bda2cfd475ab60e1f1c7c21478b (127.7.200.254:42899): Couldn't send request to peer 329b3bda2cfd475ab60e1f1c7c21478b. Status: Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 04:16:39.644550 16034 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56fb5f1c90f44bafb30c535276eefd83. Latest consensus state: current_term: 2 leader_uuid: "56fb5f1c90f44bafb30c535276eefd83" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: false } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: false } } }
I20260807 04:16:39.644894 16034 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 04:16:39.646246 16029 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "56fb5f1c90f44bafb30c535276eefd83" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: false } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: false } } }
I20260807 04:16:39.646627 16029 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83 [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:39.646723 16034 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "56fb5f1c90f44bafb30c535276eefd83" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "329b3bda2cfd475ab60e1f1c7c21478b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } peers { permanent_uuid: "56fb5f1c90f44bafb30c535276eefd83" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 40319 } attrs { promote: false } } peers { permanent_uuid: "56970c659fbc4e81994f4331243d3151" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 46569 } attrs { promote: false } } }
I20260807 04:16:39.646961 16034 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56970c659fbc4e81994f4331243d3151 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 04:16:39.663400 16030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.655850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:41457 (local address 127.0.0.1:38908)
0807 04:16:39.656117 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.656138 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:39.656243 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:39.657148 (+ 905us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:39.657152 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:39.657178 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:16:39.657395 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:39.657411 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.658904 (+ 1493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.658909 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:39.660358 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:39.660391 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.661998 (+ 1607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.662008 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:39.662428 (+ 420us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:39.662556 (+ 128us) client_negotiation.cc:769] Sending connection context
0807 04:16:39.662693 (+ 137us) client_negotiation.cc:240] Negotiation successful
0807 04:16:39.662918 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61,"mutex_wait_us":58}
I20260807 04:16:39.664567 16050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.656297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38908 (local address 127.7.200.194:41457)
0807 04:16:39.656855 (+ 558us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:39.656862 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:39.656881 (+ 19us) server_negotiation.cc:407] Connection header received
0807 04:16:39.656954 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:39.656958 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:39.657013 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:39.657167 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:16:39.657592 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.658727 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.660596 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.661813 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.661940 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:39.662039 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:39.663866 (+ 1827us) server_negotiation.cc:299] Negotiation successful
0807 04:16:39.664097 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":295,"threads_started":1}
I20260807 04:16:39.664882 16031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.656267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:43769 (local address 127.0.0.1:37348)
0807 04:16:39.656638 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.656656 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:39.656784 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:39.657637 (+ 853us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:39.657642 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:39.657669 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:16:39.658095 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:39.658121 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.660430 (+ 2309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.660437 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:39.662520 (+ 2083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:39.662536 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.664090 (+ 1554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.664097 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:39.664272 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:39.664295 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 04:16:39.664402 (+ 107us) client_negotiation.cc:240] Negotiation successful
0807 04:16:39.664541 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"mutex_wait_us":89}
I20260807 04:16:39.664906 16051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.656720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37348 (local address 127.7.200.193:43769)
0807 04:16:39.657229 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:39.657236 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:39.657258 (+ 22us) server_negotiation.cc:407] Connection header received
0807 04:16:39.657343 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:39.657351 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:39.657430 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:39.658360 (+ 930us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:16:39.658611 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.660277 (+ 1666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.662706 (+ 2429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.663870 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.664034 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:39.664151 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:39.664428 (+ 277us) server_negotiation.cc:299] Negotiation successful
0807 04:16:39.664566 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":1013,"threads_started":1}
I20260807 04:16:39.665795 15728 tablet_service.cc:1467] Processing CreateTablet for tablet a78ee6ad146647cb9f9c3d82894b9ecd (DEFAULT_TABLE table=test-table [id=407754c9a1b14eb7bda1a13eb6d4af62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:16:39.666249 15728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a78ee6ad146647cb9f9c3d82894b9ecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:39.666124 15577 tablet_service.cc:1467] Processing CreateTablet for tablet a78ee6ad146647cb9f9c3d82894b9ecd (DEFAULT_TABLE table=test-table [id=407754c9a1b14eb7bda1a13eb6d4af62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:16:39.666724 15577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a78ee6ad146647cb9f9c3d82894b9ecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:39.674283 16054 tablet_bootstrap.cc:492] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f: Bootstrap starting.
I20260807 04:16:39.675834 16054 tablet_bootstrap.cc:654] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:39.677037 16052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.657186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:46477 (local address 127.0.0.1:49460)
0807 04:16:39.658770 (+ 1584us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.658789 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:39.658933 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:39.668980 (+ 10047us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:39.668985 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:39.669060 (+ 75us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:16:39.669396 (+ 336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:39.669408 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.670940 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.670945 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:39.673603 (+ 2658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:39.673626 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.676095 (+ 2469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.676104 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:39.676305 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:39.676341 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 04:16:39.676450 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 04:16:39.676600 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":651,"threads_started":1}
I20260807 04:16:39.677171 16053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.657619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49460 (local address 127.7.200.195:46477)
0807 04:16:39.668590 (+ 10971us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:39.668597 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:39.668619 (+ 22us) server_negotiation.cc:407] Connection header received
0807 04:16:39.668700 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:39.668706 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:39.668829 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:39.668962 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:16:39.669586 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.670789 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.673806 (+ 3017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.675792 (+ 1986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.675993 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:39.676165 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:39.676506 (+ 341us) server_negotiation.cc:299] Negotiation successful
0807 04:16:39.676772 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10820,"thread_start_us":11484,"threads_started":1}
I20260807 04:16:39.678587 15881 tablet_service.cc:1467] Processing CreateTablet for tablet a78ee6ad146647cb9f9c3d82894b9ecd (DEFAULT_TABLE table=test-table [id=407754c9a1b14eb7bda1a13eb6d4af62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:16:39.679221 15881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a78ee6ad146647cb9f9c3d82894b9ecd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:39.685509 16055 tablet_bootstrap.cc:492] T a78ee6ad146647cb9f9c3d82894b9ecd P a4aff80e488846ed881d6b55607b03d5: Bootstrap starting.
I20260807 04:16:39.688112 16055 tablet_bootstrap.cc:654] T a78ee6ad146647cb9f9c3d82894b9ecd P a4aff80e488846ed881d6b55607b03d5: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:39.688308 16057 tablet_bootstrap.cc:492] T a78ee6ad146647cb9f9c3d82894b9ecd P 4943bc3d911b4582b9f211b84aa012a7: Bootstrap starting.
I20260807 04:16:39.690146 16057 tablet_bootstrap.cc:654] T a78ee6ad146647cb9f9c3d82894b9ecd P 4943bc3d911b4582b9f211b84aa012a7: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:39.690708 16054 tablet_bootstrap.cc:492] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f: No bootstrap required, opened a new log
I20260807 04:16:39.690881 16054 ts_tablet_manager.cc:1397] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.012s
I20260807 04:16:39.691215 16055 tablet_bootstrap.cc:492] T a78ee6ad146647cb9f9c3d82894b9ecd P a4aff80e488846ed881d6b55607b03d5: No bootstrap required, opened a new log
I20260807 04:16:39.691392 16055 ts_tablet_manager.cc:1397] T a78ee6ad146647cb9f9c3d82894b9ecd P a4aff80e488846ed881d6b55607b03d5: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 04:16:39.691980 16054 raft_consensus.cc:348] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f08b06a155a4b898d4315ec68eb738f" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41457 } } peers { permanent_uuid: "a4aff80e488846ed881d6b55607b03d5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43769 } } peers { permanent_uuid: "4943bc3d911b4582b9f211b84aa012a7" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 46477 } }
I20260807 04:16:39.692340 16054 raft_consensus.cc:374] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:39.692183 16055 raft_consensus.cc:348] T a78ee6ad146647cb9f9c3d82894b9ecd P a4aff80e488846ed881d6b55607b03d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f08b06a155a4b898d4315ec68eb738f" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41457 } } peers { permanent_uuid: "a4aff80e488846ed881d6b55607b03d5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43769 } } peers { permanent_uuid: "4943bc3d911b4582b9f211b84aa012a7" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 46477 } }
I20260807 04:16:39.692432 16055 raft_consensus.cc:374] T a78ee6ad146647cb9f9c3d82894b9ecd P a4aff80e488846ed881d6b55607b03d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:39.692531 16054 raft_consensus.cc:729] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f08b06a155a4b898d4315ec68eb738f, State: Initialized, Role: FOLLOWER
I20260807 04:16:39.692557 16055 raft_consensus.cc:729] T a78ee6ad146647cb9f9c3d82894b9ecd P a4aff80e488846ed881d6b55607b03d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4aff80e488846ed881d6b55607b03d5, State: Initialized, Role: FOLLOWER
I20260807 04:16:39.692857 16055 consensus_queue.cc:260] T a78ee6ad146647cb9f9c3d82894b9ecd P a4aff80e488846ed881d6b55607b03d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f08b06a155a4b898d4315ec68eb738f" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41457 } } peers { permanent_uuid: "a4aff80e488846ed881d6b55607b03d5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43769 } } peers { permanent_uuid: "4943bc3d911b4582b9f211b84aa012a7" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 46477 } }
I20260807 04:16:39.692900 16054 consensus_queue.cc:260] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f08b06a155a4b898d4315ec68eb738f" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41457 } } peers { permanent_uuid: "a4aff80e488846ed881d6b55607b03d5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43769 } } peers { permanent_uuid: "4943bc3d911b4582b9f211b84aa012a7" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 46477 } }
I20260807 04:16:39.693787 16055 ts_tablet_manager.cc:1428] T a78ee6ad146647cb9f9c3d82894b9ecd P a4aff80e488846ed881d6b55607b03d5: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 04:16:39.694038 16057 tablet_bootstrap.cc:492] T a78ee6ad146647cb9f9c3d82894b9ecd P 4943bc3d911b4582b9f211b84aa012a7: No bootstrap required, opened a new log
I20260807 04:16:39.694058 16054 ts_tablet_manager.cc:1428] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 04:16:39.698148 16063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.694850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.7.200.194:48895)
0807 04:16:39.697688 (+ 2838us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.697845 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2707,"thread_start_us":2581,"threads_started":1}
I20260807 04:16:39.698333 15648 heartbeater.cc:503] Master 127.7.200.253:40319 was elected leader, sending a full tablet report...
I20260807 04:16:39.698477 15804 heartbeater.cc:503] Master 127.7.200.253:40319 was elected leader, sending a full tablet report...
I20260807 04:16:39.699623 16057 ts_tablet_manager.cc:1397] T a78ee6ad146647cb9f9c3d82894b9ecd P 4943bc3d911b4582b9f211b84aa012a7: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.000s
I20260807 04:16:39.700526 16057 raft_consensus.cc:348] T a78ee6ad146647cb9f9c3d82894b9ecd P 4943bc3d911b4582b9f211b84aa012a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f08b06a155a4b898d4315ec68eb738f" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41457 } } peers { permanent_uuid: "a4aff80e488846ed881d6b55607b03d5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43769 } } peers { permanent_uuid: "4943bc3d911b4582b9f211b84aa012a7" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 46477 } }
I20260807 04:16:39.700800 16057 raft_consensus.cc:374] T a78ee6ad146647cb9f9c3d82894b9ecd P 4943bc3d911b4582b9f211b84aa012a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:39.700904 16057 raft_consensus.cc:729] T a78ee6ad146647cb9f9c3d82894b9ecd P 4943bc3d911b4582b9f211b84aa012a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4943bc3d911b4582b9f211b84aa012a7, State: Initialized, Role: FOLLOWER
I20260807 04:16:39.701431 16063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.699015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.7.200.194:42091)
0807 04:16:39.701188 (+ 2173us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.701278 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2046}
I20260807 04:16:39.701669 16057 consensus_queue.cc:260] T a78ee6ad146647cb9f9c3d82894b9ecd P 4943bc3d911b4582b9f211b84aa012a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f08b06a155a4b898d4315ec68eb738f" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41457 } } peers { permanent_uuid: "a4aff80e488846ed881d6b55607b03d5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43769 } } peers { permanent_uuid: "4943bc3d911b4582b9f211b84aa012a7" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 46477 } }
I20260807 04:16:39.702378 16064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.695250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.7.200.193:34953)
0807 04:16:39.701796 (+ 6546us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.702064 (+ 268us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6401,"thread_start_us":6454,"threads_started":1}
I20260807 04:16:39.702608 16057 ts_tablet_manager.cc:1428] T a78ee6ad146647cb9f9c3d82894b9ecd P 4943bc3d911b4582b9f211b84aa012a7: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 04:16:39.703747 16064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.703195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.7.200.193:60799)
0807 04:16:39.703492 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.703595 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163}
I20260807 04:16:39.704284 16066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.703080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.7.200.195:33873)
0807 04:16:39.703770 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.703972 (+ 202us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":416,"threads_started":1}
I20260807 04:16:39.704999 15953 heartbeater.cc:503] Master 127.7.200.253:40319 was elected leader, sending a full tablet report...
I20260807 04:16:39.705986 16067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.704918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.7.200.195:53051)
0807 04:16:39.705577 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.705774 (+ 197us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":340,"threads_started":1}
I20260807 04:16:39.766867 16061 raft_consensus.cc:482] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:16:39.767109 16061 raft_consensus.cc:504] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f08b06a155a4b898d4315ec68eb738f" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41457 } } peers { permanent_uuid: "a4aff80e488846ed881d6b55607b03d5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43769 } } peers { permanent_uuid: "4943bc3d911b4582b9f211b84aa012a7" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 46477 } }
I20260807 04:16:39.768949 16061 leader_election.cc:288] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a4aff80e488846ed881d6b55607b03d5 (127.7.200.193:43769), 4943bc3d911b4582b9f211b84aa012a7 (127.7.200.195:46477)
I20260807 04:16:39.775174 16051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.769210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:60563 (local address 127.7.200.193:43769)
0807 04:16:39.769447 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:39.769453 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:39.769476 (+ 23us) server_negotiation.cc:407] Connection header received
0807 04:16:39.769765 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:39.769775 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:39.769882 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:39.769991 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:16:39.770593 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.771526 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.773331 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.774243 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.774414 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:39.774491 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:39.774775 (+ 284us) server_negotiation.cc:299] Negotiation successful
0807 04:16:39.774906 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 04:16:39.775247 16063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.769095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:43769 (local address 127.7.200.194:60563)
0807 04:16:39.769335 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.769352 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:39.769567 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:39.770017 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:39.770026 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:39.770056 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:16:39.770386 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:39.770400 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.771659 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.771667 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:39.773183 (+ 1516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:39.773195 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.774427 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.774432 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:39.774620 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:39.774645 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 04:16:39.774765 (+ 120us) client_negotiation.cc:240] Negotiation successful
0807 04:16:39.774907 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260807 04:16:39.775854 16053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.769668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:42135 (local address 127.7.200.195:46477)
0807 04:16:39.769874 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:39.769881 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:39.770302 (+ 421us) server_negotiation.cc:407] Connection header received
0807 04:16:39.770495 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:39.770499 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:39.770581 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:39.770693 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:16:39.771303 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.772158 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.773845 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.774804 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.774993 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:39.775077 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:39.775449 (+ 372us) server_negotiation.cc:299] Negotiation successful
0807 04:16:39.775578 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 04:16:39.775823 15599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a78ee6ad146647cb9f9c3d82894b9ecd" candidate_uuid: "4f08b06a155a4b898d4315ec68eb738f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4aff80e488846ed881d6b55607b03d5" is_pre_election: true
I20260807 04:16:39.776026 16060 raft_consensus.cc:482] T a78ee6ad146647cb9f9c3d82894b9ecd P a4aff80e488846ed881d6b55607b03d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:16:39.776458 16068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.769536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:46477 (local address 127.7.200.194:42135)
0807 04:16:39.770196 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.770211 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:39.770336 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:39.770707 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:39.770712 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:39.770734 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:16:39.771089 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:39.771101 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.772295 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.772301 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:39.773685 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:39.773697 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.775073 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.775080 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:39.775226 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:39.775284 (+ 58us) client_negotiation.cc:769] Sending connection context
0807 04:16:39.776023 (+ 739us) client_negotiation.cc:240] Negotiation successful
0807 04:16:39.776151 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":360,"threads_started":1}
I20260807 04:16:39.776265 16060 raft_consensus.cc:504] T a78ee6ad146647cb9f9c3d82894b9ecd P a4aff80e488846ed881d6b55607b03d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f08b06a155a4b898d4315ec68eb738f" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41457 } } peers { permanent_uuid: "a4aff80e488846ed881d6b55607b03d5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43769 } } peers { permanent_uuid: "4943bc3d911b4582b9f211b84aa012a7" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 46477 } }
I20260807 04:16:39.777184 15599 raft_consensus.cc:2454] T a78ee6ad146647cb9f9c3d82894b9ecd P a4aff80e488846ed881d6b55607b03d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f08b06a155a4b898d4315ec68eb738f in term 0.
I20260807 04:16:39.777486 15902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a78ee6ad146647cb9f9c3d82894b9ecd" candidate_uuid: "4f08b06a155a4b898d4315ec68eb738f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4943bc3d911b4582b9f211b84aa012a7" is_pre_election: true
I20260807 04:16:39.777935 15902 raft_consensus.cc:2454] T a78ee6ad146647cb9f9c3d82894b9ecd P 4943bc3d911b4582b9f211b84aa012a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f08b06a155a4b898d4315ec68eb738f in term 0.
I20260807 04:16:39.778045 15680 leader_election.cc:302] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f08b06a155a4b898d4315ec68eb738f, a4aff80e488846ed881d6b55607b03d5; no voters:
I20260807 04:16:39.778219 16060 leader_election.cc:288] T a78ee6ad146647cb9f9c3d82894b9ecd P a4aff80e488846ed881d6b55607b03d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f08b06a155a4b898d4315ec68eb738f (127.7.200.194:41457), 4943bc3d911b4582b9f211b84aa012a7 (127.7.200.195:46477)
I20260807 04:16:39.778846 16061 raft_consensus.cc:2781] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:16:39.778983 16061 raft_consensus.cc:482] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:16:39.779111 16061 raft_consensus.cc:3037] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:39.783506 16061 raft_consensus.cc:504] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f08b06a155a4b898d4315ec68eb738f" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41457 } } peers { permanent_uuid: "a4aff80e488846ed881d6b55607b03d5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43769 } } peers { permanent_uuid: "4943bc3d911b4582b9f211b84aa012a7" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 46477 } }
I20260807 04:16:39.783970 16050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.778552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:53673 (local address 127.7.200.194:41457)
0807 04:16:39.778719 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:39.778725 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:39.778743 (+ 18us) server_negotiation.cc:407] Connection header received
0807 04:16:39.778829 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:39.778833 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:39.778897 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:39.779013 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:16:39.779692 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.780577 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.782298 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.783071 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.783246 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:39.783315 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:39.783612 (+ 297us) server_negotiation.cc:299] Negotiation successful
0807 04:16:39.783743 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 04:16:39.783993 16064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.778323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:41457 (local address 127.7.200.193:53673)
0807 04:16:39.778489 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.778507 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:39.778635 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:39.779236 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:39.779241 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:39.779267 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:16:39.779551 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:39.779565 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.780722 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.780747 (+ 25us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:39.782146 (+ 1399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:39.782158 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.783268 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.783274 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:39.783455 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:39.783478 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 04:16:39.783580 (+ 102us) client_negotiation.cc:240] Negotiation successful
0807 04:16:39.783714 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260807 04:16:39.784686 16061 leader_election.cc:288] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f [CANDIDATE]: Term 1 election: Requested vote from peers a4aff80e488846ed881d6b55607b03d5 (127.7.200.193:43769), 4943bc3d911b4582b9f211b84aa012a7 (127.7.200.195:46477)
I20260807 04:16:39.785000 15751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a78ee6ad146647cb9f9c3d82894b9ecd" candidate_uuid: "a4aff80e488846ed881d6b55607b03d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f08b06a155a4b898d4315ec68eb738f" is_pre_election: true
I20260807 04:16:39.785245 15751 raft_consensus.cc:2379] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4aff80e488846ed881d6b55607b03d5 in current term 1: Already voted for candidate 4f08b06a155a4b898d4315ec68eb738f in this term.
I20260807 04:16:39.785821 15902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a78ee6ad146647cb9f9c3d82894b9ecd" candidate_uuid: "4f08b06a155a4b898d4315ec68eb738f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4943bc3d911b4582b9f211b84aa012a7"
I20260807 04:16:39.786036 15902 raft_consensus.cc:3037] T a78ee6ad146647cb9f9c3d82894b9ecd P 4943bc3d911b4582b9f211b84aa012a7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:39.788080 15902 raft_consensus.cc:2454] T a78ee6ad146647cb9f9c3d82894b9ecd P 4943bc3d911b4582b9f211b84aa012a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f08b06a155a4b898d4315ec68eb738f in term 1.
I20260807 04:16:39.788575 15680 leader_election.cc:302] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4943bc3d911b4582b9f211b84aa012a7, 4f08b06a155a4b898d4315ec68eb738f; no voters:
I20260807 04:16:39.788928 16061 raft_consensus.cc:2781] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:16:39.789186 15599 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a78ee6ad146647cb9f9c3d82894b9ecd" candidate_uuid: "4f08b06a155a4b898d4315ec68eb738f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4aff80e488846ed881d6b55607b03d5"
I20260807 04:16:39.789427 15599 raft_consensus.cc:3037] T a78ee6ad146647cb9f9c3d82894b9ecd P a4aff80e488846ed881d6b55607b03d5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:39.789450 16061 raft_consensus.cc:686] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f [term 1 LEADER]: Becoming Leader. State: Replica: 4f08b06a155a4b898d4315ec68eb738f, State: Running, Role: LEADER
I20260807 04:16:39.790437 16068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.790058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.7.200.194:43967)
0807 04:16:39.790206 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.790302 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260807 04:16:39.789844 16061 consensus_queue.cc:237] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f08b06a155a4b898d4315ec68eb738f" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41457 } } peers { permanent_uuid: "a4aff80e488846ed881d6b55607b03d5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43769 } } peers { permanent_uuid: "4943bc3d911b4582b9f211b84aa012a7" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 46477 } }
I20260807 04:16:39.792245 15599 raft_consensus.cc:2454] T a78ee6ad146647cb9f9c3d82894b9ecd P a4aff80e488846ed881d6b55607b03d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f08b06a155a4b898d4315ec68eb738f in term 1.
I20260807 04:16:39.794157 15262 catalog_manager.cc:5495] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f08b06a155a4b898d4315ec68eb738f (127.7.200.194). New cstate: current_term: 1 leader_uuid: "4f08b06a155a4b898d4315ec68eb738f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f08b06a155a4b898d4315ec68eb738f" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4aff80e488846ed881d6b55607b03d5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43769 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4943bc3d911b4582b9f211b84aa012a7" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 46477 } health_report { overall_health: UNKNOWN } } }
I20260807 04:16:39.795467 16053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.779325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:46405 (local address 127.7.200.195:46477)
0807 04:16:39.779529 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:39.779534 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:39.788321 (+ 8787us) server_negotiation.cc:407] Connection header received
0807 04:16:39.788384 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:39.788390 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:39.788464 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:39.788562 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:16:39.789337 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.791013 (+ 1676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.793237 (+ 2224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.794432 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.794558 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:39.794631 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:39.795164 (+ 533us) server_negotiation.cc:299] Negotiation successful
0807 04:16:39.795262 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 04:16:39.795506 16064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.778871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:46477 (local address 127.7.200.193:46405)
0807 04:16:39.784247 (+ 5376us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.784264 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:39.784358 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:39.788822 (+ 4464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:39.788828 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:39.788860 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:16:39.789134 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:39.789150 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.791185 (+ 2035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.791192 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:39.793055 (+ 1863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:39.793072 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.794776 (+ 1704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.794781 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:39.794966 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:39.795009 (+ 43us) client_negotiation.cc:769] Sending connection context
0807 04:16:39.795109 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 04:16:39.795248 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5262,"thread_start_us":9725,"threads_started":1}
I20260807 04:16:39.796051 15902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a78ee6ad146647cb9f9c3d82894b9ecd" candidate_uuid: "a4aff80e488846ed881d6b55607b03d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4943bc3d911b4582b9f211b84aa012a7" is_pre_election: true
I20260807 04:16:39.796361 15902 raft_consensus.cc:2379] T a78ee6ad146647cb9f9c3d82894b9ecd P 4943bc3d911b4582b9f211b84aa012a7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4aff80e488846ed881d6b55607b03d5 in current term 1: Already voted for candidate 4f08b06a155a4b898d4315ec68eb738f in this term.
I20260807 04:16:39.797094 15530 leader_election.cc:302] T a78ee6ad146647cb9f9c3d82894b9ecd P a4aff80e488846ed881d6b55607b03d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4aff80e488846ed881d6b55607b03d5; no voters: 4943bc3d911b4582b9f211b84aa012a7, 4f08b06a155a4b898d4315ec68eb738f
I20260807 04:16:39.797492 16060 raft_consensus.cc:2726] T a78ee6ad146647cb9f9c3d82894b9ecd P a4aff80e488846ed881d6b55607b03d5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 04:16:39.827222 16050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.822047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38924 (local address 127.7.200.194:41457)
0807 04:16:39.822225 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:39.822229 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:39.822247 (+ 18us) server_negotiation.cc:407] Connection header received
0807 04:16:39.822452 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:39.822456 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:39.822546 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:39.822703 (+ 157us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:16:39.823027 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.823759 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.825204 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.825635 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.825729 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:39.826130 (+ 401us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:16:39.826703 (+ 573us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:16:39.826806 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:39.826914 (+ 108us) server_negotiation.cc:299] Negotiation successful
0807 04:16:39.826981 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 04:16:39.831688 15599 raft_consensus.cc:1261] T a78ee6ad146647cb9f9c3d82894b9ecd P a4aff80e488846ed881d6b55607b03d5 [term 1 FOLLOWER]: Refusing update from remote peer 4f08b06a155a4b898d4315ec68eb738f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:16:39.831915 15902 raft_consensus.cc:1261] T a78ee6ad146647cb9f9c3d82894b9ecd P 4943bc3d911b4582b9f211b84aa012a7 [term 1 FOLLOWER]: Refusing update from remote peer 4f08b06a155a4b898d4315ec68eb738f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:16:39.832635 16061 consensus_queue.cc:1035] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4aff80e488846ed881d6b55607b03d5" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43769 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:16:39.833074 16070 consensus_queue.cc:1035] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4943bc3d911b4582b9f211b84aa012a7" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 46477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:16:39.836123 16064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.835430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.7.200.193:34053)
0807 04:16:39.835731 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.835835 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169}
I20260807 04:16:39.837297 16067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.836692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.7.200.195:49867)
0807 04:16:39.836886 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.837013 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260807 04:16:39.841997 16076 mvcc.cc:205] Tried to move back new op lower bound from 7315768114502197248 to 7315768114345820160. Current Snapshot: MvccSnapshot[applied={T|T < 7315768114502197248}]
I20260807 04:16:39.845692 16067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.843163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.7.200.195:38959)
0807 04:16:39.845343 (+ 2180us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.845490 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2047}
I20260807 04:16:39.846768 16068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.845756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.7.200.194:46991)
0807 04:16:39.846539 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.846635 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":612}
I20260807 04:16:39.848140 16075 mvcc.cc:205] Tried to move back new op lower bound from 7315768114502197248 to 7315768114345820160. Current Snapshot: MvccSnapshot[applied={T|T < 7315768114502197248}]
I20260807 04:16:39.850605 16064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.849890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.7.200.193:43961)
0807 04:16:39.850242 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.850383 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236}
I20260807 04:16:39.855093 16068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.854663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.7.200.194:49569)
0807 04:16:39.854822 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:39.854918 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260807 04:16:39.865542 15261 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46426:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:16:39.865859 15261 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46426:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:16:39.871842 15261 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 56fb5f1c90f44bafb30c535276eefd83: Sending DeleteTablet for 3 replicas of tablet a78ee6ad146647cb9f9c3d82894b9ecd
I20260807 04:16:39.873099 15881 tablet_service.cc:1514] Processing DeleteTablet for tablet a78ee6ad146647cb9f9c3d82894b9ecd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:16:39 UTC) from {username='oryx', principal='oryx/127.7.200.253@KRBTEST.COM'} at 127.0.0.1:49460
I20260807 04:16:39.873278 15577 tablet_service.cc:1514] Processing DeleteTablet for tablet a78ee6ad146647cb9f9c3d82894b9ecd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:16:39 UTC) from {username='oryx', principal='oryx/127.7.200.253@KRBTEST.COM'} at 127.0.0.1:37348
I20260807 04:16:39.874013 15728 tablet_service.cc:1514] Processing DeleteTablet for tablet a78ee6ad146647cb9f9c3d82894b9ecd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:16:39 UTC) from {username='oryx', principal='oryx/127.7.200.253@KRBTEST.COM'} at 127.0.0.1:38908
I20260807 04:16:39.876247 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 15439
I20260807 04:16:39.888857 16084 tablet_replica.cc:330] T a78ee6ad146647cb9f9c3d82894b9ecd P 4943bc3d911b4582b9f211b84aa012a7: stopping tablet replica
I20260807 04:16:39.889201 16084 raft_consensus.cc:2229] T a78ee6ad146647cb9f9c3d82894b9ecd P 4943bc3d911b4582b9f211b84aa012a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:16:39.889647 16084 raft_consensus.cc:2258] T a78ee6ad146647cb9f9c3d82894b9ecd P 4943bc3d911b4582b9f211b84aa012a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:16:39.890033 16086 tablet_replica.cc:330] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f: stopping tablet replica
I20260807 04:16:39.890271 16086 raft_consensus.cc:2229] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:16:39.890462 16085 tablet_replica.cc:330] T a78ee6ad146647cb9f9c3d82894b9ecd P a4aff80e488846ed881d6b55607b03d5: stopping tablet replica
I20260807 04:16:39.890667 16085 raft_consensus.cc:2229] T a78ee6ad146647cb9f9c3d82894b9ecd P a4aff80e488846ed881d6b55607b03d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:16:39.890929 16084 ts_tablet_manager.cc:1905] T a78ee6ad146647cb9f9c3d82894b9ecd P 4943bc3d911b4582b9f211b84aa012a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:16:39.890944 16086 raft_consensus.cc:2258] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:16:39.891036 16085 raft_consensus.cc:2258] T a78ee6ad146647cb9f9c3d82894b9ecd P a4aff80e488846ed881d6b55607b03d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:16:39.892066 16086 ts_tablet_manager.cc:1905] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:16:39.892609 16085 ts_tablet_manager.cc:1905] T a78ee6ad146647cb9f9c3d82894b9ecd P a4aff80e488846ed881d6b55607b03d5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:16:39.897758 16084 ts_tablet_manager.cc:1918] T a78ee6ad146647cb9f9c3d82894b9ecd P 4943bc3d911b4582b9f211b84aa012a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:16:39.897921 16084 log.cc:1196] T a78ee6ad146647cb9f9c3d82894b9ecd P 4943bc3d911b4582b9f211b84aa012a7: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-2/wal/wals/a78ee6ad146647cb9f9c3d82894b9ecd
I20260807 04:16:39.898361 16084 ts_tablet_manager.cc:1939] T a78ee6ad146647cb9f9c3d82894b9ecd P 4943bc3d911b4582b9f211b84aa012a7: Deleting consensus metadata
I20260807 04:16:39.899232 16086 ts_tablet_manager.cc:1918] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:16:39.899497 16086 log.cc:1196] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-1/wal/wals/a78ee6ad146647cb9f9c3d82894b9ecd
I20260807 04:16:39.899631 15244 catalog_manager.cc:4841] TS 4943bc3d911b4582b9f211b84aa012a7 (127.7.200.195:46477): tablet a78ee6ad146647cb9f9c3d82894b9ecd (table test-table [id=407754c9a1b14eb7bda1a13eb6d4af62]) successfully deleted
I20260807 04:16:39.900007 16086 ts_tablet_manager.cc:1939] T a78ee6ad146647cb9f9c3d82894b9ecd P 4f08b06a155a4b898d4315ec68eb738f: Deleting consensus metadata
I20260807 04:16:39.901074 15246 catalog_manager.cc:4841] TS 4f08b06a155a4b898d4315ec68eb738f (127.7.200.194:41457): tablet a78ee6ad146647cb9f9c3d82894b9ecd (table test-table [id=407754c9a1b14eb7bda1a13eb6d4af62]) successfully deleted
I20260807 04:16:39.903180 16085 ts_tablet_manager.cc:1918] T a78ee6ad146647cb9f9c3d82894b9ecd P a4aff80e488846ed881d6b55607b03d5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:16:39.903347 16085 log.cc:1196] T a78ee6ad146647cb9f9c3d82894b9ecd P a4aff80e488846ed881d6b55607b03d5: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786076137270840-7971-0/minicluster-data/ts-0/wal/wals/a78ee6ad146647cb9f9c3d82894b9ecd
I20260807 04:16:39.903864 16085 ts_tablet_manager.cc:1939] T a78ee6ad146647cb9f9c3d82894b9ecd P a4aff80e488846ed881d6b55607b03d5: Deleting consensus metadata
I20260807 04:16:39.905158 15244 catalog_manager.cc:4841] TS a4aff80e488846ed881d6b55607b03d5 (127.7.200.193:43769): tablet a78ee6ad146647cb9f9c3d82894b9ecd (table test-table [id=407754c9a1b14eb7bda1a13eb6d4af62]) successfully deleted
I20260807 04:16:39.912233 16051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:39.877421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37350 (local address 127.7.200.193:43769)
0807 04:16:39.877690 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:39.877700 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:39.894053 (+ 16353us) server_negotiation.cc:407] Connection header received
0807 04:16:39.894224 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:39.894230 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:39.894341 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:39.894449 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:39.896450 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.897745 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.902610 (+ 4865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:39.903042 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:39.903200 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:39.906175 (+ 2975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:39.906196 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:39.906218 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:39.906264 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:39.909267 (+ 3003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:39.909987 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:39.909994 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:39.909996 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:39.910126 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:39.910536 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:39.910539 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:39.910542 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:39.910905 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:39.911218 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:39.911568 (+ 350us) server_negotiation.cc:299] Negotiation successful
0807 04:16:39.911830 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260807 04:16:39.913009 15641 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:40.016147 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 15439
I20260807 04:16:40.029475 16052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:40.029025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.0.0.1:38720)
0807 04:16:40.029214 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:40.029332 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260807 04:16:40.030622 16052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:40.030236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42899 (local address 127.0.0.1:38734)
0807 04:16:40.030416 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:40.030490 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:42899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260807 04:16:40.047657 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 15658
I20260807 04:16:40.066455 16050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:40.048821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38936 (local address 127.7.200.194:41457)
0807 04:16:40.049034 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:40.049040 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:40.049062 (+ 22us) server_negotiation.cc:407] Connection header received
0807 04:16:40.049141 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:40.049146 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:40.049227 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:40.049330 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:40.051439 (+ 2109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:40.052255 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:40.054645 (+ 2390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:40.055199 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:40.055300 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:40.059097 (+ 3797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:40.059112 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:40.059129 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:40.059168 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:40.063262 (+ 4094us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:40.063999 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:40.064009 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:40.064013 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:40.064207 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:40.064607 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:40.064613 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:40.064617 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:40.065153 (+ 536us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:40.065570 (+ 417us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:40.065754 (+ 184us) server_negotiation.cc:299] Negotiation successful
0807 04:16:40.066043 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 04:16:40.067216 15797 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:40.189989 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 15658
I20260807 04:16:40.213119 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 15816
I20260807 04:16:40.226208 16053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:40.213873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49470 (local address 127.7.200.195:46477)
0807 04:16:40.214074 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:40.214078 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:40.214097 (+ 19us) server_negotiation.cc:407] Connection header received
0807 04:16:40.214215 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:40.214219 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:40.214297 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:40.214386 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:40.215703 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:40.216371 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:40.217749 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:40.218142 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:40.218247 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:40.220899 (+ 2652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:40.220912 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:40.220927 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:40.220961 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:40.223584 (+ 2623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:40.224219 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:40.224225 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:40.224227 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:40.224357 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:40.224793 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:40.224798 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:40.224801 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:40.225198 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:40.225430 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:40.225719 (+ 289us) server_negotiation.cc:299] Negotiation successful
0807 04:16:40.225927 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 04:16:40.226823 15946 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:40.349030 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 15816
I20260807 04:16:40.374740 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 15114
I20260807 04:16:40.375839 15293 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:40.502628 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 15114
W20260807 04:16:40.528049 15445 connection.cc:535] server connection from 127.0.0.1:38292 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 04:16:40.528574 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 15223
I20260807 04:16:40.529747 15491 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:40.649112 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 15223
2026-08-07T04:16:40Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (10060 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:16:40 dist-test-slave-qg60 krb5kdc[16095](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:16:40 dist-test-slave-qg60 krb5kdc[16095](info): set up 2 sockets
Aug 07 04:16:40 dist-test-slave-qg60 krb5kdc[16095](info): commencing operation
krb5kdc: starting...
W20260807 04:16:41.810796 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.001s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:16:41 dist-test-slave-qg60 krb5kdc[16095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:16:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:16:42Z Disabled control of system clock
WARNING: no policy specified for oryx/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.254.keytab.
Entry for principal oryx/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.254.keytab.
I20260807 04:16:42.080767 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:46561
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.254.keytab
--principal=oryx/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:33697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:46561
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:42.413625 16110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:42.413915 16110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:42.414016 16110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:42.421228 16110 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:16:42.421334 16110 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 04:16:42.421375 16110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:42.421435 16110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:42.421485 16110 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:16:42.421546 16110 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:16:42.431456 16110 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:33697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:46561
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.254.keytab
--principal=oryx/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:46561
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:42.432734 16110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:42.434072 16110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:42.446249 16115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:42.446282 16116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:42.446249 16118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:42.447547 16110 server_base.cc:1034] running on GCE node
I20260807 04:16:42.448334 16110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:42.449815 16110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:42.451069 16110 hybrid_clock.cc:648] HybridClock initialized: now 1786076202451002 us; error 43 us; skew 500 ppm
I20260807 04:16:42.451423 16110 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:42 dist-test-slave-qg60 krb5kdc[16095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076202, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:42.454712 16110 init.cc:377] Logged in from keytab as oryx/127.7.200.254@KRBTEST.COM (short username oryx)
I20260807 04:16:42.456256 16110 webserver.cc:460] Webserver started at http://127.7.200.254:43361/ using document root <none> and password file <none>
I20260807 04:16:42.457048 16110 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:42.457185 16110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:42.457517 16110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:42.460528 16110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "e98ddfcebd144582a387c1d6fc1efe93"
format_stamp: "Formatted at 2026-08-07 04:16:42 on dist-test-slave-qg60"
server_key: "34b34602e9eabd5a858b8d6e8bbc7be6"
server_key_iv: "f4f6ee81f17fa53ebebbf074f8bea261"
server_key_version: "encryptionkey@0"
I20260807 04:16:42.461403 16110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "e98ddfcebd144582a387c1d6fc1efe93"
format_stamp: "Formatted at 2026-08-07 04:16:42 on dist-test-slave-qg60"
server_key: "34b34602e9eabd5a858b8d6e8bbc7be6"
server_key_iv: "f4f6ee81f17fa53ebebbf074f8bea261"
server_key_version: "encryptionkey@0"
I20260807 04:16:42.466632 16110 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 04:16:42.470177 16125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:42.471508 16110 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:16:42.471690 16110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "e98ddfcebd144582a387c1d6fc1efe93"
format_stamp: "Formatted at 2026-08-07 04:16:42 on dist-test-slave-qg60"
server_key: "34b34602e9eabd5a858b8d6e8bbc7be6"
server_key_iv: "f4f6ee81f17fa53ebebbf074f8bea261"
server_key_version: "encryptionkey@0"
I20260807 04:16:42.471912 16110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:42.504161 16110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:42.508671 16110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:42.509011 16110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:42.531445 16110 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:46561
I20260807 04:16:42.531477 16188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:46561 every 8 connection(s)
I20260807 04:16:42.532908 16110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:16:42.536844 16189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:42.536890 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 16110
I20260807 04:16:42.537106 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:16:42.537869 7971 external_mini_cluster.cc:1428] Setting key 1e996c28c3c09770afa1a744a19651cc
I20260807 04:16:42.553617 16189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e98ddfcebd144582a387c1d6fc1efe93: Bootstrap starting.
Aug 07 04:16:42 dist-test-slave-qg60 krb5kdc[16095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076201, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM
I20260807 04:16:42.557722 16189 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e98ddfcebd144582a387c1d6fc1efe93: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:42.558841 16189 log.cc:824] T 00000000000000000000000000000000 P e98ddfcebd144582a387c1d6fc1efe93: Log is configured to *not* fsync() on all Append() calls
I20260807 04:16:42.562537 16189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e98ddfcebd144582a387c1d6fc1efe93: No bootstrap required, opened a new log
I20260807 04:16:42.564566 16193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:42.540007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36878 (local address 127.7.200.254:46561)
0807 04:16:42.540922 (+ 915us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:42.540946 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:42.541005 (+ 59us) server_negotiation.cc:407] Connection header received
0807 04:16:42.544172 (+ 3167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:42.544223 (+ 51us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:42.544960 (+ 737us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:42.545504 (+ 544us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:42.547153 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:42.549334 (+ 2181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:42.550687 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:42.551453 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:42.551649 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:42.556536 (+ 4887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:42.556546 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:42.556562 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:42.556614 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:42.560335 (+ 3721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:42.561262 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:42.561269 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:42.561275 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:42.561454 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:42.561890 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:42.561894 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:42.561896 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:42.562412 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:42.562688 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:42.563134 (+ 446us) server_negotiation.cc:299] Negotiation successful
0807 04:16:42.563452 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":641,"thread_start_us":383,"threads_started":1}
I20260807 04:16:42.570694 16189 raft_consensus.cc:348] T 00000000000000000000000000000000 P e98ddfcebd144582a387c1d6fc1efe93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e98ddfcebd144582a387c1d6fc1efe93" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 46561 } }
I20260807 04:16:42.571072 16189 raft_consensus.cc:374] T 00000000000000000000000000000000 P e98ddfcebd144582a387c1d6fc1efe93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:42.571190 16189 raft_consensus.cc:729] T 00000000000000000000000000000000 P e98ddfcebd144582a387c1d6fc1efe93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98ddfcebd144582a387c1d6fc1efe93, State: Initialized, Role: FOLLOWER
I20260807 04:16:42.571812 16189 consensus_queue.cc:260] T 00000000000000000000000000000000 P e98ddfcebd144582a387c1d6fc1efe93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e98ddfcebd144582a387c1d6fc1efe93" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 46561 } }
I20260807 04:16:42.572052 16189 raft_consensus.cc:388] T 00000000000000000000000000000000 P e98ddfcebd144582a387c1d6fc1efe93 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:16:42.572189 16189 raft_consensus.cc:482] T 00000000000000000000000000000000 P e98ddfcebd144582a387c1d6fc1efe93 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:16:42.572340 16189 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e98ddfcebd144582a387c1d6fc1efe93 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:42.575031 16189 raft_consensus.cc:504] T 00000000000000000000000000000000 P e98ddfcebd144582a387c1d6fc1efe93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e98ddfcebd144582a387c1d6fc1efe93" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 46561 } }
I20260807 04:16:42.575592 16189 leader_election.cc:302] T 00000000000000000000000000000000 P e98ddfcebd144582a387c1d6fc1efe93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e98ddfcebd144582a387c1d6fc1efe93; no voters:
I20260807 04:16:42.576284 16189 leader_election.cc:288] T 00000000000000000000000000000000 P e98ddfcebd144582a387c1d6fc1efe93 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:16:42.576386 16195 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e98ddfcebd144582a387c1d6fc1efe93 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:16:42.577280 16195 raft_consensus.cc:686] T 00000000000000000000000000000000 P e98ddfcebd144582a387c1d6fc1efe93 [term 1 LEADER]: Becoming Leader. State: Replica: e98ddfcebd144582a387c1d6fc1efe93, State: Running, Role: LEADER
I20260807 04:16:42.577930 16195 consensus_queue.cc:237] T 00000000000000000000000000000000 P e98ddfcebd144582a387c1d6fc1efe93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e98ddfcebd144582a387c1d6fc1efe93" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 46561 } }
I20260807 04:16:42.578748 16189 sys_catalog.cc:564] T 00000000000000000000000000000000 P e98ddfcebd144582a387c1d6fc1efe93 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:16:42.580807 16196 sys_catalog.cc:455] T 00000000000000000000000000000000 P e98ddfcebd144582a387c1d6fc1efe93 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e98ddfcebd144582a387c1d6fc1efe93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e98ddfcebd144582a387c1d6fc1efe93" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 46561 } } }
I20260807 04:16:42.581136 16196 sys_catalog.cc:458] T 00000000000000000000000000000000 P e98ddfcebd144582a387c1d6fc1efe93 [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:42.581195 16198 sys_catalog.cc:455] T 00000000000000000000000000000000 P e98ddfcebd144582a387c1d6fc1efe93 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e98ddfcebd144582a387c1d6fc1efe93. Latest consensus state: current_term: 1 leader_uuid: "e98ddfcebd144582a387c1d6fc1efe93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e98ddfcebd144582a387c1d6fc1efe93" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 46561 } } }
I20260807 04:16:42.581480 16198 sys_catalog.cc:458] T 00000000000000000000000000000000 P e98ddfcebd144582a387c1d6fc1efe93 [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:42.583612 16201 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:16:42.590353 16201 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:16:42.598934 16201 catalog_manager.cc:1347] Generated new cluster ID: d53bbeeea9c24585beabf4aaa580452b
I20260807 04:16:42.599081 16201 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:16:42.607726 16201 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:16:42.609798 16201 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:16:42.624931 16201 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e98ddfcebd144582a387c1d6fc1efe93: Generated new TSK 0
I20260807 04:16:42.626111 16201 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.7.200.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.200.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.200.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.193.keytab.
Entry for principal oryx/127.7.200.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.193.keytab.
I20260807 04:16:42.696628 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:0
--local_ip_for_outbound_sockets=127.7.200.193
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:46561
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.193.keytab
--principal=oryx/127.7.200.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:33697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:43.052263 16217 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:43.052629 16217 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:43.052839 16217 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:43.060928 16217 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:43.061094 16217 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:43.061234 16217 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 04:16:43.061367 16217 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:16:43.072098 16217 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:33697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.193.keytab
--principal=oryx/127.7.200.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.200.254:46561
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:43.073601 16217 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:43.075007 16217 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:43.089386 16226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:43.089408 16224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:43.089838 16222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:43.090312 16217 server_base.cc:1034] running on GCE node
I20260807 04:16:43.090978 16217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:43.092034 16217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:43.093290 16217 hybrid_clock.cc:648] HybridClock initialized: now 1786076203093217 us; error 39 us; skew 500 ppm
I20260807 04:16:43.093622 16217 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:43 dist-test-slave-qg60 krb5kdc[16095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076203, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:43.097208 16217 init.cc:377] Logged in from keytab as oryx/127.7.200.193@KRBTEST.COM (short username oryx)
I20260807 04:16:43.098754 16217 webserver.cc:460] Webserver started at http://127.7.200.193:35443/ using document root <none> and password file <none>
I20260807 04:16:43.099483 16217 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:43.099612 16217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:43.099943 16217 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:43.103008 16217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-0/data/instance:
uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f"
format_stamp: "Formatted at 2026-08-07 04:16:43 on dist-test-slave-qg60"
server_key: "e470129d3c00cfcf54249305e19037e9"
server_key_iv: "9d9e10628227c39d06f5b628b72964e6"
server_key_version: "encryptionkey@0"
I20260807 04:16:43.103856 16217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance:
uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f"
format_stamp: "Formatted at 2026-08-07 04:16:43 on dist-test-slave-qg60"
server_key: "e470129d3c00cfcf54249305e19037e9"
server_key_iv: "9d9e10628227c39d06f5b628b72964e6"
server_key_version: "encryptionkey@0"
I20260807 04:16:43.109263 16217 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 04:16:43.112851 16235 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:43.114240 16217 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:16:43.114411 16217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f"
format_stamp: "Formatted at 2026-08-07 04:16:43 on dist-test-slave-qg60"
server_key: "e470129d3c00cfcf54249305e19037e9"
server_key_iv: "9d9e10628227c39d06f5b628b72964e6"
server_key_version: "encryptionkey@0"
I20260807 04:16:43.114650 16217 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:43.137598 16217 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:43.142097 16217 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:43.142392 16217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:43.145373 16217 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:43.145509 16217 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:43.145648 16217 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:43.145723 16217 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 04:16:43 dist-test-slave-qg60 krb5kdc[16095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076203, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM
I20260807 04:16:43.171306 16244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:43.146244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:40481 (local address 127.7.200.254:46561)
0807 04:16:43.146805 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:43.146811 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:43.148108 (+ 1297us) server_negotiation.cc:407] Connection header received
0807 04:16:43.151404 (+ 3296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:43.151412 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:43.151514 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:43.151660 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:43.153972 (+ 2312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:43.155093 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:43.157641 (+ 2548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:43.158300 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:43.158449 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:43.164146 (+ 5697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:43.164154 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:43.164161 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:43.164211 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:43.167317 (+ 3106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:43.168515 (+ 1198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:43.168520 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:43.168522 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:43.168657 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:43.169338 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:43.169345 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:43.169350 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:43.169680 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:43.169850 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:43.170671 (+ 821us) server_negotiation.cc:299] Negotiation successful
0807 04:16:43.170921 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":299,"threads_started":1}
I20260807 04:16:43.172540 16245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:43.146993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:46561 (local address 127.7.200.193:40481)
0807 04:16:43.147912 (+ 919us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:43.147971 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:43.151026 (+ 3055us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:43.151928 (+ 902us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:43.151936 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:43.152722 (+ 786us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:43.153767 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:43.153808 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:43.155257 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:43.155267 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:43.157471 (+ 2204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:43.157489 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:43.158598 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:43.158616 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:43.158900 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:43.159840 (+ 940us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:43.159908 (+ 68us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:43.163817 (+ 3909us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:43.167489 (+ 3672us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:43.167504 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:43.167529 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:43.168339 (+ 810us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:43.168799 (+ 460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:43.168807 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:43.168812 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:43.169173 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:43.169826 (+ 653us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:43.169835 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:43.170253 (+ 418us) client_negotiation.cc:769] Sending connection context
0807 04:16:43.170551 (+ 298us) client_negotiation.cc:240] Negotiation successful
0807 04:16:43.171136 (+ 585us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":617,"thread_start_us":342,"threads_started":1}
I20260807 04:16:43.194393 16244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:43.179212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:58145 (local address 127.7.200.254:46561)
0807 04:16:43.179391 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:43.179395 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:43.180431 (+ 1036us) server_negotiation.cc:407] Connection header received
0807 04:16:43.180659 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:43.180663 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:43.180764 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:43.180872 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:43.182482 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:43.183295 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:43.185640 (+ 2345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:43.186120 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:43.186251 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:43.188143 (+ 1892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:43.188148 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:43.188152 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:43.188184 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:43.191148 (+ 2964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:43.191985 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:43.191993 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:43.192000 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:43.192199 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:43.192705 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:43.192714 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:43.192717 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:43.193177 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:43.193352 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:43.193772 (+ 420us) server_negotiation.cc:299] Negotiation successful
0807 04:16:43.194018 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 04:16:43.194552 16319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:43.179578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:46561 (local address 127.7.200.193:58145)
0807 04:16:43.180301 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:43.180333 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:43.180514 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:43.180908 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:43.180913 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:43.181832 (+ 919us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:43.182319 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:43.182334 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:43.183423 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:43.183431 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:43.185474 (+ 2043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:43.185489 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:43.186321 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:43.186329 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:43.186494 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:43.187161 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:43.187178 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:43.187933 (+ 755us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:43.191282 (+ 3349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:43.191288 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:43.191292 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:43.191841 (+ 549us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:43.192339 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:43.192344 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:43.192351 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:43.192556 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:43.193302 (+ 746us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:43.193306 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:43.193521 (+ 215us) client_negotiation.cc:769] Sending connection context
0807 04:16:43.193668 (+ 147us) client_negotiation.cc:240] Negotiation successful
0807 04:16:43.194024 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":346,"threads_started":1}
I20260807 04:16:43.205940 16217 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:40247
I20260807 04:16:43.205964 16363 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:40247 every 8 connection(s)
I20260807 04:16:43.207221 16217 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:16:43.208057 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 16217
I20260807 04:16:43.208299 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance
I20260807 04:16:43.209254 7971 external_mini_cluster.cc:1428] Setting key ce5a38b7162ae5e57e0eb92fcbba1dc3
I20260807 04:16:43.209630 16364 heartbeater.cc:347] Connected to a master server at 127.7.200.254:46561
I20260807 04:16:43.209897 16364 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:43.210635 16364 heartbeater.cc:511] Master 127.7.200.254:46561 requested a full tablet report, sending...
I20260807 04:16:43.212823 16143 ts_manager.cc:194] Registered new tserver with Master: 390a78efc54c4fe0a3b8da1a8bd18d8f (127.7.200.193:40247)
I20260807 04:16:43.214356 16143 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.200.193@KRBTEST.COM'} at 127.7.200.193:40481
WARNING: no policy specified for oryx/127.7.200.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.200.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.200.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.194.keytab.
Entry for principal oryx/127.7.200.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.194.keytab.
I20260807 04:16:43.268033 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:0
--local_ip_for_outbound_sockets=127.7.200.194
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:46561
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.194.keytab
--principal=oryx/127.7.200.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:33697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:43.609465 16368 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:43.609809 16368 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:43.609982 16368 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:43.617426 16368 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:43.617594 16368 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:43.617751 16368 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 04:16:43.617895 16368 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:16:43.628131 16368 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:33697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.194.keytab
--principal=oryx/127.7.200.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.200.254:46561
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:43.629591 16368 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:43.630966 16368 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:43.644980 16374 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:43.644909 16375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:43.644866 16377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:43.645900 16368 server_base.cc:1034] running on GCE node
I20260807 04:16:43.646633 16368 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:43.647691 16368 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:43.648928 16368 hybrid_clock.cc:648] HybridClock initialized: now 1786076203648837 us; error 67 us; skew 500 ppm
I20260807 04:16:43.649240 16368 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:43 dist-test-slave-qg60 krb5kdc[16095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076203, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:43.652561 16368 init.cc:377] Logged in from keytab as oryx/127.7.200.194@KRBTEST.COM (short username oryx)
I20260807 04:16:43.654119 16368 webserver.cc:460] Webserver started at http://127.7.200.194:34367/ using document root <none> and password file <none>
I20260807 04:16:43.654819 16368 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:43.654906 16368 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:43.655184 16368 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:43.658290 16368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-1/data/instance:
uuid: "12c3099a4725491285ff68d2166fbcb3"
format_stamp: "Formatted at 2026-08-07 04:16:43 on dist-test-slave-qg60"
server_key: "7f122e6d13cfe63213da8f491862bfb2"
server_key_iv: "fbd44dfc4ab4866cd56454044057d4c7"
server_key_version: "encryptionkey@0"
I20260807 04:16:43.659060 16368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance:
uuid: "12c3099a4725491285ff68d2166fbcb3"
format_stamp: "Formatted at 2026-08-07 04:16:43 on dist-test-slave-qg60"
server_key: "7f122e6d13cfe63213da8f491862bfb2"
server_key_iv: "fbd44dfc4ab4866cd56454044057d4c7"
server_key_version: "encryptionkey@0"
I20260807 04:16:43.664286 16368 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260807 04:16:43.668004 16385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:43.669579 16368 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 04:16:43.669740 16368 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "12c3099a4725491285ff68d2166fbcb3"
format_stamp: "Formatted at 2026-08-07 04:16:43 on dist-test-slave-qg60"
server_key: "7f122e6d13cfe63213da8f491862bfb2"
server_key_iv: "fbd44dfc4ab4866cd56454044057d4c7"
server_key_version: "encryptionkey@0"
I20260807 04:16:43.669974 16368 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:43.695271 16368 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:43.699532 16368 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:43.699827 16368 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:43.702742 16368 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:43.702863 16368 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:43.703059 16368 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:43.703142 16368 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 04:16:43 dist-test-slave-qg60 krb5kdc[16095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076203, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM
I20260807 04:16:43.730116 16393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:43.703169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:42235 (local address 127.7.200.254:46561)
0807 04:16:43.703710 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:43.703719 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:43.704994 (+ 1275us) server_negotiation.cc:407] Connection header received
0807 04:16:43.707126 (+ 2132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:43.707133 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:43.707233 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:43.707383 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:43.709615 (+ 2232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:43.711008 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:43.713701 (+ 2693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:43.714219 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:43.714372 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:43.720931 (+ 6559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:43.720942 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:43.720950 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:43.721014 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:43.725446 (+ 4432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:43.726642 (+ 1196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:43.726648 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:43.726653 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:43.726844 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:43.727522 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:43.727527 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:43.727529 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:43.727826 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:43.727978 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:43.729270 (+ 1292us) server_negotiation.cc:299] Negotiation successful
0807 04:16:43.729625 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":262,"threads_started":1}
I20260807 04:16:43.732097 16395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:43.703924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:46561 (local address 127.7.200.194:42235)
0807 04:16:43.704835 (+ 911us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:43.704885 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:43.706771 (+ 1886us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:43.707567 (+ 796us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:43.707595 (+ 28us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:43.708432 (+ 837us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:43.709385 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:43.709418 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:43.711191 (+ 1773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:43.711195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:43.713435 (+ 2240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:43.713449 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:43.714506 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:43.714517 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:43.714786 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:43.715825 (+ 1039us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:43.715869 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:43.720492 (+ 4623us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:43.725690 (+ 5198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:43.725699 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:43.725715 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:43.726487 (+ 772us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:43.726976 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:43.726985 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:43.726991 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:43.727348 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:43.727973 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:43.727985 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:43.728637 (+ 652us) client_negotiation.cc:769] Sending connection context
0807 04:16:43.729087 (+ 450us) client_negotiation.cc:240] Negotiation successful
0807 04:16:43.729950 (+ 863us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":379,"threads_started":1}
I20260807 04:16:43.754563 16393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:43.739221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:35827 (local address 127.7.200.254:46561)
0807 04:16:43.739431 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:43.739438 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:43.740178 (+ 740us) server_negotiation.cc:407] Connection header received
0807 04:16:43.740334 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:43.740342 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:43.740468 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:43.740597 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:43.742274 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:43.743369 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:43.745073 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:43.745722 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:43.745874 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:43.747835 (+ 1961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:43.747840 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:43.747844 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:43.747877 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:43.751153 (+ 3276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:43.752078 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:43.752087 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:43.752091 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:43.752220 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:43.752768 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:43.752775 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:43.752780 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:43.753309 (+ 529us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:43.753476 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:43.753911 (+ 435us) server_negotiation.cc:299] Negotiation successful
0807 04:16:43.754185 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 04:16:43.754716 16480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:43.739363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:46561 (local address 127.7.200.194:35827)
0807 04:16:43.740066 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:43.740083 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:43.740210 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:43.740650 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:43.740653 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:43.741472 (+ 819us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:43.742098 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:43.742111 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:43.743523 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:43.743533 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:43.744857 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:43.744875 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:43.745945 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:43.745952 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:43.746137 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:43.746798 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:43.746817 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:43.747626 (+ 809us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:43.751292 (+ 3666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:43.751301 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:43.751305 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:43.751947 (+ 642us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:43.752340 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:43.752348 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:43.752352 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:43.752579 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:43.753425 (+ 846us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:43.753430 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:43.753643 (+ 213us) client_negotiation.cc:769] Sending connection context
0807 04:16:43.753799 (+ 156us) client_negotiation.cc:240] Negotiation successful
0807 04:16:43.754176 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":377,"threads_started":1}
I20260807 04:16:43.757848 16511 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:37837 every 8 connection(s)
I20260807 04:16:43.757853 16368 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:37837
I20260807 04:16:43.759295 16368 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:16:43.761584 16512 heartbeater.cc:347] Connected to a master server at 127.7.200.254:46561
I20260807 04:16:43.761831 16512 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:43.762516 16512 heartbeater.cc:511] Master 127.7.200.254:46561 requested a full tablet report, sending...
I20260807 04:16:43.764123 16143 ts_manager.cc:194] Registered new tserver with Master: 12c3099a4725491285ff68d2166fbcb3 (127.7.200.194:37837)
I20260807 04:16:43.765101 16143 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.200.194@KRBTEST.COM'} at 127.7.200.194:42235
I20260807 04:16:43.767747 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 16368
I20260807 04:16:43.767923 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance
I20260807 04:16:43.768402 7971 external_mini_cluster.cc:1428] Setting key 5538044739e5cc1839f0a56332489598
WARNING: no policy specified for oryx/127.7.200.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.200.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.200.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.195.keytab.
Entry for principal oryx/127.7.200.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.195.keytab.
I20260807 04:16:43.829308 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:0
--local_ip_for_outbound_sockets=127.7.200.195
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:46561
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.195.keytab
--principal=oryx/127.7.200.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:33697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:44.171919 16516 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:44.172228 16516 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:44.172398 16516 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:44.180299 16516 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:44.180433 16516 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:44.180574 16516 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 04:16:44.180686 16516 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:16:44.191038 16516 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:33697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.195.keytab
--principal=oryx/127.7.200.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.7.200.254:46561
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:44.192359 16516 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:44.193801 16516 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:44.207340 16521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:44.207365 16522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:44.207917 16524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:44.209077 16516 server_base.cc:1034] running on GCE node
I20260807 04:16:44.209651 16516 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:44.210528 16516 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:44.211768 16516 hybrid_clock.cc:648] HybridClock initialized: now 1786076204211705 us; error 40 us; skew 500 ppm
I20260807 04:16:44.212083 16516 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 04:16:44.217083 16364 heartbeater.cc:503] Master 127.7.200.254:46561 was elected leader, sending a full tablet report...
Aug 07 04:16:44 dist-test-slave-qg60 krb5kdc[16095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076204, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:44.221160 16516 init.cc:377] Logged in from keytab as oryx/127.7.200.195@KRBTEST.COM (short username oryx)
I20260807 04:16:44.222685 16516 webserver.cc:460] Webserver started at http://127.7.200.195:45981/ using document root <none> and password file <none>
I20260807 04:16:44.223383 16516 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:44.223506 16516 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:44.223846 16516 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:44.226918 16516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-2/data/instance:
uuid: "b57b231ba91841bb8efe01cc7214f3c2"
format_stamp: "Formatted at 2026-08-07 04:16:44 on dist-test-slave-qg60"
server_key: "5d5e945e86ba2cb10ec6dbd16e938280"
server_key_iv: "960302e17bedeea1d8bcb0300ab5ec64"
server_key_version: "encryptionkey@0"
I20260807 04:16:44.227726 16516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance:
uuid: "b57b231ba91841bb8efe01cc7214f3c2"
format_stamp: "Formatted at 2026-08-07 04:16:44 on dist-test-slave-qg60"
server_key: "5d5e945e86ba2cb10ec6dbd16e938280"
server_key_iv: "960302e17bedeea1d8bcb0300ab5ec64"
server_key_version: "encryptionkey@0"
I20260807 04:16:44.233125 16516 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 04:16:44.236907 16532 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:44.238332 16516 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:16:44.238574 16516 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "b57b231ba91841bb8efe01cc7214f3c2"
format_stamp: "Formatted at 2026-08-07 04:16:44 on dist-test-slave-qg60"
server_key: "5d5e945e86ba2cb10ec6dbd16e938280"
server_key_iv: "960302e17bedeea1d8bcb0300ab5ec64"
server_key_version: "encryptionkey@0"
I20260807 04:16:44.238790 16516 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:44.270128 16516 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:44.274863 16516 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:44.275164 16516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:44.278121 16516 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:44.278228 16516 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:44.278438 16516 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:44.278527 16516 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 04:16:44 dist-test-slave-qg60 krb5kdc[16095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076204, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM
I20260807 04:16:44.307749 16541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:44.278582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:33921 (local address 127.7.200.254:46561)
0807 04:16:44.281417 (+ 2835us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:44.281421 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:44.281440 (+ 19us) server_negotiation.cc:407] Connection header received
0807 04:16:44.284116 (+ 2676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:44.284126 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:44.284228 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:44.284355 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:44.287374 (+ 3019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:44.288253 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:44.291602 (+ 3349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:44.292173 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:44.292335 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:44.298546 (+ 6211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:44.298551 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:44.298555 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:44.298592 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:44.302991 (+ 4399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:44.304216 (+ 1225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:44.304225 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:44.304231 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:44.304433 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:44.305092 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:44.305100 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:44.305105 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:44.305521 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:44.305711 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:44.306807 (+ 1096us) server_negotiation.cc:299] Negotiation successful
0807 04:16:44.307150 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2720,"thread_start_us":2619,"threads_started":1}
I20260807 04:16:44.308409 16543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:44.279422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:46561 (local address 127.7.200.195:33921)
0807 04:16:44.280587 (+ 1165us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:44.280640 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:44.283568 (+ 2928us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:44.284883 (+ 1315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:44.284913 (+ 30us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:44.286011 (+ 1098us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:44.287131 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:44.287164 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:44.288432 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:44.288441 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:44.291411 (+ 2970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:44.291431 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:44.292465 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:44.292476 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:44.292908 (+ 432us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:44.293933 (+ 1025us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:44.293979 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:44.298264 (+ 4285us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:44.303193 (+ 4929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:44.303204 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:44.303229 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:44.304032 (+ 803us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:44.304586 (+ 554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:44.304592 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:44.304597 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:44.304962 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:44.305696 (+ 734us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:44.305704 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:44.306286 (+ 582us) client_negotiation.cc:769] Sending connection context
0807 04:16:44.306647 (+ 361us) client_negotiation.cc:240] Negotiation successful
0807 04:16:44.307133 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":715,"thread_start_us":449,"threads_started":1}
I20260807 04:16:44.329013 16516 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:34029
I20260807 04:16:44.329046 16662 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:34029 every 8 connection(s)
I20260807 04:16:44.329814 16541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:44.313932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:51571 (local address 127.7.200.254:46561)
0807 04:16:44.314165 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:44.314173 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:44.314830 (+ 657us) server_negotiation.cc:407] Connection header received
0807 04:16:44.315064 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:44.315068 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:44.315146 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:44.315219 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:44.316992 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:44.317901 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:44.319624 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:44.320209 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:44.320339 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:44.323222 (+ 2883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:44.323227 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:44.323230 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:44.323263 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:44.326789 (+ 3526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:44.327482 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:44.327490 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:44.327496 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:44.327699 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:44.328142 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:44.328149 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:44.328153 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:44.328469 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:44.328614 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:44.329192 (+ 578us) server_negotiation.cc:299] Negotiation successful
0807 04:16:44.329426 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 04:16:44.329957 16629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:44.313923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:46561 (local address 127.7.200.195:51571)
0807 04:16:44.314708 (+ 785us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:44.314733 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:44.314925 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:44.315284 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:44.315292 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:44.316053 (+ 761us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:44.316806 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:44.316831 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:44.318077 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:44.318086 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:44.319475 (+ 1389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:44.319491 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:44.320647 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:44.320656 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:44.320947 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:44.321733 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:44.321756 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:44.323017 (+ 1261us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:44.326944 (+ 3927us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:44.326947 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:44.326950 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:44.327334 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:44.327827 (+ 493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:44.327831 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:44.327835 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:44.327993 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:44.328672 (+ 679us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:44.328676 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:44.328913 (+ 237us) client_negotiation.cc:769] Sending connection context
0807 04:16:44.329080 (+ 167us) client_negotiation.cc:240] Negotiation successful
0807 04:16:44.329484 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":388,"threads_started":1}
I20260807 04:16:44.330698 16516 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:16:44.332978 16663 heartbeater.cc:347] Connected to a master server at 127.7.200.254:46561
I20260807 04:16:44.333227 16663 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:44.333985 16663 heartbeater.cc:511] Master 127.7.200.254:46561 requested a full tablet report, sending...
I20260807 04:16:44.335369 16143 ts_manager.cc:194] Registered new tserver with Master: b57b231ba91841bb8efe01cc7214f3c2 (127.7.200.195:34029)
I20260807 04:16:44.336198 16143 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.7.200.195@KRBTEST.COM'} at 127.7.200.195:33921
I20260807 04:16:44.338950 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 16516
I20260807 04:16:44.339121 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance
I20260807 04:16:44.339567 7971 external_mini_cluster.cc:1428] Setting key 7774be74ac90069b24ecf1fb44b9a8aa
I20260807 04:16:44.342814 7971 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 04:16:44 dist-test-slave-qg60 krb5kdc[16095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076204, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 04:16:44 dist-test-slave-qg60 krb5kdc[16095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:16:44 dist-test-slave-qg60 krb5kdc[16095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:16:44.767692 16512 heartbeater.cc:503] Master 127.7.200.254:46561 was elected leader, sending a full tablet report...
I20260807 04:16:45.338673 16663 heartbeater.cc:503] Master 127.7.200.254:46561 was elected leader, sending a full tablet report...
W20260807 04:16:45.524273 16671 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.122s user 0.000s sys 0.019s
W20260807 04:16:45.525672 16541 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:16:44.396134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37220 (local address 127.7.200.254:46561)
0807 04:16:44.396380 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:44.396386 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:44.396633 (+ 247us) server_negotiation.cc:407] Connection header received
0807 04:16:44.396918 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:44.396922 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:44.396992 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:44.397100 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:44.398486 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:44.399252 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:44.400537 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:44.401167 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:44.401314 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:45.525304 (+1123990us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37220: BlockingRecv error: recv got EOF from 127.0.0.1:37220 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 07 04:16:45 dist-test-slave-qg60 krb5kdc[16095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076204, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM
I20260807 04:16:45.544378 16541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:45.529240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37234 (local address 127.7.200.254:46561)
0807 04:16:45.529473 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:45.529480 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:45.529741 (+ 261us) server_negotiation.cc:407] Connection header received
0807 04:16:45.529873 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:45.529876 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:45.529949 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:45.530042 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:45.531342 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:45.532495 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:45.533861 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:45.534518 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:45.534668 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:45.539168 (+ 4500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:45.539173 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:45.539176 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:45.539211 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:45.541818 (+ 2607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:45.542566 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:45.542570 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:45.542572 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:45.542691 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:45.543125 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:45.543128 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:45.543131 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:45.543422 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:45.543629 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:45.543942 (+ 313us) server_negotiation.cc:299] Negotiation successful
0807 04:16:45.544161 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 04:16:45.548638 16143 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37234:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:16:45.555683 16143 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:16:45.591151 16684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:45.568324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:37837 (local address 127.0.0.1:55648)
0807 04:16:45.581482 (+ 13158us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:45.581532 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:45.581700 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:45.584022 (+ 2322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:45.584029 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:45.584063 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:16:45.584653 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:45.584674 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:45.586536 (+ 1862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:45.586541 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:45.588694 (+ 2153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:45.588704 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:45.590005 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:45.590011 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:45.590230 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:45.590290 (+ 60us) client_negotiation.cc:769] Sending connection context
0807 04:16:45.590437 (+ 147us) client_negotiation.cc:240] Negotiation successful
0807 04:16:45.590660 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12902,"mutex_wait_us":3,"thread_start_us":12753,"threads_started":1}
I20260807 04:16:45.591881 16685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:45.568612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55648 (local address 127.7.200.194:37837)
0807 04:16:45.583144 (+ 14532us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:45.583155 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:45.583187 (+ 32us) server_negotiation.cc:407] Connection header received
0807 04:16:45.583331 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:45.583338 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:45.583590 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:45.583838 (+ 248us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:16:45.584904 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:45.586359 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:45.588866 (+ 2507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:45.589792 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:45.589953 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:45.590181 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:45.591410 (+ 1229us) server_negotiation.cc:299] Negotiation successful
0807 04:16:45.591582 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14356,"thread_start_us":14215,"threads_started":1}
I20260807 04:16:45.591888 16689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:45.572024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34936 (local address 127.7.200.193:40247)
0807 04:16:45.582302 (+ 10278us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:45.582312 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:45.583219 (+ 907us) server_negotiation.cc:407] Connection header received
0807 04:16:45.583330 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:45.583338 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:45.583566 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:45.583785 (+ 219us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:16:45.584442 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:45.586053 (+ 1611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:45.588206 (+ 2153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:45.589797 (+ 1591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:45.589938 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:45.590166 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:45.591387 (+ 1221us) server_negotiation.cc:299] Negotiation successful
0807 04:16:45.591579 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10102,"thread_start_us":9969,"threads_started":1}
I20260807 04:16:45.591250 16686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:45.571294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:40247 (local address 127.0.0.1:34936)
0807 04:16:45.582992 (+ 11698us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:45.583011 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:45.583126 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:45.583789 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:45.583794 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:45.583823 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:16:45.584261 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:45.584279 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:45.586212 (+ 1933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:45.586221 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:45.588032 (+ 1811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:45.588044 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:45.590319 (+ 2275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:45.590326 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:45.590517 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:45.590548 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 04:16:45.590633 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 04:16:45.590780 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11310,"mutex_wait_us":91,"thread_start_us":10918,"threads_started":1}
I20260807 04:16:45.591655 16688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:45.568713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:34029 (local address 127.0.0.1:44202)
0807 04:16:45.582294 (+ 13581us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:45.582312 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:45.582455 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:45.583283 (+ 828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:45.583289 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:45.583317 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:16:45.583742 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:45.583758 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:45.585733 (+ 1975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:45.585740 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:45.588255 (+ 2515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:45.588270 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:45.590842 (+ 2572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:45.590849 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:45.591042 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:45.591080 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 04:16:45.591177 (+ 97us) client_negotiation.cc:240] Negotiation successful
0807 04:16:45.591334 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13416,"mutex_wait_us":60,"thread_start_us":13757,"threads_started":1}
I20260807 04:16:45.592361 16687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:45.569429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44202 (local address 127.7.200.195:34029)
0807 04:16:45.580351 (+ 10922us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:45.580363 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:45.582619 (+ 2256us) server_negotiation.cc:407] Connection header received
0807 04:16:45.582737 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:45.582749 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:45.583043 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:45.583252 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:16:45.583983 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:45.585611 (+ 1628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:45.588432 (+ 2821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:45.590352 (+ 1920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:45.590489 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:45.590686 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:45.591771 (+ 1085us) server_negotiation.cc:299] Negotiation successful
0807 04:16:45.591962 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10719,"thread_start_us":11132,"threads_started":1}
I20260807 04:16:45.595515 16289 tablet_service.cc:1467] Processing CreateTablet for tablet cfcfe2c603a0462f91754277185d7f49 (DEFAULT_TABLE table=test-table [id=9360a779a4274698a47f10fb333ce300]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:16:45.595805 16439 tablet_service.cc:1467] Processing CreateTablet for tablet cfcfe2c603a0462f91754277185d7f49 (DEFAULT_TABLE table=test-table [id=9360a779a4274698a47f10fb333ce300]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:16:45.595805 16587 tablet_service.cc:1467] Processing CreateTablet for tablet cfcfe2c603a0462f91754277185d7f49 (DEFAULT_TABLE table=test-table [id=9360a779a4274698a47f10fb333ce300]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:16:45.596885 16289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfcfe2c603a0462f91754277185d7f49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:45.597148 16439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfcfe2c603a0462f91754277185d7f49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:45.597148 16587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfcfe2c603a0462f91754277185d7f49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:45.608899 16690 tablet_bootstrap.cc:492] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f: Bootstrap starting.
I20260807 04:16:45.612152 16691 tablet_bootstrap.cc:492] T cfcfe2c603a0462f91754277185d7f49 P b57b231ba91841bb8efe01cc7214f3c2: Bootstrap starting.
I20260807 04:16:45.612950 16690 tablet_bootstrap.cc:654] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:45.612974 16692 tablet_bootstrap.cc:492] T cfcfe2c603a0462f91754277185d7f49 P 12c3099a4725491285ff68d2166fbcb3: Bootstrap starting.
I20260807 04:16:45.614476 16690 log.cc:824] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f: Log is configured to *not* fsync() on all Append() calls
I20260807 04:16:45.616495 16691 tablet_bootstrap.cc:654] T cfcfe2c603a0462f91754277185d7f49 P b57b231ba91841bb8efe01cc7214f3c2: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:45.616501 16692 tablet_bootstrap.cc:654] T cfcfe2c603a0462f91754277185d7f49 P 12c3099a4725491285ff68d2166fbcb3: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:45.617684 16691 log.cc:824] T cfcfe2c603a0462f91754277185d7f49 P b57b231ba91841bb8efe01cc7214f3c2: Log is configured to *not* fsync() on all Append() calls
I20260807 04:16:45.617841 16692 log.cc:824] T cfcfe2c603a0462f91754277185d7f49 P 12c3099a4725491285ff68d2166fbcb3: Log is configured to *not* fsync() on all Append() calls
I20260807 04:16:45.619428 16690 tablet_bootstrap.cc:492] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f: No bootstrap required, opened a new log
I20260807 04:16:45.619742 16690 ts_tablet_manager.cc:1397] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.006s
I20260807 04:16:45.621279 16692 tablet_bootstrap.cc:492] T cfcfe2c603a0462f91754277185d7f49 P 12c3099a4725491285ff68d2166fbcb3: No bootstrap required, opened a new log
I20260807 04:16:45.621336 16691 tablet_bootstrap.cc:492] T cfcfe2c603a0462f91754277185d7f49 P b57b231ba91841bb8efe01cc7214f3c2: No bootstrap required, opened a new log
I20260807 04:16:45.621579 16692 ts_tablet_manager.cc:1397] T cfcfe2c603a0462f91754277185d7f49 P 12c3099a4725491285ff68d2166fbcb3: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260807 04:16:45.621578 16691 ts_tablet_manager.cc:1397] T cfcfe2c603a0462f91754277185d7f49 P b57b231ba91841bb8efe01cc7214f3c2: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260807 04:16:45.627321 16690 raft_consensus.cc:348] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } } peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } }
I20260807 04:16:45.627763 16690 raft_consensus.cc:374] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:45.627903 16690 raft_consensus.cc:729] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 390a78efc54c4fe0a3b8da1a8bd18d8f, State: Initialized, Role: FOLLOWER
I20260807 04:16:45.628556 16690 consensus_queue.cc:260] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } } peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } }
I20260807 04:16:45.630451 16690 ts_tablet_manager.cc:1428] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f: Time spent starting tablet: real 0.011s user 0.007s sys 0.003s
I20260807 04:16:45.632803 16691 raft_consensus.cc:348] T cfcfe2c603a0462f91754277185d7f49 P b57b231ba91841bb8efe01cc7214f3c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } } peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } }
I20260807 04:16:45.632831 16692 raft_consensus.cc:348] T cfcfe2c603a0462f91754277185d7f49 P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } } peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } }
I20260807 04:16:45.633291 16691 raft_consensus.cc:374] T cfcfe2c603a0462f91754277185d7f49 P b57b231ba91841bb8efe01cc7214f3c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:45.633291 16692 raft_consensus.cc:374] T cfcfe2c603a0462f91754277185d7f49 P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:45.633397 16692 raft_consensus.cc:729] T cfcfe2c603a0462f91754277185d7f49 P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12c3099a4725491285ff68d2166fbcb3, State: Initialized, Role: FOLLOWER
I20260807 04:16:45.633401 16691 raft_consensus.cc:729] T cfcfe2c603a0462f91754277185d7f49 P b57b231ba91841bb8efe01cc7214f3c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b57b231ba91841bb8efe01cc7214f3c2, State: Initialized, Role: FOLLOWER
I20260807 04:16:45.634060 16692 consensus_queue.cc:260] T cfcfe2c603a0462f91754277185d7f49 P 12c3099a4725491285ff68d2166fbcb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } } peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } }
I20260807 04:16:45.634112 16691 consensus_queue.cc:260] T cfcfe2c603a0462f91754277185d7f49 P b57b231ba91841bb8efe01cc7214f3c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } } peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } }
I20260807 04:16:45.636138 16691 ts_tablet_manager.cc:1428] T cfcfe2c603a0462f91754277185d7f49 P b57b231ba91841bb8efe01cc7214f3c2: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20260807 04:16:45.636245 16692 ts_tablet_manager.cc:1428] T cfcfe2c603a0462f91754277185d7f49 P 12c3099a4725491285ff68d2166fbcb3: Time spent starting tablet: real 0.015s user 0.011s sys 0.004s
I20260807 04:16:45.645814 16696 raft_consensus.cc:482] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:16:45.646080 16696 raft_consensus.cc:504] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } } peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } }
I20260807 04:16:45.647892 16696 leader_election.cc:288] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 12c3099a4725491285ff68d2166fbcb3 (127.7.200.194:37837), b57b231ba91841bb8efe01cc7214f3c2 (127.7.200.195:34029)
I20260807 04:16:45.655325 16685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:45.648343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:42437 (local address 127.7.200.194:37837)
0807 04:16:45.648659 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:45.648668 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:45.649494 (+ 826us) server_negotiation.cc:407] Connection header received
0807 04:16:45.649712 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:45.649718 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:45.649800 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:45.649886 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:16:45.650542 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:45.651306 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:45.653419 (+ 2113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:45.654301 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:45.654445 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:45.654540 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:45.654896 (+ 356us) server_negotiation.cc:299] Negotiation successful
0807 04:16:45.655045 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260807 04:16:45.655344 16687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:45.648411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:44195 (local address 127.7.200.195:34029)
0807 04:16:45.648621 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:45.648629 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:45.649693 (+ 1064us) server_negotiation.cc:407] Connection header received
0807 04:16:45.649843 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:45.649846 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:45.649944 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:45.650047 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:16:45.650695 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:45.651445 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:45.653621 (+ 2176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:45.654410 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:45.654587 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:45.654661 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:45.654963 (+ 302us) server_negotiation.cc:299] Negotiation successful
0807 04:16:45.655109 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 04:16:45.655454 16699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:45.648270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:37837 (local address 127.7.200.193:42437)
0807 04:16:45.649364 (+ 1094us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:45.649390 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:45.649567 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:45.649920 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:45.649926 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:45.649951 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:16:45.650391 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:45.650405 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:45.651441 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:45.651447 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:45.653244 (+ 1797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:45.653257 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:45.654538 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:45.654545 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:45.654736 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:45.654761 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 04:16:45.654839 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 04:16:45.654976 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":915,"mutex_wait_us":41,"thread_start_us":655,"threads_started":1}
I20260807 04:16:45.655515 16700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:45.648270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:34029 (local address 127.7.200.193:44195)
0807 04:16:45.649564 (+ 1294us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:45.649579 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:45.649726 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:45.650078 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:45.650081 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:45.650117 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:16:45.650529 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:45.650541 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:45.651596 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:45.651600 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:45.653425 (+ 1825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:45.653440 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:45.654656 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:45.654661 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:45.654781 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:45.654804 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 04:16:45.654937 (+ 133us) client_negotiation.cc:240] Negotiation successful
0807 04:16:45.655069 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1131,"mutex_wait_us":375,"thread_start_us":564,"threads_started":1}
I20260807 04:16:45.656494 16609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfcfe2c603a0462f91754277185d7f49" candidate_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b57b231ba91841bb8efe01cc7214f3c2" is_pre_election: true
I20260807 04:16:45.656498 16461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfcfe2c603a0462f91754277185d7f49" candidate_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12c3099a4725491285ff68d2166fbcb3" is_pre_election: true
I20260807 04:16:45.657061 16609 raft_consensus.cc:2454] T cfcfe2c603a0462f91754277185d7f49 P b57b231ba91841bb8efe01cc7214f3c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 390a78efc54c4fe0a3b8da1a8bd18d8f in term 0.
I20260807 04:16:45.657088 16461 raft_consensus.cc:2454] T cfcfe2c603a0462f91754277185d7f49 P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 390a78efc54c4fe0a3b8da1a8bd18d8f in term 0.
I20260807 04:16:45.657732 16236 leader_election.cc:302] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 390a78efc54c4fe0a3b8da1a8bd18d8f, b57b231ba91841bb8efe01cc7214f3c2; no voters:
I20260807 04:16:45.658147 16696 raft_consensus.cc:2781] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:16:45.658306 16696 raft_consensus.cc:482] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:16:45.658414 16696 raft_consensus.cc:3037] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:45.660633 16696 raft_consensus.cc:504] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } } peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } }
I20260807 04:16:45.661348 16696 leader_election.cc:288] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f [CANDIDATE]: Term 1 election: Requested vote from peers 12c3099a4725491285ff68d2166fbcb3 (127.7.200.194:37837), b57b231ba91841bb8efe01cc7214f3c2 (127.7.200.195:34029)
I20260807 04:16:45.662040 16461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfcfe2c603a0462f91754277185d7f49" candidate_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12c3099a4725491285ff68d2166fbcb3"
I20260807 04:16:45.662268 16461 raft_consensus.cc:3037] T cfcfe2c603a0462f91754277185d7f49 P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:45.664595 16461 raft_consensus.cc:2454] T cfcfe2c603a0462f91754277185d7f49 P 12c3099a4725491285ff68d2166fbcb3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 390a78efc54c4fe0a3b8da1a8bd18d8f in term 1.
I20260807 04:16:45.664932 16609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfcfe2c603a0462f91754277185d7f49" candidate_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b57b231ba91841bb8efe01cc7214f3c2"
I20260807 04:16:45.665153 16609 raft_consensus.cc:3037] T cfcfe2c603a0462f91754277185d7f49 P b57b231ba91841bb8efe01cc7214f3c2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:45.665184 16239 leader_election.cc:302] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12c3099a4725491285ff68d2166fbcb3, 390a78efc54c4fe0a3b8da1a8bd18d8f; no voters:
I20260807 04:16:45.665580 16696 raft_consensus.cc:2781] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:16:45.666117 16696 raft_consensus.cc:686] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 1 LEADER]: Becoming Leader. State: Replica: 390a78efc54c4fe0a3b8da1a8bd18d8f, State: Running, Role: LEADER
I20260807 04:16:45.666676 16696 consensus_queue.cc:237] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } } peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } }
I20260807 04:16:45.667763 16609 raft_consensus.cc:2454] T cfcfe2c603a0462f91754277185d7f49 P b57b231ba91841bb8efe01cc7214f3c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 390a78efc54c4fe0a3b8da1a8bd18d8f in term 1.
I20260807 04:16:45.671945 16143 catalog_manager.cc:5495] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f reported cstate change: term changed from 0 to 1, leader changed from <none> to 390a78efc54c4fe0a3b8da1a8bd18d8f (127.7.200.193). New cstate: current_term: 1 leader_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } health_report { overall_health: HEALTHY } } }
I20260807 04:16:45.704389 16689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:45.699327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34950 (local address 127.7.200.193:40247)
0807 04:16:45.699520 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:45.699526 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:45.699606 (+ 80us) server_negotiation.cc:407] Connection header received
0807 04:16:45.699790 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:45.699794 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:45.699889 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:45.700019 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:16:45.700365 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:45.701116 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:45.702409 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:45.702801 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:45.702894 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:45.703319 (+ 425us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:16:45.703871 (+ 552us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:16:45.703991 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:45.704081 (+ 90us) server_negotiation.cc:299] Negotiation successful
0807 04:16:45.704156 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260807 04:16:45.710858 16365 tablet.cc:2369] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:16:45.713284 16609 raft_consensus.cc:1261] T cfcfe2c603a0462f91754277185d7f49 P b57b231ba91841bb8efe01cc7214f3c2 [term 1 FOLLOWER]: Refusing update from remote peer 390a78efc54c4fe0a3b8da1a8bd18d8f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:16:45.713456 16461 raft_consensus.cc:1261] T cfcfe2c603a0462f91754277185d7f49 P 12c3099a4725491285ff68d2166fbcb3 [term 1 FOLLOWER]: Refusing update from remote peer 390a78efc54c4fe0a3b8da1a8bd18d8f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:16:45.714349 16701 consensus_queue.cc:1035] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:16:45.714722 16696 consensus_queue.cc:1035] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:16:45.727070 16707 mvcc.cc:205] Tried to move back new op lower bound from 7315768138591113216 to 7315768138415226880. Current Snapshot: MvccSnapshot[applied={T|T < 7315768138591113216}]
I20260807 04:16:45.741674 16143 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37234:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:16:45.741951 16143 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37234:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:16:45.746376 16143 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e98ddfcebd144582a387c1d6fc1efe93: Sending DeleteTablet for 3 replicas of tablet cfcfe2c603a0462f91754277185d7f49
I20260807 04:16:45.747807 16439 tablet_service.cc:1514] Processing DeleteTablet for tablet cfcfe2c603a0462f91754277185d7f49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:16:45 UTC) from {username='oryx', principal='oryx/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:55648
I20260807 04:16:45.747866 16289 tablet_service.cc:1514] Processing DeleteTablet for tablet cfcfe2c603a0462f91754277185d7f49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:16:45 UTC) from {username='oryx', principal='oryx/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:34936
I20260807 04:16:45.747926 16587 tablet_service.cc:1514] Processing DeleteTablet for tablet cfcfe2c603a0462f91754277185d7f49 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:16:45 UTC) from {username='oryx', principal='oryx/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:44202
I20260807 04:16:45.749475 16142 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37234:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:16:45.750834 16142 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:16:45.753473 16716 tablet_replica.cc:330] T cfcfe2c603a0462f91754277185d7f49 P 12c3099a4725491285ff68d2166fbcb3: stopping tablet replica
I20260807 04:16:45.754117 16716 raft_consensus.cc:2229] T cfcfe2c603a0462f91754277185d7f49 P 12c3099a4725491285ff68d2166fbcb3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:16:45.754724 16716 raft_consensus.cc:2258] T cfcfe2c603a0462f91754277185d7f49 P 12c3099a4725491285ff68d2166fbcb3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:16:45.755695 16715 tablet_replica.cc:330] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f: stopping tablet replica
I20260807 04:16:45.758719 16715 raft_consensus.cc:2229] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:16:45.759522 16715 raft_consensus.cc:2258] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:16:45.761869 16715 ts_tablet_manager.cc:1905] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:16:45.764366 16289 tablet_service.cc:1467] Processing CreateTablet for tablet 6bd9310b2ea9420a982bf6e1299c00ea (DEFAULT_TABLE table=test-table [id=9531d9d16e4e4c15b59649ea44d2a322]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:16:45.765019 16289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bd9310b2ea9420a982bf6e1299c00ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:45.765213 16586 tablet_service.cc:1467] Processing CreateTablet for tablet 6bd9310b2ea9420a982bf6e1299c00ea (DEFAULT_TABLE table=test-table [id=9531d9d16e4e4c15b59649ea44d2a322]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:16:45.765795 16586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bd9310b2ea9420a982bf6e1299c00ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:45.770201 16715 ts_tablet_manager.cc:1918] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:16:45.770479 16715 log.cc:1196] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-0/wal/wals/cfcfe2c603a0462f91754277185d7f49
I20260807 04:16:45.771216 16715 ts_tablet_manager.cc:1939] T cfcfe2c603a0462f91754277185d7f49 P 390a78efc54c4fe0a3b8da1a8bd18d8f: Deleting consensus metadata
I20260807 04:16:45.772565 16690 tablet_bootstrap.cc:492] T 6bd9310b2ea9420a982bf6e1299c00ea P 390a78efc54c4fe0a3b8da1a8bd18d8f: Bootstrap starting.
I20260807 04:16:45.773360 16128 catalog_manager.cc:4841] TS 390a78efc54c4fe0a3b8da1a8bd18d8f (127.7.200.193:40247): tablet cfcfe2c603a0462f91754277185d7f49 (table test-table [id=9360a779a4274698a47f10fb333ce300]) successfully deleted
I20260807 04:16:45.774426 16690 tablet_bootstrap.cc:654] T 6bd9310b2ea9420a982bf6e1299c00ea P 390a78efc54c4fe0a3b8da1a8bd18d8f: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:45.774461 16439 tablet_service.cc:1467] Processing CreateTablet for tablet 6bd9310b2ea9420a982bf6e1299c00ea (DEFAULT_TABLE table=test-table [id=9531d9d16e4e4c15b59649ea44d2a322]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:16:45.775018 16439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bd9310b2ea9420a982bf6e1299c00ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:45.777168 16690 tablet_bootstrap.cc:492] T 6bd9310b2ea9420a982bf6e1299c00ea P 390a78efc54c4fe0a3b8da1a8bd18d8f: No bootstrap required, opened a new log
I20260807 04:16:45.777392 16690 ts_tablet_manager.cc:1397] T 6bd9310b2ea9420a982bf6e1299c00ea P 390a78efc54c4fe0a3b8da1a8bd18d8f: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 04:16:45.778398 16690 raft_consensus.cc:348] T 6bd9310b2ea9420a982bf6e1299c00ea P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:45.778754 16690 raft_consensus.cc:374] T 6bd9310b2ea9420a982bf6e1299c00ea P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:45.778923 16690 raft_consensus.cc:729] T 6bd9310b2ea9420a982bf6e1299c00ea P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 390a78efc54c4fe0a3b8da1a8bd18d8f, State: Initialized, Role: FOLLOWER
I20260807 04:16:45.779392 16690 consensus_queue.cc:260] T 6bd9310b2ea9420a982bf6e1299c00ea P 390a78efc54c4fe0a3b8da1a8bd18d8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:45.780205 16690 ts_tablet_manager.cc:1428] T 6bd9310b2ea9420a982bf6e1299c00ea P 390a78efc54c4fe0a3b8da1a8bd18d8f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 04:16:45.780828 16717 tablet_replica.cc:330] T cfcfe2c603a0462f91754277185d7f49 P b57b231ba91841bb8efe01cc7214f3c2: stopping tablet replica
I20260807 04:16:45.781782 16691 tablet_bootstrap.cc:492] T 6bd9310b2ea9420a982bf6e1299c00ea P b57b231ba91841bb8efe01cc7214f3c2: Bootstrap starting.
I20260807 04:16:45.781747 16717 raft_consensus.cc:2229] T cfcfe2c603a0462f91754277185d7f49 P b57b231ba91841bb8efe01cc7214f3c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:16:45.782449 16717 raft_consensus.cc:2258] T cfcfe2c603a0462f91754277185d7f49 P b57b231ba91841bb8efe01cc7214f3c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:16:45.783845 16691 tablet_bootstrap.cc:654] T 6bd9310b2ea9420a982bf6e1299c00ea P b57b231ba91841bb8efe01cc7214f3c2: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:45.786765 16717 ts_tablet_manager.cc:1905] T cfcfe2c603a0462f91754277185d7f49 P b57b231ba91841bb8efe01cc7214f3c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:16:45.781458 16716 ts_tablet_manager.cc:1905] T cfcfe2c603a0462f91754277185d7f49 P 12c3099a4725491285ff68d2166fbcb3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:16:45.790261 16692 tablet_bootstrap.cc:492] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3: Bootstrap starting.
I20260807 04:16:45.792028 16692 tablet_bootstrap.cc:654] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:45.799147 16691 tablet_bootstrap.cc:492] T 6bd9310b2ea9420a982bf6e1299c00ea P b57b231ba91841bb8efe01cc7214f3c2: No bootstrap required, opened a new log
I20260807 04:16:45.799202 16692 tablet_bootstrap.cc:492] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3: No bootstrap required, opened a new log
I20260807 04:16:45.799366 16692 ts_tablet_manager.cc:1397] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260807 04:16:45.799475 16691 ts_tablet_manager.cc:1397] T 6bd9310b2ea9420a982bf6e1299c00ea P b57b231ba91841bb8efe01cc7214f3c2: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.009s
I20260807 04:16:45.800370 16691 raft_consensus.cc:348] T 6bd9310b2ea9420a982bf6e1299c00ea P b57b231ba91841bb8efe01cc7214f3c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:45.800506 16692 raft_consensus.cc:348] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:45.800720 16692 raft_consensus.cc:374] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:45.800673 16717 ts_tablet_manager.cc:1918] T cfcfe2c603a0462f91754277185d7f49 P b57b231ba91841bb8efe01cc7214f3c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:16:45.800771 16691 raft_consensus.cc:374] T 6bd9310b2ea9420a982bf6e1299c00ea P b57b231ba91841bb8efe01cc7214f3c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:45.800908 16717 log.cc:1196] T cfcfe2c603a0462f91754277185d7f49 P b57b231ba91841bb8efe01cc7214f3c2: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-2/wal/wals/cfcfe2c603a0462f91754277185d7f49
I20260807 04:16:45.800935 16692 raft_consensus.cc:729] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12c3099a4725491285ff68d2166fbcb3, State: Initialized, Role: FOLLOWER
I20260807 04:16:45.800990 16691 raft_consensus.cc:729] T 6bd9310b2ea9420a982bf6e1299c00ea P b57b231ba91841bb8efe01cc7214f3c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b57b231ba91841bb8efe01cc7214f3c2, State: Initialized, Role: FOLLOWER
I20260807 04:16:45.801293 16692 consensus_queue.cc:260] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:45.801656 16717 ts_tablet_manager.cc:1939] T cfcfe2c603a0462f91754277185d7f49 P b57b231ba91841bb8efe01cc7214f3c2: Deleting consensus metadata
I20260807 04:16:45.802251 16692 ts_tablet_manager.cc:1428] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 04:16:45.804129 16126 catalog_manager.cc:4841] TS b57b231ba91841bb8efe01cc7214f3c2 (127.7.200.195:34029): tablet cfcfe2c603a0462f91754277185d7f49 (table test-table [id=9360a779a4274698a47f10fb333ce300]) successfully deleted
I20260807 04:16:45.804203 16716 ts_tablet_manager.cc:1918] T cfcfe2c603a0462f91754277185d7f49 P 12c3099a4725491285ff68d2166fbcb3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:16:45.804348 16716 log.cc:1196] T cfcfe2c603a0462f91754277185d7f49 P 12c3099a4725491285ff68d2166fbcb3: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-1/wal/wals/cfcfe2c603a0462f91754277185d7f49
I20260807 04:16:45.801435 16691 consensus_queue.cc:260] T 6bd9310b2ea9420a982bf6e1299c00ea P b57b231ba91841bb8efe01cc7214f3c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:45.805585 16716 ts_tablet_manager.cc:1939] T cfcfe2c603a0462f91754277185d7f49 P 12c3099a4725491285ff68d2166fbcb3: Deleting consensus metadata
I20260807 04:16:45.806375 16691 ts_tablet_manager.cc:1428] T 6bd9310b2ea9420a982bf6e1299c00ea P b57b231ba91841bb8efe01cc7214f3c2: Time spent starting tablet: real 0.007s user 0.002s sys 0.001s
I20260807 04:16:45.807719 16129 catalog_manager.cc:4841] TS 12c3099a4725491285ff68d2166fbcb3 (127.7.200.194:37837): tablet cfcfe2c603a0462f91754277185d7f49 (table test-table [id=9360a779a4274698a47f10fb333ce300]) successfully deleted
W20260807 04:16:45.833537 16664 tablet.cc:2369] T 6bd9310b2ea9420a982bf6e1299c00ea P b57b231ba91841bb8efe01cc7214f3c2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 04:16:46.012532 16513 tablet.cc:2369] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:16:46.014410 16698 raft_consensus.cc:482] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:16:46.014647 16698 raft_consensus.cc:504] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:46.016292 16698 leader_election.cc:288] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 390a78efc54c4fe0a3b8da1a8bd18d8f (127.7.200.193:40247), b57b231ba91841bb8efe01cc7214f3c2 (127.7.200.195:34029)
I20260807 04:16:46.025919 16687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:46.017019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:47663 (local address 127.7.200.195:34029)
0807 04:16:46.017277 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:46.017286 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:46.018283 (+ 997us) server_negotiation.cc:407] Connection header received
0807 04:16:46.018416 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:46.018423 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:46.018533 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:46.018647 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:16:46.019389 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.020536 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.023280 (+ 2744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.024464 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.024669 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:46.024796 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:46.025434 (+ 638us) server_negotiation.cc:299] Negotiation successful
0807 04:16:46.025564 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260807 04:16:46.026000 16721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:46.016720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:34029 (local address 127.7.200.194:47663)
0807 04:16:46.018174 (+ 1454us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:46.018192 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:46.018302 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:46.018683 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:46.018689 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:46.018720 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:16:46.019173 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:46.019192 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.020678 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.020684 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:46.023050 (+ 2366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:46.023066 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.024985 (+ 1919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.024994 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:46.025247 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:46.025281 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 04:16:46.025391 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 04:16:46.025532 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1324,"mutex_wait_us":67,"thread_start_us":715,"threads_started":1}
I20260807 04:16:46.026072 16689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:46.017009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:40529 (local address 127.7.200.193:40247)
0807 04:16:46.017201 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:46.017208 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:46.017981 (+ 773us) server_negotiation.cc:407] Connection header received
0807 04:16:46.018344 (+ 363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:46.018352 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:46.018474 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:46.018542 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:16:46.019548 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.020336 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.023240 (+ 2904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.024624 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.024849 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:46.024935 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:46.025551 (+ 616us) server_negotiation.cc:299] Negotiation successful
0807 04:16:46.025732 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 04:16:46.026922 16722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:46.016577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:40247 (local address 127.7.200.194:40529)
0807 04:16:46.017832 (+ 1255us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:46.017856 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:46.018132 (+ 276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:46.018804 (+ 672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:46.018808 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:46.018842 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:16:46.019384 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:46.019397 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.020483 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.020489 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:46.023050 (+ 2561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:46.023066 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.025121 (+ 2055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.025130 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:46.025339 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:46.025377 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 04:16:46.026368 (+ 991us) client_negotiation.cc:240] Negotiation successful
0807 04:16:46.026518 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1058,"mutex_wait_us":91,"thread_start_us":1298,"threads_started":1}
I20260807 04:16:46.027062 16609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bd9310b2ea9420a982bf6e1299c00ea" candidate_uuid: "12c3099a4725491285ff68d2166fbcb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b57b231ba91841bb8efe01cc7214f3c2" is_pre_election: true
I20260807 04:16:46.027347 16609 raft_consensus.cc:2454] T 6bd9310b2ea9420a982bf6e1299c00ea P b57b231ba91841bb8efe01cc7214f3c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12c3099a4725491285ff68d2166fbcb3 in term 0.
I20260807 04:16:46.027861 16386 leader_election.cc:302] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12c3099a4725491285ff68d2166fbcb3, b57b231ba91841bb8efe01cc7214f3c2; no voters:
I20260807 04:16:46.027859 16315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bd9310b2ea9420a982bf6e1299c00ea" candidate_uuid: "12c3099a4725491285ff68d2166fbcb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" is_pre_election: true
I20260807 04:16:46.028283 16698 raft_consensus.cc:2781] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:16:46.028374 16698 raft_consensus.cc:482] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:16:46.028438 16698 raft_consensus.cc:3037] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:46.028368 16315 raft_consensus.cc:2454] T 6bd9310b2ea9420a982bf6e1299c00ea P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12c3099a4725491285ff68d2166fbcb3 in term 0.
I20260807 04:16:46.030997 16698 raft_consensus.cc:504] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:46.031690 16698 leader_election.cc:288] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3 [CANDIDATE]: Term 1 election: Requested vote from peers 390a78efc54c4fe0a3b8da1a8bd18d8f (127.7.200.193:40247), b57b231ba91841bb8efe01cc7214f3c2 (127.7.200.195:34029)
I20260807 04:16:46.032115 16315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bd9310b2ea9420a982bf6e1299c00ea" candidate_uuid: "12c3099a4725491285ff68d2166fbcb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f"
I20260807 04:16:46.032361 16315 raft_consensus.cc:3037] T 6bd9310b2ea9420a982bf6e1299c00ea P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:46.032312 16609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bd9310b2ea9420a982bf6e1299c00ea" candidate_uuid: "12c3099a4725491285ff68d2166fbcb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b57b231ba91841bb8efe01cc7214f3c2"
I20260807 04:16:46.032539 16609 raft_consensus.cc:3037] T 6bd9310b2ea9420a982bf6e1299c00ea P b57b231ba91841bb8efe01cc7214f3c2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:46.035683 16609 raft_consensus.cc:2454] T 6bd9310b2ea9420a982bf6e1299c00ea P b57b231ba91841bb8efe01cc7214f3c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12c3099a4725491285ff68d2166fbcb3 in term 1.
I20260807 04:16:46.036068 16315 raft_consensus.cc:2454] T 6bd9310b2ea9420a982bf6e1299c00ea P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12c3099a4725491285ff68d2166fbcb3 in term 1.
I20260807 04:16:46.036199 16386 leader_election.cc:302] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12c3099a4725491285ff68d2166fbcb3, b57b231ba91841bb8efe01cc7214f3c2; no voters:
I20260807 04:16:46.036587 16698 raft_consensus.cc:2781] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:16:46.037182 16698 raft_consensus.cc:686] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3 [term 1 LEADER]: Becoming Leader. State: Replica: 12c3099a4725491285ff68d2166fbcb3, State: Running, Role: LEADER
I20260807 04:16:46.037626 16698 consensus_queue.cc:237] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:46.041301 16142 catalog_manager.cc:5495] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 12c3099a4725491285ff68d2166fbcb3 (127.7.200.194). New cstate: current_term: 1 leader_uuid: "12c3099a4725491285ff68d2166fbcb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } health_report { overall_health: UNKNOWN } } }
Aug 07 04:16:46 dist-test-slave-qg60 krb5kdc[16095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076202, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.254@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM
I20260807 04:16:46.097709 16732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:46.083237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37250 (local address 127.7.200.254:46561)
0807 04:16:46.084518 (+ 1281us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:46.084525 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:46.084550 (+ 25us) server_negotiation.cc:407] Connection header received
0807 04:16:46.084605 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:46.084608 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:46.084661 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:46.084819 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:46.086130 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.086931 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.088185 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.088582 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.088718 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:46.092188 (+ 3470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:46.092193 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:46.092196 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:46.092225 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:46.094915 (+ 2690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:46.095603 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:46.095609 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:46.095615 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:46.095744 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:46.096120 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:46.096124 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:46.096127 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:46.096406 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:46.096556 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:46.097031 (+ 475us) server_negotiation.cc:299] Negotiation successful
0807 04:16:46.097307 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":1137,"thread_start_us":937,"threads_started":1}
I20260807 04:16:46.097805 16733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:46.083252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:46561 (local address 127.0.0.1:37250)
0807 04:16:46.084160 (+ 908us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:46.084212 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:46.084402 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:46.084848 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:46.084853 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:46.085664 (+ 811us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:46.085940 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:46.085949 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.087054 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.087062 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:46.088043 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:46.088055 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.088794 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.088800 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:46.088991 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:46.089731 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:46.089748 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:46.091976 (+ 2228us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:46.095057 (+ 3081us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:46.095071 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:46.095080 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:46.095489 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:46.095865 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:46.095869 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:46.095873 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:46.096004 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:46.096531 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:46.096539 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:46.096770 (+ 231us) client_negotiation.cc:769] Sending connection context
0807 04:16:46.096946 (+ 176us) client_negotiation.cc:240] Negotiation successful
0807 04:16:46.097425 (+ 479us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":708,"mutex_wait_us":176,"thread_start_us":510,"threads_started":1}
I20260807 04:16:46.104040 16142 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:37250:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 04:16:46.105257 16142 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:16:46.113462 16289 tablet_service.cc:1467] Processing CreateTablet for tablet dcde4af68fb8472690e2527d7321f40d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d837fecb088448ae8703b5a1e8d3cbe1]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 04:16:46.114174 16289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dcde4af68fb8472690e2527d7321f40d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:46.114233 16439 tablet_service.cc:1467] Processing CreateTablet for tablet dcde4af68fb8472690e2527d7321f40d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d837fecb088448ae8703b5a1e8d3cbe1]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 04:16:46.114349 16586 tablet_service.cc:1467] Processing CreateTablet for tablet dcde4af68fb8472690e2527d7321f40d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d837fecb088448ae8703b5a1e8d3cbe1]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 04:16:46.114812 16439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dcde4af68fb8472690e2527d7321f40d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:46.114930 16586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dcde4af68fb8472690e2527d7321f40d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:46.122550 16690 tablet_bootstrap.cc:492] T dcde4af68fb8472690e2527d7321f40d P 390a78efc54c4fe0a3b8da1a8bd18d8f: Bootstrap starting.
I20260807 04:16:46.122551 16692 tablet_bootstrap.cc:492] T dcde4af68fb8472690e2527d7321f40d P 12c3099a4725491285ff68d2166fbcb3: Bootstrap starting.
I20260807 04:16:46.124009 16692 tablet_bootstrap.cc:654] T dcde4af68fb8472690e2527d7321f40d P 12c3099a4725491285ff68d2166fbcb3: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:46.124512 16690 tablet_bootstrap.cc:654] T dcde4af68fb8472690e2527d7321f40d P 390a78efc54c4fe0a3b8da1a8bd18d8f: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:46.126268 16692 tablet_bootstrap.cc:492] T dcde4af68fb8472690e2527d7321f40d P 12c3099a4725491285ff68d2166fbcb3: No bootstrap required, opened a new log
I20260807 04:16:46.126442 16692 ts_tablet_manager.cc:1397] T dcde4af68fb8472690e2527d7321f40d P 12c3099a4725491285ff68d2166fbcb3: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260807 04:16:46.127070 16692 raft_consensus.cc:348] T dcde4af68fb8472690e2527d7321f40d P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:46.127295 16692 raft_consensus.cc:374] T dcde4af68fb8472690e2527d7321f40d P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:46.127396 16692 raft_consensus.cc:729] T dcde4af68fb8472690e2527d7321f40d P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12c3099a4725491285ff68d2166fbcb3, State: Initialized, Role: FOLLOWER
I20260807 04:16:46.127722 16692 consensus_queue.cc:260] T dcde4af68fb8472690e2527d7321f40d P 12c3099a4725491285ff68d2166fbcb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:46.128131 16698 tablet_replica.cc:439] T dcde4af68fb8472690e2527d7321f40d P 12c3099a4725491285ff68d2166fbcb3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } } }
I20260807 04:16:46.128412 16698 tablet_replica.cc:442] T dcde4af68fb8472690e2527d7321f40d P 12c3099a4725491285ff68d2166fbcb3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:16:46.128875 16691 tablet_bootstrap.cc:492] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2: Bootstrap starting.
I20260807 04:16:46.130471 16692 ts_tablet_manager.cc:1428] T dcde4af68fb8472690e2527d7321f40d P 12c3099a4725491285ff68d2166fbcb3: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260807 04:16:46.130510 16690 tablet_bootstrap.cc:492] T dcde4af68fb8472690e2527d7321f40d P 390a78efc54c4fe0a3b8da1a8bd18d8f: No bootstrap required, opened a new log
I20260807 04:16:46.130697 16690 ts_tablet_manager.cc:1397] T dcde4af68fb8472690e2527d7321f40d P 390a78efc54c4fe0a3b8da1a8bd18d8f: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260807 04:16:46.130939 16691 tablet_bootstrap.cc:654] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:46.131561 16690 raft_consensus.cc:348] T dcde4af68fb8472690e2527d7321f40d P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:46.131814 16690 raft_consensus.cc:374] T dcde4af68fb8472690e2527d7321f40d P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:46.131909 16690 raft_consensus.cc:729] T dcde4af68fb8472690e2527d7321f40d P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 390a78efc54c4fe0a3b8da1a8bd18d8f, State: Initialized, Role: FOLLOWER
I20260807 04:16:46.132328 16690 consensus_queue.cc:260] T dcde4af68fb8472690e2527d7321f40d P 390a78efc54c4fe0a3b8da1a8bd18d8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:46.132923 16696 tablet_replica.cc:439] T dcde4af68fb8472690e2527d7321f40d P 390a78efc54c4fe0a3b8da1a8bd18d8f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } } }
I20260807 04:16:46.133229 16696 tablet_replica.cc:442] T dcde4af68fb8472690e2527d7321f40d P 390a78efc54c4fe0a3b8da1a8bd18d8f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:16:46.134861 16690 ts_tablet_manager.cc:1428] T dcde4af68fb8472690e2527d7321f40d P 390a78efc54c4fe0a3b8da1a8bd18d8f: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20260807 04:16:46.137461 16691 tablet_bootstrap.cc:492] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2: No bootstrap required, opened a new log
I20260807 04:16:46.137660 16691 ts_tablet_manager.cc:1397] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.007s
I20260807 04:16:46.138622 16691 raft_consensus.cc:348] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:46.138883 16691 raft_consensus.cc:374] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:46.139060 16691 raft_consensus.cc:729] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b57b231ba91841bb8efe01cc7214f3c2, State: Initialized, Role: FOLLOWER
I20260807 04:16:46.139372 16691 consensus_queue.cc:260] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:46.140071 16691 ts_tablet_manager.cc:1428] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260807 04:16:46.140029 16697 tablet_replica.cc:439] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } } }
I20260807 04:16:46.140446 16697 tablet_replica.cc:442] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:16:46.313359 16697 raft_consensus.cc:482] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:16:46.313621 16697 raft_consensus.cc:504] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:46.315357 16697 leader_election.cc:288] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 390a78efc54c4fe0a3b8da1a8bd18d8f (127.7.200.193:40247), 12c3099a4725491285ff68d2166fbcb3 (127.7.200.194:37837)
I20260807 04:16:46.324949 16689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:46.315901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:34913 (local address 127.7.200.193:40247)
0807 04:16:46.316145 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:46.316154 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:46.316912 (+ 758us) server_negotiation.cc:407] Connection header received
0807 04:16:46.317145 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:46.317150 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:46.317238 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:46.317350 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:16:46.318306 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.319443 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.322372 (+ 2929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.323614 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.323776 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:46.323853 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:46.324454 (+ 601us) server_negotiation.cc:299] Negotiation successful
0807 04:16:46.324611 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 04:16:46.324959 16739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:46.315790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:50423 (local address 127.7.200.194:37837)
0807 04:16:46.316532 (+ 742us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:46.316538 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:46.317053 (+ 515us) server_negotiation.cc:407] Connection header received
0807 04:16:46.317170 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:46.317175 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:46.317255 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:46.317355 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:16:46.318255 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.319481 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.322371 (+ 2890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.323603 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.323780 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:46.323853 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:46.324454 (+ 601us) server_negotiation.cc:299] Negotiation successful
0807 04:16:46.324603 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":606,"thread_start_us":491,"threads_started":1}
I20260807 04:16:46.325192 16737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:46.315669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:37837 (local address 127.7.200.195:50423)
0807 04:16:46.316946 (+ 1277us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:46.316961 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:46.317067 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:46.317389 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:46.317394 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:46.317437 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:16:46.317950 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:46.317971 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.319603 (+ 1632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.319609 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:46.322184 (+ 2575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:46.322199 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.323848 (+ 1649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.323856 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:46.324188 (+ 332us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:46.324311 (+ 123us) client_negotiation.cc:769] Sending connection context
0807 04:16:46.324412 (+ 101us) client_negotiation.cc:240] Negotiation successful
0807 04:16:46.324659 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1159,"mutex_wait_us":358,"spinlock_wait_cycles":3968,"thread_start_us":814,"threads_started":1}
I20260807 04:16:46.325560 16738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:46.315640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:40247 (local address 127.7.200.195:34913)
0807 04:16:46.316796 (+ 1156us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:46.316819 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:46.316976 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:46.317389 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:46.317394 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:46.317431 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:16:46.318136 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:46.318151 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.319639 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.319645 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:46.322184 (+ 2539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:46.322199 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.323880 (+ 1681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.323884 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:46.324184 (+ 300us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:46.324311 (+ 127us) client_negotiation.cc:769] Sending connection context
0807 04:16:46.324412 (+ 101us) client_negotiation.cc:240] Negotiation successful
0807 04:16:46.324659 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":943,"mutex_wait_us":384,"spinlock_wait_cycles":1280,"thread_start_us":1003,"threads_started":1}
I20260807 04:16:46.325981 16461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dcde4af68fb8472690e2527d7321f40d" candidate_uuid: "b57b231ba91841bb8efe01cc7214f3c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12c3099a4725491285ff68d2166fbcb3" is_pre_election: true
I20260807 04:16:46.326256 16461 raft_consensus.cc:2454] T dcde4af68fb8472690e2527d7321f40d P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b57b231ba91841bb8efe01cc7214f3c2 in term 0.
I20260807 04:16:46.326277 16315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dcde4af68fb8472690e2527d7321f40d" candidate_uuid: "b57b231ba91841bb8efe01cc7214f3c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" is_pre_election: true
I20260807 04:16:46.326543 16315 raft_consensus.cc:2454] T dcde4af68fb8472690e2527d7321f40d P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b57b231ba91841bb8efe01cc7214f3c2 in term 0.
I20260807 04:16:46.327070 16537 leader_election.cc:302] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12c3099a4725491285ff68d2166fbcb3, b57b231ba91841bb8efe01cc7214f3c2; no voters:
I20260807 04:16:46.327577 16697 raft_consensus.cc:2781] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:16:46.327741 16697 raft_consensus.cc:482] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:16:46.327868 16697 raft_consensus.cc:3037] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:46.330487 16697 raft_consensus.cc:504] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:46.331188 16697 leader_election.cc:288] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2 [CANDIDATE]: Term 1 election: Requested vote from peers 390a78efc54c4fe0a3b8da1a8bd18d8f (127.7.200.193:40247), 12c3099a4725491285ff68d2166fbcb3 (127.7.200.194:37837)
I20260807 04:16:46.331763 16315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dcde4af68fb8472690e2527d7321f40d" candidate_uuid: "b57b231ba91841bb8efe01cc7214f3c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f"
I20260807 04:16:46.331821 16461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dcde4af68fb8472690e2527d7321f40d" candidate_uuid: "b57b231ba91841bb8efe01cc7214f3c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12c3099a4725491285ff68d2166fbcb3"
I20260807 04:16:46.332024 16315 raft_consensus.cc:3037] T dcde4af68fb8472690e2527d7321f40d P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:46.332046 16461 raft_consensus.cc:3037] T dcde4af68fb8472690e2527d7321f40d P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:46.334425 16315 raft_consensus.cc:2454] T dcde4af68fb8472690e2527d7321f40d P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b57b231ba91841bb8efe01cc7214f3c2 in term 1.
I20260807 04:16:46.335137 16461 raft_consensus.cc:2454] T dcde4af68fb8472690e2527d7321f40d P 12c3099a4725491285ff68d2166fbcb3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b57b231ba91841bb8efe01cc7214f3c2 in term 1.
I20260807 04:16:46.335772 16535 leader_election.cc:302] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 390a78efc54c4fe0a3b8da1a8bd18d8f, b57b231ba91841bb8efe01cc7214f3c2; no voters:
I20260807 04:16:46.336367 16697 raft_consensus.cc:2781] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:16:46.336900 16697 raft_consensus.cc:686] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2 [term 1 LEADER]: Becoming Leader. State: Replica: b57b231ba91841bb8efe01cc7214f3c2, State: Running, Role: LEADER
I20260807 04:16:46.337612 16697 consensus_queue.cc:237] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:46.339637 16740 tablet_replica.cc:439] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2: TxnStatusTablet state changed. Reason: New leader b57b231ba91841bb8efe01cc7214f3c2. Latest consensus state: current_term: 1 leader_uuid: "b57b231ba91841bb8efe01cc7214f3c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } } }
I20260807 04:16:46.340178 16740 tablet_replica.cc:442] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2: This TxnStatusTablet replica's current role is: LEADER
I20260807 04:16:46.340962 16742 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 04:16:46.341185 16742 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 04:16:46.341679 16142 catalog_manager.cc:5495] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2 reported cstate change: term changed from 0 to 1, leader changed from <none> to b57b231ba91841bb8efe01cc7214f3c2 (127.7.200.195). New cstate: current_term: 1 leader_uuid: "b57b231ba91841bb8efe01cc7214f3c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } health_report { overall_health: HEALTHY } } }
I20260807 04:16:46.374802 16733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:46.368794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:34029 (local address 127.0.0.1:44214)
0807 04:16:46.369143 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:46.369165 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:46.369336 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:46.369827 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:46.369832 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:46.369844 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 04:16:46.370053 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:46.370062 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.371128 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.371134 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:46.372168 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:46.372180 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.373016 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.373023 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:46.373247 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:46.373320 (+ 73us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 04:16:46.374204 (+ 884us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 04:16:46.374227 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 04:16:46.374315 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 04:16:46.374473 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98}
I20260807 04:16:46.374836 16687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:46.368897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44214 (local address 127.7.200.195:34029)
0807 04:16:46.369104 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:46.369110 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:46.369237 (+ 127us) server_negotiation.cc:407] Connection header received
0807 04:16:46.369547 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:46.369552 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:46.369656 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:46.369804 (+ 148us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:16:46.370184 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.370991 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.372315 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.372841 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.372977 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:46.373526 (+ 549us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:16:46.374068 (+ 542us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:16:46.374241 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:46.374369 (+ 128us) server_negotiation.cc:299] Negotiation successful
0807 04:16:46.374465 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 04:16:46.380151 16461 raft_consensus.cc:1261] T dcde4af68fb8472690e2527d7321f40d P 12c3099a4725491285ff68d2166fbcb3 [term 1 FOLLOWER]: Refusing update from remote peer b57b231ba91841bb8efe01cc7214f3c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:16:46.380447 16315 raft_consensus.cc:1261] T dcde4af68fb8472690e2527d7321f40d P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 1 FOLLOWER]: Refusing update from remote peer b57b231ba91841bb8efe01cc7214f3c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:16:46.380878 16740 consensus_queue.cc:1035] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:16:46.381417 16697 consensus_queue.cc:1035] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:16:46.389744 16696 tablet_replica.cc:439] T dcde4af68fb8472690e2527d7321f40d P 390a78efc54c4fe0a3b8da1a8bd18d8f: TxnStatusTablet state changed. Reason: New leader b57b231ba91841bb8efe01cc7214f3c2. Latest consensus state: current_term: 1 leader_uuid: "b57b231ba91841bb8efe01cc7214f3c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } } }
I20260807 04:16:46.390091 16696 tablet_replica.cc:442] T dcde4af68fb8472690e2527d7321f40d P 390a78efc54c4fe0a3b8da1a8bd18d8f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:16:46.392840 16698 tablet_replica.cc:439] T dcde4af68fb8472690e2527d7321f40d P 12c3099a4725491285ff68d2166fbcb3: TxnStatusTablet state changed. Reason: New leader b57b231ba91841bb8efe01cc7214f3c2. Latest consensus state: current_term: 1 leader_uuid: "b57b231ba91841bb8efe01cc7214f3c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } } }
I20260807 04:16:46.393196 16698 tablet_replica.cc:442] T dcde4af68fb8472690e2527d7321f40d P 12c3099a4725491285ff68d2166fbcb3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:16:46.395689 16745 mvcc.cc:205] Tried to move back new op lower bound from 7315768141325295616 to 7315768141162700800. Current Snapshot: MvccSnapshot[applied={T|T < 7315768141325295616}]
I20260807 04:16:46.397066 16749 mvcc.cc:205] Tried to move back new op lower bound from 7315768141325295616 to 7315768141162700800. Current Snapshot: MvccSnapshot[applied={T|T < 7315768141325295616}]
I20260807 04:16:46.401353 16696 tablet_replica.cc:439] T dcde4af68fb8472690e2527d7321f40d P 390a78efc54c4fe0a3b8da1a8bd18d8f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b57b231ba91841bb8efe01cc7214f3c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } } }
I20260807 04:16:46.401701 16696 tablet_replica.cc:442] T dcde4af68fb8472690e2527d7321f40d P 390a78efc54c4fe0a3b8da1a8bd18d8f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:16:46.402141 16697 tablet_replica.cc:439] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b57b231ba91841bb8efe01cc7214f3c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } } }
I20260807 04:16:46.402484 16697 tablet_replica.cc:442] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2: This TxnStatusTablet replica's current role is: LEADER
I20260807 04:16:46.402170 16751 tablet_replica.cc:439] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b57b231ba91841bb8efe01cc7214f3c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } } }
I20260807 04:16:46.402974 16751 tablet_replica.cc:442] T dcde4af68fb8472690e2527d7321f40d P b57b231ba91841bb8efe01cc7214f3c2: This TxnStatusTablet replica's current role is: LEADER
I20260807 04:16:46.403808 16698 tablet_replica.cc:439] T dcde4af68fb8472690e2527d7321f40d P 12c3099a4725491285ff68d2166fbcb3: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b57b231ba91841bb8efe01cc7214f3c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } } }
I20260807 04:16:46.404148 16698 tablet_replica.cc:442] T dcde4af68fb8472690e2527d7321f40d P 12c3099a4725491285ff68d2166fbcb3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 04:16:46.418749 16739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:46.411398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55664 (local address 127.7.200.194:37837)
0807 04:16:46.411645 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:46.411651 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:46.412019 (+ 368us) server_negotiation.cc:407] Connection header received
0807 04:16:46.412242 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:46.412245 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:46.412331 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:46.412468 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:16:46.413088 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.413830 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.416224 (+ 2394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.416695 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.416872 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:46.417400 (+ 528us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:16:46.417980 (+ 580us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:16:46.418095 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:46.418288 (+ 193us) server_negotiation.cc:299] Negotiation successful
0807 04:16:46.418378 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 04:16:46.437321 16759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:46.430336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:34029 (local address 127.7.200.194:47125)
0807 04:16:46.431304 (+ 968us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:46.431321 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:46.431442 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:46.431816 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:46.431820 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:46.431830 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 04:16:46.432085 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:46.432093 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.433670 (+ 1577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.433674 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:46.434872 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:46.434884 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.436174 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.436179 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:46.436299 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:46.436355 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 04:16:46.436821 (+ 466us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 04:16:46.436831 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 04:16:46.436897 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 04:16:46.437004 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":796,"thread_start_us":643,"threads_started":1}
I20260807 04:16:46.437412 16687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:46.430456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:47125 (local address 127.7.200.195:34029)
0807 04:16:46.430773 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:46.430783 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:46.431407 (+ 624us) server_negotiation.cc:407] Connection header received
0807 04:16:46.431572 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:46.431579 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:46.431696 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:46.431804 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:16:46.432244 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.433534 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.435024 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.435949 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.436090 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:46.436533 (+ 443us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:16:46.436674 (+ 141us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:16:46.436818 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:46.436953 (+ 135us) server_negotiation.cc:299] Negotiation successful
0807 04:16:46.437048 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 04:16:46.447878 16609 raft_consensus.cc:1261] T 6bd9310b2ea9420a982bf6e1299c00ea P b57b231ba91841bb8efe01cc7214f3c2 [term 1 FOLLOWER]: Refusing update from remote peer 12c3099a4725491285ff68d2166fbcb3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:16:46.447938 16315 raft_consensus.cc:1261] T 6bd9310b2ea9420a982bf6e1299c00ea P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 1 FOLLOWER]: Refusing update from remote peer 12c3099a4725491285ff68d2166fbcb3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:16:46.448644 16723 consensus_queue.cc:1035] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:16:46.449373 16698 consensus_queue.cc:1035] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:16:46.497417 16739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:46.489917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:32949 (local address 127.7.200.194:37837)
0807 04:16:46.490078 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:46.490082 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:46.491086 (+ 1004us) server_negotiation.cc:407] Connection header received
0807 04:16:46.491317 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:46.491323 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:46.491438 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:46.491558 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:16:46.492267 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.493655 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.495349 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.495957 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.496101 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:46.496679 (+ 578us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:16:46.496861 (+ 182us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:16:46.496935 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:46.497122 (+ 187us) server_negotiation.cc:299] Negotiation successful
0807 04:16:46.497190 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 04:16:46.497793 16764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:46.490033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:37837 (local address 127.7.200.195:32949)
0807 04:16:46.490962 (+ 929us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:46.490986 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:46.491160 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:46.491579 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:46.491583 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:46.491596 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 04:16:46.492047 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:46.492063 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.493790 (+ 1727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.493795 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:46.495209 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:46.495222 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.496184 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.496193 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:46.496403 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:46.496488 (+ 85us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 04:16:46.496963 (+ 475us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 04:16:46.496977 (+ 14us) client_negotiation.cc:769] Sending connection context
0807 04:16:46.497076 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 04:16:46.497247 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":690,"spinlock_wait_cycles":8448,"thread_start_us":671,"threads_started":1}
I20260807 04:16:46.539321 16141 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37234:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:16:46.539595 16141 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37234:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:16:46.543118 16141 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e98ddfcebd144582a387c1d6fc1efe93: Sending DeleteTablet for 3 replicas of tablet 6bd9310b2ea9420a982bf6e1299c00ea
I20260807 04:16:46.544113 16289 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bd9310b2ea9420a982bf6e1299c00ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:16:46 UTC) from {username='oryx', principal='oryx/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:34936
I20260807 04:16:46.544855 16768 tablet_replica.cc:330] T 6bd9310b2ea9420a982bf6e1299c00ea P 390a78efc54c4fe0a3b8da1a8bd18d8f: stopping tablet replica
I20260807 04:16:46.544863 16586 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bd9310b2ea9420a982bf6e1299c00ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:16:46 UTC) from {username='oryx', principal='oryx/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:44202
I20260807 04:16:46.545202 16768 raft_consensus.cc:2229] T 6bd9310b2ea9420a982bf6e1299c00ea P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:16:46.546073 16439 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bd9310b2ea9420a982bf6e1299c00ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:16:46 UTC) from {username='oryx', principal='oryx/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:55648
I20260807 04:16:46.545514 16768 raft_consensus.cc:2258] T 6bd9310b2ea9420a982bf6e1299c00ea P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:16:46.553517 16770 tablet_replica.cc:330] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3: stopping tablet replica
I20260807 04:16:46.553747 16770 raft_consensus.cc:2229] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3 [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:16:46.554067 16768 ts_tablet_manager.cc:1905] T 6bd9310b2ea9420a982bf6e1299c00ea P 390a78efc54c4fe0a3b8da1a8bd18d8f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:16:46.554370 16770 raft_consensus.cc:2258] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:16:46.555472 16770 ts_tablet_manager.cc:1905] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:16:46.562041 16768 ts_tablet_manager.cc:1918] T 6bd9310b2ea9420a982bf6e1299c00ea P 390a78efc54c4fe0a3b8da1a8bd18d8f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 04:16:46.562299 16768 log.cc:1196] T 6bd9310b2ea9420a982bf6e1299c00ea P 390a78efc54c4fe0a3b8da1a8bd18d8f: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-0/wal/wals/6bd9310b2ea9420a982bf6e1299c00ea
I20260807 04:16:46.562897 16768 ts_tablet_manager.cc:1939] T 6bd9310b2ea9420a982bf6e1299c00ea P 390a78efc54c4fe0a3b8da1a8bd18d8f: Deleting consensus metadata
I20260807 04:16:46.564318 16128 catalog_manager.cc:4841] TS 390a78efc54c4fe0a3b8da1a8bd18d8f (127.7.200.193:40247): tablet 6bd9310b2ea9420a982bf6e1299c00ea (table test-table [id=9531d9d16e4e4c15b59649ea44d2a322]) successfully deleted
I20260807 04:16:46.567533 16770 ts_tablet_manager.cc:1918] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 04:16:46.567699 16770 log.cc:1196] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-1/wal/wals/6bd9310b2ea9420a982bf6e1299c00ea
I20260807 04:16:46.568154 16770 ts_tablet_manager.cc:1939] T 6bd9310b2ea9420a982bf6e1299c00ea P 12c3099a4725491285ff68d2166fbcb3: Deleting consensus metadata
I20260807 04:16:46.569429 16129 catalog_manager.cc:4841] TS 12c3099a4725491285ff68d2166fbcb3 (127.7.200.194:37837): tablet 6bd9310b2ea9420a982bf6e1299c00ea (table test-table [id=9531d9d16e4e4c15b59649ea44d2a322]) successfully deleted
I20260807 04:16:46.571353 16769 tablet_replica.cc:330] T 6bd9310b2ea9420a982bf6e1299c00ea P b57b231ba91841bb8efe01cc7214f3c2: stopping tablet replica
I20260807 04:16:46.571599 16769 raft_consensus.cc:2229] T 6bd9310b2ea9420a982bf6e1299c00ea P b57b231ba91841bb8efe01cc7214f3c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:16:46.571938 16769 raft_consensus.cc:2258] T 6bd9310b2ea9420a982bf6e1299c00ea P b57b231ba91841bb8efe01cc7214f3c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:16:46.579923 16769 ts_tablet_manager.cc:1905] T 6bd9310b2ea9420a982bf6e1299c00ea P b57b231ba91841bb8efe01cc7214f3c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:16:46.602221 16769 ts_tablet_manager.cc:1918] T 6bd9310b2ea9420a982bf6e1299c00ea P b57b231ba91841bb8efe01cc7214f3c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 04:16:46.602392 16769 log.cc:1196] T 6bd9310b2ea9420a982bf6e1299c00ea P b57b231ba91841bb8efe01cc7214f3c2: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-2/wal/wals/6bd9310b2ea9420a982bf6e1299c00ea
I20260807 04:16:46.602937 16769 ts_tablet_manager.cc:1939] T 6bd9310b2ea9420a982bf6e1299c00ea P b57b231ba91841bb8efe01cc7214f3c2: Deleting consensus metadata
I20260807 04:16:46.604238 16126 catalog_manager.cc:4841] TS b57b231ba91841bb8efe01cc7214f3c2 (127.7.200.195:34029): tablet 6bd9310b2ea9420a982bf6e1299c00ea (table test-table [id=9531d9d16e4e4c15b59649ea44d2a322]) successfully deleted
Aug 07 04:16:46 dist-test-slave-qg60 krb5kdc[16095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076206, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 04:16:46 dist-test-slave-qg60 krb5kdc[16095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:16:46 dist-test-slave-qg60 krb5kdc[16095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 04:16:46.677515 16778 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:16:46.645809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37252 (local address 127.7.200.254:46561)
0807 04:16:46.661791 (+ 15982us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:46.661799 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:46.661827 (+ 28us) server_negotiation.cc:407] Connection header received
0807 04:16:46.661901 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:46.661907 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:46.661995 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:46.662136 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:46.664298 (+ 2162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.665445 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.667604 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.668255 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.668382 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:46.677172 (+ 8790us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37252: BlockingRecv error: recv got EOF from 127.0.0.1:37252 (error 108)
Metrics: {"server-negotiator.queue_time_us":15825,"thread_start_us":15644,"threads_started":1}
Aug 07 04:16:46 dist-test-slave-qg60 krb5kdc[16095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076206, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM
I20260807 04:16:46.714092 16778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:46.690346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37254 (local address 127.7.200.254:46561)
0807 04:16:46.690572 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:46.690579 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:46.693367 (+ 2788us) server_negotiation.cc:407] Connection header received
0807 04:16:46.693579 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:46.693585 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:46.693676 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:46.693794 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:46.695675 (+ 1881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.696962 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.699169 (+ 2207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.699871 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.700021 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:46.705899 (+ 5878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:46.705909 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:46.705916 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:46.705974 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:46.710037 (+ 4063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:46.711192 (+ 1155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:46.711199 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:46.711203 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:46.711411 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:46.711946 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:46.711952 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:46.711957 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:46.712375 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:46.712672 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:46.713463 (+ 791us) server_negotiation.cc:299] Negotiation successful
0807 04:16:46.713723 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260807 04:16:46.718703 16141 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37254:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:16:46.719590 16141 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:16:46.727792 16289 tablet_service.cc:1467] Processing CreateTablet for tablet 681cb2cd83f34ff99cd99abf79f3cf5e (DEFAULT_TABLE table=test-table [id=fca068cc3b7b4a0f8bacf6cb1e55dd03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:16:46.728343 16289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 681cb2cd83f34ff99cd99abf79f3cf5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:46.728499 16439 tablet_service.cc:1467] Processing CreateTablet for tablet 681cb2cd83f34ff99cd99abf79f3cf5e (DEFAULT_TABLE table=test-table [id=fca068cc3b7b4a0f8bacf6cb1e55dd03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:16:46.729125 16586 tablet_service.cc:1467] Processing CreateTablet for tablet 681cb2cd83f34ff99cd99abf79f3cf5e (DEFAULT_TABLE table=test-table [id=fca068cc3b7b4a0f8bacf6cb1e55dd03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:16:46.729625 16586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 681cb2cd83f34ff99cd99abf79f3cf5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:46.733500 16439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 681cb2cd83f34ff99cd99abf79f3cf5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:46.743070 16784 tablet_bootstrap.cc:492] T 681cb2cd83f34ff99cd99abf79f3cf5e P 390a78efc54c4fe0a3b8da1a8bd18d8f: Bootstrap starting.
I20260807 04:16:46.748751 16784 tablet_bootstrap.cc:654] T 681cb2cd83f34ff99cd99abf79f3cf5e P 390a78efc54c4fe0a3b8da1a8bd18d8f: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:46.759899 16784 tablet_bootstrap.cc:492] T 681cb2cd83f34ff99cd99abf79f3cf5e P 390a78efc54c4fe0a3b8da1a8bd18d8f: No bootstrap required, opened a new log
I20260807 04:16:46.760090 16784 ts_tablet_manager.cc:1397] T 681cb2cd83f34ff99cd99abf79f3cf5e P 390a78efc54c4fe0a3b8da1a8bd18d8f: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.005s
I20260807 04:16:46.760979 16784 raft_consensus.cc:348] T 681cb2cd83f34ff99cd99abf79f3cf5e P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:46.761274 16784 raft_consensus.cc:374] T 681cb2cd83f34ff99cd99abf79f3cf5e P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:46.761372 16784 raft_consensus.cc:729] T 681cb2cd83f34ff99cd99abf79f3cf5e P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 390a78efc54c4fe0a3b8da1a8bd18d8f, State: Initialized, Role: FOLLOWER
I20260807 04:16:46.761668 16784 consensus_queue.cc:260] T 681cb2cd83f34ff99cd99abf79f3cf5e P 390a78efc54c4fe0a3b8da1a8bd18d8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:46.763516 16787 tablet_bootstrap.cc:492] T 681cb2cd83f34ff99cd99abf79f3cf5e P b57b231ba91841bb8efe01cc7214f3c2: Bootstrap starting.
I20260807 04:16:46.765522 16787 tablet_bootstrap.cc:654] T 681cb2cd83f34ff99cd99abf79f3cf5e P b57b231ba91841bb8efe01cc7214f3c2: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:46.766391 16784 ts_tablet_manager.cc:1428] T 681cb2cd83f34ff99cd99abf79f3cf5e P 390a78efc54c4fe0a3b8da1a8bd18d8f: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260807 04:16:46.767762 16785 tablet_bootstrap.cc:492] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3: Bootstrap starting.
I20260807 04:16:46.769840 16785 tablet_bootstrap.cc:654] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:46.772815 16785 tablet_bootstrap.cc:492] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3: No bootstrap required, opened a new log
I20260807 04:16:46.772985 16785 ts_tablet_manager.cc:1397] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260807 04:16:46.773864 16785 raft_consensus.cc:348] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:46.774181 16785 raft_consensus.cc:374] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:46.774273 16785 raft_consensus.cc:729] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12c3099a4725491285ff68d2166fbcb3, State: Initialized, Role: FOLLOWER
I20260807 04:16:46.775297 16785 consensus_queue.cc:260] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:46.775949 16785 ts_tablet_manager.cc:1428] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 04:16:46.779127 16762 raft_consensus.cc:482] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:16:46.779294 16762 raft_consensus.cc:504] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:46.780038 16762 leader_election.cc:288] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 390a78efc54c4fe0a3b8da1a8bd18d8f (127.7.200.193:40247), b57b231ba91841bb8efe01cc7214f3c2 (127.7.200.195:34029)
I20260807 04:16:46.780826 16609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "681cb2cd83f34ff99cd99abf79f3cf5e" candidate_uuid: "12c3099a4725491285ff68d2166fbcb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b57b231ba91841bb8efe01cc7214f3c2" is_pre_election: true
I20260807 04:16:46.781635 16315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "681cb2cd83f34ff99cd99abf79f3cf5e" candidate_uuid: "12c3099a4725491285ff68d2166fbcb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" is_pre_election: true
I20260807 04:16:46.781916 16315 raft_consensus.cc:2454] T 681cb2cd83f34ff99cd99abf79f3cf5e P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12c3099a4725491285ff68d2166fbcb3 in term 0.
I20260807 04:16:46.782425 16388 leader_election.cc:302] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12c3099a4725491285ff68d2166fbcb3, 390a78efc54c4fe0a3b8da1a8bd18d8f; no voters:
W20260807 04:16:46.782907 16386 leader_election.cc:341] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b57b231ba91841bb8efe01cc7214f3c2 (127.7.200.195:34029): Illegal state: must be running to vote when last-logged opid is not known
I20260807 04:16:46.783766 16762 raft_consensus.cc:2781] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:16:46.783903 16762 raft_consensus.cc:482] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:16:46.784001 16762 raft_consensus.cc:3037] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:46.786375 16787 tablet_bootstrap.cc:492] T 681cb2cd83f34ff99cd99abf79f3cf5e P b57b231ba91841bb8efe01cc7214f3c2: No bootstrap required, opened a new log
I20260807 04:16:46.786536 16787 ts_tablet_manager.cc:1397] T 681cb2cd83f34ff99cd99abf79f3cf5e P b57b231ba91841bb8efe01cc7214f3c2: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.013s
I20260807 04:16:46.787302 16787 raft_consensus.cc:348] T 681cb2cd83f34ff99cd99abf79f3cf5e P b57b231ba91841bb8efe01cc7214f3c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:46.787529 16787 raft_consensus.cc:374] T 681cb2cd83f34ff99cd99abf79f3cf5e P b57b231ba91841bb8efe01cc7214f3c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:46.787606 16787 raft_consensus.cc:729] T 681cb2cd83f34ff99cd99abf79f3cf5e P b57b231ba91841bb8efe01cc7214f3c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b57b231ba91841bb8efe01cc7214f3c2, State: Initialized, Role: FOLLOWER
I20260807 04:16:46.787848 16787 consensus_queue.cc:260] T 681cb2cd83f34ff99cd99abf79f3cf5e P b57b231ba91841bb8efe01cc7214f3c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:46.788988 16762 raft_consensus.cc:504] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:46.789443 16787 ts_tablet_manager.cc:1428] T 681cb2cd83f34ff99cd99abf79f3cf5e P b57b231ba91841bb8efe01cc7214f3c2: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260807 04:16:46.790092 16315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "681cb2cd83f34ff99cd99abf79f3cf5e" candidate_uuid: "12c3099a4725491285ff68d2166fbcb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f"
I20260807 04:16:46.790305 16315 raft_consensus.cc:3037] T 681cb2cd83f34ff99cd99abf79f3cf5e P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:46.798882 16315 raft_consensus.cc:2454] T 681cb2cd83f34ff99cd99abf79f3cf5e P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12c3099a4725491285ff68d2166fbcb3 in term 1.
I20260807 04:16:46.799567 16388 leader_election.cc:302] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12c3099a4725491285ff68d2166fbcb3, 390a78efc54c4fe0a3b8da1a8bd18d8f; no voters:
I20260807 04:16:46.799937 16766 raft_consensus.cc:2781] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:16:46.800139 16766 raft_consensus.cc:686] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3 [term 1 LEADER]: Becoming Leader. State: Replica: 12c3099a4725491285ff68d2166fbcb3, State: Running, Role: LEADER
I20260807 04:16:46.800561 16766 consensus_queue.cc:237] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:46.803685 16609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "681cb2cd83f34ff99cd99abf79f3cf5e" candidate_uuid: "12c3099a4725491285ff68d2166fbcb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b57b231ba91841bb8efe01cc7214f3c2"
I20260807 04:16:46.803957 16609 raft_consensus.cc:3037] T 681cb2cd83f34ff99cd99abf79f3cf5e P b57b231ba91841bb8efe01cc7214f3c2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:46.807291 16609 raft_consensus.cc:2454] T 681cb2cd83f34ff99cd99abf79f3cf5e P b57b231ba91841bb8efe01cc7214f3c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12c3099a4725491285ff68d2166fbcb3 in term 1.
I20260807 04:16:46.808219 16762 leader_election.cc:288] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3 [CANDIDATE]: Term 1 election: Requested vote from peers 390a78efc54c4fe0a3b8da1a8bd18d8f (127.7.200.193:40247), b57b231ba91841bb8efe01cc7214f3c2 (127.7.200.195:34029)
I20260807 04:16:46.814114 16141 catalog_manager.cc:5495] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 12c3099a4725491285ff68d2166fbcb3 (127.7.200.194). New cstate: current_term: 1 leader_uuid: "12c3099a4725491285ff68d2166fbcb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } health_report { overall_health: UNKNOWN } } }
I20260807 04:16:46.840559 16739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:46.833580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55668 (local address 127.7.200.194:37837)
0807 04:16:46.833753 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:46.833760 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:46.833994 (+ 234us) server_negotiation.cc:407] Connection header received
0807 04:16:46.834126 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:46.834131 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:46.834222 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:46.834312 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:16:46.834763 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.836027 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.838236 (+ 2209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:46.838946 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:46.839080 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:46.839670 (+ 590us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:16:46.839820 (+ 150us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:16:46.839921 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:46.840116 (+ 195us) server_negotiation.cc:299] Negotiation successful
0807 04:16:46.840214 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 04:16:46.844056 16609 raft_consensus.cc:1261] T 681cb2cd83f34ff99cd99abf79f3cf5e P b57b231ba91841bb8efe01cc7214f3c2 [term 1 FOLLOWER]: Refusing update from remote peer 12c3099a4725491285ff68d2166fbcb3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:16:46.845283 16315 raft_consensus.cc:1261] T 681cb2cd83f34ff99cd99abf79f3cf5e P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 1 FOLLOWER]: Refusing update from remote peer 12c3099a4725491285ff68d2166fbcb3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:16:46.846240 16723 consensus_queue.cc:1035] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:16:46.846869 16723 consensus_queue.cc:1035] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:16:46.860324 16142 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37254:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:16:46.860626 16142 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37254:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:16:46.864929 16142 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e98ddfcebd144582a387c1d6fc1efe93: Sending DeleteTablet for 3 replicas of tablet 681cb2cd83f34ff99cd99abf79f3cf5e
I20260807 04:16:46.866860 16289 tablet_service.cc:1514] Processing DeleteTablet for tablet 681cb2cd83f34ff99cd99abf79f3cf5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:16:46 UTC) from {username='oryx', principal='oryx/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:34936
I20260807 04:16:46.867149 16768 tablet_replica.cc:330] T 681cb2cd83f34ff99cd99abf79f3cf5e P 390a78efc54c4fe0a3b8da1a8bd18d8f: stopping tablet replica
I20260807 04:16:46.867443 16439 tablet_service.cc:1514] Processing DeleteTablet for tablet 681cb2cd83f34ff99cd99abf79f3cf5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:16:46 UTC) from {username='oryx', principal='oryx/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:55648
I20260807 04:16:46.867765 16770 tablet_replica.cc:330] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3: stopping tablet replica
I20260807 04:16:46.867820 16586 tablet_service.cc:1514] Processing DeleteTablet for tablet 681cb2cd83f34ff99cd99abf79f3cf5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:16:46 UTC) from {username='oryx', principal='oryx/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:44202
I20260807 04:16:46.868069 16770 raft_consensus.cc:2229] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3 [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:16:46.868124 16769 tablet_replica.cc:330] T 681cb2cd83f34ff99cd99abf79f3cf5e P b57b231ba91841bb8efe01cc7214f3c2: stopping tablet replica
I20260807 04:16:46.868345 16769 raft_consensus.cc:2229] T 681cb2cd83f34ff99cd99abf79f3cf5e P b57b231ba91841bb8efe01cc7214f3c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:16:46.868427 16770 raft_consensus.cc:2258] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:16:46.868605 16769 raft_consensus.cc:2258] T 681cb2cd83f34ff99cd99abf79f3cf5e P b57b231ba91841bb8efe01cc7214f3c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:16:46.869540 16770 ts_tablet_manager.cc:1905] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:16:46.870239 16141 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37254:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:16:46.870941 16141 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:16:46.878018 16770 ts_tablet_manager.cc:1918] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:16:46.878197 16770 log.cc:1196] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-1/wal/wals/681cb2cd83f34ff99cd99abf79f3cf5e
I20260807 04:16:46.879443 16439 tablet_service.cc:1467] Processing CreateTablet for tablet 5bfa18da6be14846a4db2cc994118031 (DEFAULT_TABLE table=test-table [id=154972fa9c1c46df8fca682935a05098]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:16:46.879890 16439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bfa18da6be14846a4db2cc994118031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:46.882236 16769 ts_tablet_manager.cc:1905] T 681cb2cd83f34ff99cd99abf79f3cf5e P b57b231ba91841bb8efe01cc7214f3c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:16:46.885504 16289 tablet_service.cc:1467] Processing CreateTablet for tablet 5bfa18da6be14846a4db2cc994118031 (DEFAULT_TABLE table=test-table [id=154972fa9c1c46df8fca682935a05098]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:16:46.890290 16586 tablet_service.cc:1467] Processing CreateTablet for tablet 5bfa18da6be14846a4db2cc994118031 (DEFAULT_TABLE table=test-table [id=154972fa9c1c46df8fca682935a05098]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:16:46.890733 16586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bfa18da6be14846a4db2cc994118031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:46.892479 16289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bfa18da6be14846a4db2cc994118031. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:46.892693 16769 ts_tablet_manager.cc:1918] T 681cb2cd83f34ff99cd99abf79f3cf5e P b57b231ba91841bb8efe01cc7214f3c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:16:46.892915 16769 log.cc:1196] T 681cb2cd83f34ff99cd99abf79f3cf5e P b57b231ba91841bb8efe01cc7214f3c2: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-2/wal/wals/681cb2cd83f34ff99cd99abf79f3cf5e
I20260807 04:16:46.893430 16769 ts_tablet_manager.cc:1939] T 681cb2cd83f34ff99cd99abf79f3cf5e P b57b231ba91841bb8efe01cc7214f3c2: Deleting consensus metadata
I20260807 04:16:46.895884 16126 catalog_manager.cc:4841] TS b57b231ba91841bb8efe01cc7214f3c2 (127.7.200.195:34029): tablet 681cb2cd83f34ff99cd99abf79f3cf5e (table test-table [id=fca068cc3b7b4a0f8bacf6cb1e55dd03]) successfully deleted
I20260807 04:16:46.900051 16784 tablet_bootstrap.cc:492] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f: Bootstrap starting.
I20260807 04:16:46.901917 16784 tablet_bootstrap.cc:654] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:46.905260 16787 tablet_bootstrap.cc:492] T 5bfa18da6be14846a4db2cc994118031 P b57b231ba91841bb8efe01cc7214f3c2: Bootstrap starting.
I20260807 04:16:46.905937 16785 tablet_bootstrap.cc:492] T 5bfa18da6be14846a4db2cc994118031 P 12c3099a4725491285ff68d2166fbcb3: Bootstrap starting.
I20260807 04:16:46.906971 16787 tablet_bootstrap.cc:654] T 5bfa18da6be14846a4db2cc994118031 P b57b231ba91841bb8efe01cc7214f3c2: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:46.907794 16785 tablet_bootstrap.cc:654] T 5bfa18da6be14846a4db2cc994118031 P 12c3099a4725491285ff68d2166fbcb3: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:46.914974 16770 ts_tablet_manager.cc:1939] T 681cb2cd83f34ff99cd99abf79f3cf5e P 12c3099a4725491285ff68d2166fbcb3: Deleting consensus metadata
I20260807 04:16:46.916463 16784 tablet_bootstrap.cc:492] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f: No bootstrap required, opened a new log
I20260807 04:16:46.916648 16784 ts_tablet_manager.cc:1397] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.012s
I20260807 04:16:46.916720 16129 catalog_manager.cc:4841] TS 12c3099a4725491285ff68d2166fbcb3 (127.7.200.194:37837): tablet 681cb2cd83f34ff99cd99abf79f3cf5e (table test-table [id=fca068cc3b7b4a0f8bacf6cb1e55dd03]) successfully deleted
I20260807 04:16:46.917486 16784 raft_consensus.cc:348] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:46.917940 16784 raft_consensus.cc:374] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:46.918031 16784 raft_consensus.cc:729] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 390a78efc54c4fe0a3b8da1a8bd18d8f, State: Initialized, Role: FOLLOWER
I20260807 04:16:46.918345 16784 consensus_queue.cc:260] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:46.919075 16784 ts_tablet_manager.cc:1428] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260807 04:16:46.921455 16768 raft_consensus.cc:2229] T 681cb2cd83f34ff99cd99abf79f3cf5e P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:16:46.921674 16785 tablet_bootstrap.cc:492] T 5bfa18da6be14846a4db2cc994118031 P 12c3099a4725491285ff68d2166fbcb3: No bootstrap required, opened a new log
I20260807 04:16:46.922035 16787 tablet_bootstrap.cc:492] T 5bfa18da6be14846a4db2cc994118031 P b57b231ba91841bb8efe01cc7214f3c2: No bootstrap required, opened a new log
I20260807 04:16:46.922037 16768 pending_rounds.cc:62] T 681cb2cd83f34ff99cd99abf79f3cf5e P 390a78efc54c4fe0a3b8da1a8bd18d8f: Trying to abort 2 pending ops.
I20260807 04:16:46.922238 16787 ts_tablet_manager.cc:1397] T 5bfa18da6be14846a4db2cc994118031 P b57b231ba91841bb8efe01cc7214f3c2: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.009s
I20260807 04:16:46.922176 16768 pending_rounds.cc:68] T 681cb2cd83f34ff99cd99abf79f3cf5e P 390a78efc54c4fe0a3b8da1a8bd18d8f: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7315768143225597952 op_type: WRITE_OP write_request { tablet_id: "681cb2cd83f34ff99cd99abf79f3cf5e" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "val" type: INT32 is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\003\00090\000\0001\324\000\000" indirect_data: "<redacted>""" } external_consistency_mode: CLIENT_PROPAGATED authz_token { token_data: "\010\332\272\325\323\006\"8\n\ntest-admin\022*\n fca068cc3b7b4a0f8bacf6cb1e55dd03\020\001\030\001 \001(\001" signature: "<redacted>""f%\237c\303\253\266\303\261\272\250\267\t\260OIL\363\376\374\025\325\352\037\314w)\023o\242\341\010\347\033mg\310I\031\341\242L\014\314\025\375m\275|\005\263\241\375Q>=cNXSD\275\247V" signing_key_seq_num: 0 } } request_id { client_id: "9f22ef3987ff4ec098c564dcaff92cbd" seq_no: 0 first_incomplete_seq_no: 0 attempt_no: 0 }
I20260807 04:16:46.922879 16768 pending_rounds.cc:68] T 681cb2cd83f34ff99cd99abf79f3cf5e P 390a78efc54c4fe0a3b8da1a8bd18d8f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7315768143058694144 op_type: NO_OP noop_request { }
I20260807 04:16:46.923066 16768 raft_consensus.cc:2866] T 681cb2cd83f34ff99cd99abf79f3cf5e P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260807 04:16:46.922983 16787 raft_consensus.cc:348] T 5bfa18da6be14846a4db2cc994118031 P b57b231ba91841bb8efe01cc7214f3c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:46.923202 16768 raft_consensus.cc:2258] T 681cb2cd83f34ff99cd99abf79f3cf5e P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:16:46.923254 16787 raft_consensus.cc:374] T 5bfa18da6be14846a4db2cc994118031 P b57b231ba91841bb8efe01cc7214f3c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:46.923324 16787 raft_consensus.cc:729] T 5bfa18da6be14846a4db2cc994118031 P b57b231ba91841bb8efe01cc7214f3c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b57b231ba91841bb8efe01cc7214f3c2, State: Initialized, Role: FOLLOWER
I20260807 04:16:46.923557 16787 consensus_queue.cc:260] T 5bfa18da6be14846a4db2cc994118031 P b57b231ba91841bb8efe01cc7214f3c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:46.924207 16787 ts_tablet_manager.cc:1428] T 5bfa18da6be14846a4db2cc994118031 P b57b231ba91841bb8efe01cc7214f3c2: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 04:16:46.924479 16785 ts_tablet_manager.cc:1397] T 5bfa18da6be14846a4db2cc994118031 P 12c3099a4725491285ff68d2166fbcb3: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.004s
I20260807 04:16:46.925413 16785 raft_consensus.cc:348] T 5bfa18da6be14846a4db2cc994118031 P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:46.925698 16785 raft_consensus.cc:374] T 5bfa18da6be14846a4db2cc994118031 P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:46.925803 16785 raft_consensus.cc:729] T 5bfa18da6be14846a4db2cc994118031 P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12c3099a4725491285ff68d2166fbcb3, State: Initialized, Role: FOLLOWER
I20260807 04:16:46.926059 16785 consensus_queue.cc:260] T 5bfa18da6be14846a4db2cc994118031 P 12c3099a4725491285ff68d2166fbcb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:46.926685 16785 ts_tablet_manager.cc:1428] T 5bfa18da6be14846a4db2cc994118031 P 12c3099a4725491285ff68d2166fbcb3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 04:16:46.932256 16768 ts_tablet_manager.cc:1905] T 681cb2cd83f34ff99cd99abf79f3cf5e P 390a78efc54c4fe0a3b8da1a8bd18d8f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:16:46.939843 16768 ts_tablet_manager.cc:1918] T 681cb2cd83f34ff99cd99abf79f3cf5e P 390a78efc54c4fe0a3b8da1a8bd18d8f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:16:46.940024 16768 log.cc:1196] T 681cb2cd83f34ff99cd99abf79f3cf5e P 390a78efc54c4fe0a3b8da1a8bd18d8f: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-0/wal/wals/681cb2cd83f34ff99cd99abf79f3cf5e
I20260807 04:16:46.940457 16768 ts_tablet_manager.cc:1939] T 681cb2cd83f34ff99cd99abf79f3cf5e P 390a78efc54c4fe0a3b8da1a8bd18d8f: Deleting consensus metadata
I20260807 04:16:46.941730 16128 catalog_manager.cc:4841] TS 390a78efc54c4fe0a3b8da1a8bd18d8f (127.7.200.193:40247): tablet 681cb2cd83f34ff99cd99abf79f3cf5e (table test-table [id=fca068cc3b7b4a0f8bacf6cb1e55dd03]) successfully deleted
I20260807 04:16:47.205097 16696 raft_consensus.cc:482] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:16:47.205315 16696 raft_consensus.cc:504] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:47.206111 16696 leader_election.cc:288] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 12c3099a4725491285ff68d2166fbcb3 (127.7.200.194:37837), b57b231ba91841bb8efe01cc7214f3c2 (127.7.200.195:34029)
I20260807 04:16:47.206758 16461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bfa18da6be14846a4db2cc994118031" candidate_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12c3099a4725491285ff68d2166fbcb3" is_pre_election: true
I20260807 04:16:47.206789 16609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bfa18da6be14846a4db2cc994118031" candidate_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b57b231ba91841bb8efe01cc7214f3c2" is_pre_election: true
I20260807 04:16:47.207041 16461 raft_consensus.cc:2454] T 5bfa18da6be14846a4db2cc994118031 P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 390a78efc54c4fe0a3b8da1a8bd18d8f in term 0.
I20260807 04:16:47.207041 16609 raft_consensus.cc:2454] T 5bfa18da6be14846a4db2cc994118031 P b57b231ba91841bb8efe01cc7214f3c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 390a78efc54c4fe0a3b8da1a8bd18d8f in term 0.
I20260807 04:16:47.207468 16236 leader_election.cc:302] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 390a78efc54c4fe0a3b8da1a8bd18d8f, b57b231ba91841bb8efe01cc7214f3c2; no voters:
I20260807 04:16:47.207876 16696 raft_consensus.cc:2781] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:16:47.208056 16696 raft_consensus.cc:482] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:16:47.208158 16696 raft_consensus.cc:3037] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:47.210429 16696 raft_consensus.cc:504] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:47.211024 16696 leader_election.cc:288] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f [CANDIDATE]: Term 1 election: Requested vote from peers 12c3099a4725491285ff68d2166fbcb3 (127.7.200.194:37837), b57b231ba91841bb8efe01cc7214f3c2 (127.7.200.195:34029)
I20260807 04:16:47.211537 16461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bfa18da6be14846a4db2cc994118031" candidate_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12c3099a4725491285ff68d2166fbcb3"
I20260807 04:16:47.211542 16609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bfa18da6be14846a4db2cc994118031" candidate_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b57b231ba91841bb8efe01cc7214f3c2"
I20260807 04:16:47.211746 16461 raft_consensus.cc:3037] T 5bfa18da6be14846a4db2cc994118031 P 12c3099a4725491285ff68d2166fbcb3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:47.211756 16609 raft_consensus.cc:3037] T 5bfa18da6be14846a4db2cc994118031 P b57b231ba91841bb8efe01cc7214f3c2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:47.214136 16461 raft_consensus.cc:2454] T 5bfa18da6be14846a4db2cc994118031 P 12c3099a4725491285ff68d2166fbcb3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 390a78efc54c4fe0a3b8da1a8bd18d8f in term 1.
I20260807 04:16:47.214694 16239 leader_election.cc:302] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12c3099a4725491285ff68d2166fbcb3, 390a78efc54c4fe0a3b8da1a8bd18d8f; no voters:
I20260807 04:16:47.214710 16609 raft_consensus.cc:2454] T 5bfa18da6be14846a4db2cc994118031 P b57b231ba91841bb8efe01cc7214f3c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 390a78efc54c4fe0a3b8da1a8bd18d8f in term 1.
I20260807 04:16:47.215037 16696 raft_consensus.cc:2781] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:16:47.215437 16696 raft_consensus.cc:686] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 1 LEADER]: Becoming Leader. State: Replica: 390a78efc54c4fe0a3b8da1a8bd18d8f, State: Running, Role: LEADER
I20260807 04:16:47.215751 16696 consensus_queue.cc:237] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } }
I20260807 04:16:47.218271 16143 catalog_manager.cc:5495] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f reported cstate change: term changed from 0 to 1, leader changed from <none> to 390a78efc54c4fe0a3b8da1a8bd18d8f (127.7.200.193). New cstate: current_term: 1 leader_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "390a78efc54c4fe0a3b8da1a8bd18d8f" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 } health_report { overall_health: UNKNOWN } } }
I20260807 04:16:47.284672 16802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:47.279751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34962 (local address 127.7.200.193:40247)
0807 04:16:47.280379 (+ 628us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:47.280383 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:47.280402 (+ 19us) server_negotiation.cc:407] Connection header received
0807 04:16:47.280454 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:47.280458 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:47.280514 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:47.280601 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:16:47.281031 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:47.281775 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:47.283053 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:47.283471 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:47.283568 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:47.284036 (+ 468us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:16:47.284138 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:16:47.284208 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:47.284332 (+ 124us) server_negotiation.cc:299] Negotiation successful
0807 04:16:47.284394 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":372,"threads_started":1}
I20260807 04:16:47.299162 16807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:47.293932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:35851 (local address 127.7.200.195:34029)
0807 04:16:47.294478 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:47.294487 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:47.294641 (+ 154us) server_negotiation.cc:407] Connection header received
0807 04:16:47.294812 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:47.294815 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:47.294889 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:47.294968 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:16:47.295402 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:47.296132 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:47.297618 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:47.298009 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:47.298159 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:47.298531 (+ 372us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:16:47.298632 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:16:47.298704 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:47.298818 (+ 114us) server_negotiation.cc:299] Negotiation successful
0807 04:16:47.298882 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":231,"threads_started":1}
I20260807 04:16:47.299173 16809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:47.293958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:34029 (local address 127.7.200.193:35851)
0807 04:16:47.294545 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:47.294561 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:47.294688 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:47.294999 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:47.295002 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:47.295011 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 04:16:47.295284 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:47.295291 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:47.296251 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:47.296260 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:47.297491 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:47.297503 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:47.298189 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:47.298193 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:47.298313 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:47.298367 (+ 54us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 04:16:47.298716 (+ 349us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 04:16:47.298724 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 04:16:47.298785 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 04:16:47.298883 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":334,"threads_started":1}
I20260807 04:16:47.307770 16461 raft_consensus.cc:1261] T 5bfa18da6be14846a4db2cc994118031 P 12c3099a4725491285ff68d2166fbcb3 [term 1 FOLLOWER]: Refusing update from remote peer 390a78efc54c4fe0a3b8da1a8bd18d8f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:16:47.307829 16609 raft_consensus.cc:1261] T 5bfa18da6be14846a4db2cc994118031 P b57b231ba91841bb8efe01cc7214f3c2 [term 1 FOLLOWER]: Refusing update from remote peer 390a78efc54c4fe0a3b8da1a8bd18d8f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:16:47.308357 16696 consensus_queue.cc:1035] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "12c3099a4725491285ff68d2166fbcb3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 37837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:16:47.308642 16797 consensus_queue.cc:1035] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b57b231ba91841bb8efe01cc7214f3c2" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 34029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:16:47.355106 16802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:47.335316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:43689 (local address 127.7.200.193:40247)
0807 04:16:47.335558 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:47.335567 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:47.348920 (+ 13353us) server_negotiation.cc:407] Connection header received
0807 04:16:47.349069 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:47.349077 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:47.349174 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:47.349289 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:16:47.349881 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:47.350828 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:47.353028 (+ 2200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:47.353704 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:47.353842 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:47.354324 (+ 482us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:16:47.354469 (+ 145us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:16:47.354561 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:47.354731 (+ 170us) server_negotiation.cc:299] Negotiation successful
0807 04:16:47.354818 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260807 04:16:47.355360 16814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:47.335242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:40247 (local address 127.7.200.195:43689)
0807 04:16:47.348768 (+ 13526us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:47.348790 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:47.348943 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:47.349308 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:47.349313 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:47.349326 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 04:16:47.349673 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:47.349685 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:47.350972 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:47.350979 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:47.352839 (+ 1860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:47.352855 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:47.353882 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:47.353889 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:47.354040 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:47.354124 (+ 84us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 04:16:47.354589 (+ 465us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 04:16:47.354602 (+ 13us) client_negotiation.cc:769] Sending connection context
0807 04:16:47.354694 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 04:16:47.354849 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13323,"thread_start_us":13172,"threads_started":1}
I20260807 04:16:47.394761 16141 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37254:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:16:47.394968 16141 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37254:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:16:47.397883 16141 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e98ddfcebd144582a387c1d6fc1efe93: Sending DeleteTablet for 3 replicas of tablet 5bfa18da6be14846a4db2cc994118031
I20260807 04:16:47.398698 16289 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bfa18da6be14846a4db2cc994118031 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:16:47 UTC) from {username='oryx', principal='oryx/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:34936
I20260807 04:16:47.398857 16439 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bfa18da6be14846a4db2cc994118031 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:16:47 UTC) from {username='oryx', principal='oryx/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:55648
I20260807 04:16:47.399032 16768 tablet_replica.cc:330] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f: stopping tablet replica
I20260807 04:16:47.399185 16770 tablet_replica.cc:330] T 5bfa18da6be14846a4db2cc994118031 P 12c3099a4725491285ff68d2166fbcb3: stopping tablet replica
I20260807 04:16:47.399195 16586 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bfa18da6be14846a4db2cc994118031 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:16:47 UTC) from {username='oryx', principal='oryx/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:44202
I20260807 04:16:47.399217 16768 raft_consensus.cc:2229] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:16:47.399374 16770 raft_consensus.cc:2229] T 5bfa18da6be14846a4db2cc994118031 P 12c3099a4725491285ff68d2166fbcb3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:16:47.399583 16768 raft_consensus.cc:2258] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:16:47.399616 16770 raft_consensus.cc:2258] T 5bfa18da6be14846a4db2cc994118031 P 12c3099a4725491285ff68d2166fbcb3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:16:47.400133 16816 tablet_replica.cc:330] T 5bfa18da6be14846a4db2cc994118031 P b57b231ba91841bb8efe01cc7214f3c2: stopping tablet replica
I20260807 04:16:47.400384 16816 raft_consensus.cc:2229] T 5bfa18da6be14846a4db2cc994118031 P b57b231ba91841bb8efe01cc7214f3c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:16:47.400638 16816 raft_consensus.cc:2258] T 5bfa18da6be14846a4db2cc994118031 P b57b231ba91841bb8efe01cc7214f3c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:16:47.400830 16768 ts_tablet_manager.cc:1905] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:16:47.400878 16770 ts_tablet_manager.cc:1905] T 5bfa18da6be14846a4db2cc994118031 P 12c3099a4725491285ff68d2166fbcb3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:16:47.400673 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 16217
I20260807 04:16:47.403358 16816 ts_tablet_manager.cc:1905] T 5bfa18da6be14846a4db2cc994118031 P b57b231ba91841bb8efe01cc7214f3c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:16:47.407581 16768 ts_tablet_manager.cc:1918] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 04:16:47.407765 16768 log.cc:1196] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-0/wal/wals/5bfa18da6be14846a4db2cc994118031
I20260807 04:16:47.408236 16768 ts_tablet_manager.cc:1939] T 5bfa18da6be14846a4db2cc994118031 P 390a78efc54c4fe0a3b8da1a8bd18d8f: Deleting consensus metadata
I20260807 04:16:47.409459 16128 catalog_manager.cc:4841] TS 390a78efc54c4fe0a3b8da1a8bd18d8f (127.7.200.193:40247): tablet 5bfa18da6be14846a4db2cc994118031 (table test-table [id=154972fa9c1c46df8fca682935a05098]) successfully deleted
I20260807 04:16:47.410094 16816 ts_tablet_manager.cc:1918] T 5bfa18da6be14846a4db2cc994118031 P b57b231ba91841bb8efe01cc7214f3c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 04:16:47.410151 16770 ts_tablet_manager.cc:1918] T 5bfa18da6be14846a4db2cc994118031 P 12c3099a4725491285ff68d2166fbcb3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 04:16:47.410239 16816 log.cc:1196] T 5bfa18da6be14846a4db2cc994118031 P b57b231ba91841bb8efe01cc7214f3c2: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-2/wal/wals/5bfa18da6be14846a4db2cc994118031
I20260807 04:16:47.410328 16770 log.cc:1196] T 5bfa18da6be14846a4db2cc994118031 P 12c3099a4725491285ff68d2166fbcb3: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786076137270840-7971-0/minicluster-data/ts-1/wal/wals/5bfa18da6be14846a4db2cc994118031
I20260807 04:16:47.410750 16816 ts_tablet_manager.cc:1939] T 5bfa18da6be14846a4db2cc994118031 P b57b231ba91841bb8efe01cc7214f3c2: Deleting consensus metadata
I20260807 04:16:47.410845 16770 ts_tablet_manager.cc:1939] T 5bfa18da6be14846a4db2cc994118031 P 12c3099a4725491285ff68d2166fbcb3: Deleting consensus metadata
I20260807 04:16:47.411830 16129 catalog_manager.cc:4841] TS 12c3099a4725491285ff68d2166fbcb3 (127.7.200.194:37837): tablet 5bfa18da6be14846a4db2cc994118031 (table test-table [id=154972fa9c1c46df8fca682935a05098]) successfully deleted
I20260807 04:16:47.412002 16126 catalog_manager.cc:4841] TS b57b231ba91841bb8efe01cc7214f3c2 (127.7.200.195:34029): tablet 5bfa18da6be14846a4db2cc994118031 (table test-table [id=154972fa9c1c46df8fca682935a05098]) successfully deleted
Aug 07 04:16:47 dist-test-slave-qg60 krb5kdc[16095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076206, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.200.193@KRBTEST.COM
I20260807 04:16:47.424957 16802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:47.402507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34970 (local address 127.7.200.193:40247)
0807 04:16:47.402679 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:47.402685 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:47.410359 (+ 7674us) server_negotiation.cc:407] Connection header received
0807 04:16:47.410585 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:47.410593 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:47.410704 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:47.410825 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:47.412417 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:47.413206 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:47.414385 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:47.414817 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:47.414911 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:47.418883 (+ 3972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:47.418900 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:47.418916 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:47.418955 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:47.422101 (+ 3146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:47.422824 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:47.422831 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:47.422834 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:47.422957 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:47.423346 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:47.423352 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:47.423355 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:47.423744 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:47.424060 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:47.424349 (+ 289us) server_negotiation.cc:299] Negotiation successful
0807 04:16:47.424572 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 04:16:47.425683 16359 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:47.558913 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 16217
I20260807 04:16:47.590062 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 16368
Aug 07 04:16:47 dist-test-slave-qg60 krb5kdc[16095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076206, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.200.194@KRBTEST.COM
I20260807 04:16:47.606238 16819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:47.590884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55678 (local address 127.7.200.194:37837)
0807 04:16:47.591328 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:47.591333 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:47.591351 (+ 18us) server_negotiation.cc:407] Connection header received
0807 04:16:47.591414 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:47.591418 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:47.591478 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:47.591573 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:47.592991 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:47.593766 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:47.595282 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:47.595688 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:47.595790 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:47.600612 (+ 4822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:47.600627 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:47.600643 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:47.600681 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:47.603501 (+ 2820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:47.604181 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:47.604188 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:47.604190 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:47.604312 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:47.604639 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:47.604642 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:47.604644 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:47.605095 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:47.605325 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:47.605602 (+ 277us) server_negotiation.cc:299] Negotiation successful
0807 04:16:47.605781 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":236,"threads_started":1}
I20260807 04:16:47.607151 16507 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:47.736199 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 16368
I20260807 04:16:47.763361 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 16516
Aug 07 04:16:47 dist-test-slave-qg60 krb5kdc[16095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076206, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.7.200.195@KRBTEST.COM
I20260807 04:16:47.779289 16807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:47.764189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44230 (local address 127.7.200.195:34029)
0807 04:16:47.764377 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:47.764385 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:47.764472 (+ 87us) server_negotiation.cc:407] Connection header received
0807 04:16:47.764708 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:47.764713 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:47.764817 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:47.764924 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:47.766243 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:47.767001 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:47.768236 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:47.768656 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:47.768832 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:47.773543 (+ 4711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:47.773560 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:47.773578 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:47.773612 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:47.776688 (+ 3076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:47.777370 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:47.777377 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:47.777379 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:47.777509 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:47.777832 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:47.777836 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:47.777838 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:47.778181 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:47.778424 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:47.778668 (+ 244us) server_negotiation.cc:299] Negotiation successful
0807 04:16:47.778929 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 04:16:47.779966 16658 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:47.910825 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 16516
I20260807 04:16:47.936125 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 16110
I20260807 04:16:47.937377 16184 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:48.058236 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 16110
2026-08-07T04:16:48Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (7407 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:16:48 dist-test-slave-qg60 krb5kdc[16829](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:16:48 dist-test-slave-qg60 krb5kdc[16829](info): set up 2 sockets
Aug 07 04:16:48 dist-test-slave-qg60 krb5kdc[16829](info): commencing operation
krb5kdc: starting...
W20260807 04:16:49.236490 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.005s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:16:49 dist-test-slave-qg60 krb5kdc[16829](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076209, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:16:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:16:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
I20260807 04:16:49.525188 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:41083
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:41279
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:41083
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:49.878849 16843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:49.879153 16843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:49.879242 16843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:49.886322 16843 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:16:49.886426 16843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:49.886473 16843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:49.886533 16843 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:16:49.886582 16843 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:16:49.896553 16843 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:41279
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:41083
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:41083
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:49.898242 16843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:49.899978 16843 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:49.911798 16848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:49.912047 16849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:49.912954 16851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:49.914249 16843 server_base.cc:1034] running on GCE node
I20260807 04:16:49.915069 16843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:49.916582 16843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:49.917860 16843 hybrid_clock.cc:648] HybridClock initialized: now 1786076209917800 us; error 39 us; skew 500 ppm
I20260807 04:16:49.918275 16843 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-07T04:16:50Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1937 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:16:50 dist-test-slave-qg60 krb5kdc[16857](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:16:50 dist-test-slave-qg60 krb5kdc[16857](info): set up 2 sockets
Aug 07 04:16:50 dist-test-slave-qg60 krb5kdc[16857](info): commencing operation
krb5kdc: starting...
W20260807 04:16:51.194109 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.149s user 0.001s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:16:51 dist-test-slave-qg60 krb5kdc[16857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076211, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:16:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:16:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
I20260807 04:16:51.476869 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:40131
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:41415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:40131
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:51.827813 16870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:51.828142 16870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:51.828236 16870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:51.836606 16870 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:16:51.836778 16870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:51.836856 16870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:51.836934 16870 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:16:51.836982 16870 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:16:51.847316 16870 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:41415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:40131
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:40131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:51.848665 16870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:51.850077 16870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:51.862154 16875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:51.862215 16876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:51.862509 16878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:51.863574 16870 server_base.cc:1034] running on GCE node
I20260807 04:16:51.864462 16870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:51.865976 16870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:51.867177 16870 hybrid_clock.cc:648] HybridClock initialized: now 1786076211867138 us; error 30 us; skew 500 ppm
I20260807 04:16:51.867475 16870 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:51 dist-test-slave-qg60 krb5kdc[16857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076211, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:51.870568 16870 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:16:51.872102 16870 webserver.cc:460] Webserver started at http://127.7.200.254:45461/ using document root <none> and password file <none>
I20260807 04:16:51.872798 16870 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:51.872907 16870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:51.873209 16870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:51.876238 16870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "4f88c35c606c40abad5716a6a95e8ad6"
format_stamp: "Formatted at 2026-08-07 04:16:51 on dist-test-slave-qg60"
server_key: "ef6b6853214c4d521b1606f13cc8109c"
server_key_iv: "5272d91fd4f933d89e4af81741c8fcb8"
server_key_version: "encryptionkey@0"
I20260807 04:16:51.877041 16870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "4f88c35c606c40abad5716a6a95e8ad6"
format_stamp: "Formatted at 2026-08-07 04:16:51 on dist-test-slave-qg60"
server_key: "ef6b6853214c4d521b1606f13cc8109c"
server_key_iv: "5272d91fd4f933d89e4af81741c8fcb8"
server_key_version: "encryptionkey@0"
I20260807 04:16:51.882121 16870 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260807 04:16:51.885612 16885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:51.887065 16870 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260807 04:16:51.887221 16870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "4f88c35c606c40abad5716a6a95e8ad6"
format_stamp: "Formatted at 2026-08-07 04:16:51 on dist-test-slave-qg60"
server_key: "ef6b6853214c4d521b1606f13cc8109c"
server_key_iv: "5272d91fd4f933d89e4af81741c8fcb8"
server_key_version: "encryptionkey@0"
I20260807 04:16:51.887408 16870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:51.913648 16870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:51.918061 16870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:51.918303 16870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:51.937628 16870 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:40131
I20260807 04:16:51.937673 16939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:40131 every 8 connection(s)
I20260807 04:16:51.939049 16870 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:16:51.942761 16940 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:16:51.947042 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 16870
I20260807 04:16:51.947265 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:16:51.947964 7971 external_mini_cluster.cc:1428] Setting key c54142790b666778313c2cdb16e23ab6
I20260807 04:16:51.953814 16940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6: Bootstrap starting.
I20260807 04:16:51.957595 16940 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6: Neither blocks nor log segments found. Creating new log.
I20260807 04:16:51.958859 16940 log.cc:824] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6: Log is configured to *not* fsync() on all Append() calls
I20260807 04:16:51.962548 16940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6: No bootstrap required, opened a new log
Aug 07 04:16:51 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076211, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:16:51.970577 16940 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f88c35c606c40abad5716a6a95e8ad6" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40131 } }
I20260807 04:16:51.970963 16940 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:16:51.971074 16940 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f88c35c606c40abad5716a6a95e8ad6, State: Initialized, Role: FOLLOWER
I20260807 04:16:51.971782 16940 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f88c35c606c40abad5716a6a95e8ad6" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40131 } }
I20260807 04:16:51.972059 16940 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:16:51.972219 16940 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:16:51.972433 16940 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:16:51.973057 16943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:51.950265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49384 (local address 127.7.200.254:40131)
0807 04:16:51.951159 (+ 894us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:51.951170 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:51.951218 (+ 48us) server_negotiation.cc:407] Connection header received
0807 04:16:51.953067 (+ 1849us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:51.953090 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:51.953470 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:51.953774 (+ 304us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:51.955748 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:51.957221 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:51.959096 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:51.960159 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:51.960359 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:51.965326 (+ 4967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:51.965334 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:51.965352 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:51.965389 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:51.968607 (+ 3218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:51.969398 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:51.969410 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:51.969416 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:51.969591 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:51.970006 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:51.970011 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:51.970014 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:51.970559 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:51.970857 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:51.971355 (+ 498us) server_negotiation.cc:299] Negotiation successful
0807 04:16:51.971774 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":655,"thread_start_us":428,"threads_started":1}
I20260807 04:16:51.975409 16940 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f88c35c606c40abad5716a6a95e8ad6" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40131 } }
I20260807 04:16:51.976037 16940 leader_election.cc:302] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4f88c35c606c40abad5716a6a95e8ad6; no voters:
I20260807 04:16:51.976679 16940 leader_election.cc:288] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:16:51.976884 16947 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:16:51.977629 16947 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [term 1 LEADER]: Becoming Leader. State: Replica: 4f88c35c606c40abad5716a6a95e8ad6, State: Running, Role: LEADER
I20260807 04:16:51.978199 16947 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f88c35c606c40abad5716a6a95e8ad6" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40131 } }
I20260807 04:16:51.978816 16940 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:16:51.981033 16948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4f88c35c606c40abad5716a6a95e8ad6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f88c35c606c40abad5716a6a95e8ad6" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40131 } } }
I20260807 04:16:51.981496 16948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:51.983697 16949 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f88c35c606c40abad5716a6a95e8ad6. Latest consensus state: current_term: 1 leader_uuid: "4f88c35c606c40abad5716a6a95e8ad6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f88c35c606c40abad5716a6a95e8ad6" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40131 } } }
I20260807 04:16:51.984192 16949 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:51.985662 16955 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:16:51.991170 16955 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:16:51.999694 16955 catalog_manager.cc:1347] Generated new cluster ID: 1cc451dfcbb34b3ba10212288cac9607
I20260807 04:16:51.999812 16955 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:16:52.025369 16955 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:16:52.026737 16955 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:16:52.043738 16955 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6: Generated new TSK 0
I20260807 04:16:52.044778 16955 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.200.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
I20260807 04:16:52.124301 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:0
--local_ip_for_outbound_sockets=127.7.200.193
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:40131
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:41415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:52.468843 16968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:52.469156 16968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:52.469326 16968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:52.476989 16968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:52.477108 16968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:52.477315 16968 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:16:52.487556 16968 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:41415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:40131
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:52.488905 16968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:52.490248 16968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:52.504091 16974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:52.504189 16977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:52.504165 16973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:52.510813 16968 server_base.cc:1034] running on GCE node
I20260807 04:16:52.511631 16968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:52.512866 16968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:52.514138 16968 hybrid_clock.cc:648] HybridClock initialized: now 1786076212514092 us; error 39 us; skew 500 ppm
I20260807 04:16:52.514555 16968 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:52 dist-test-slave-qg60 krb5kdc[16857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076212, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:52.518128 16968 init.cc:377] Logged in from keytab as kudu/127.7.200.193@KRBTEST.COM (short username kudu)
I20260807 04:16:52.519810 16968 webserver.cc:460] Webserver started at http://127.7.200.193:44665/ using document root <none> and password file <none>
I20260807 04:16:52.520587 16968 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:52.520795 16968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:52.521148 16968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:52.524329 16968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/data/instance:
uuid: "9a36350b77b9449d98dcb89b2ed8b133"
format_stamp: "Formatted at 2026-08-07 04:16:52 on dist-test-slave-qg60"
server_key: "ba29e0395151219d32e8643efa50b6c8"
server_key_iv: "367ac0e217d04ff813c043b724f4f85b"
server_key_version: "encryptionkey@0"
I20260807 04:16:52.525193 16968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance:
uuid: "9a36350b77b9449d98dcb89b2ed8b133"
format_stamp: "Formatted at 2026-08-07 04:16:52 on dist-test-slave-qg60"
server_key: "ba29e0395151219d32e8643efa50b6c8"
server_key_iv: "367ac0e217d04ff813c043b724f4f85b"
server_key_version: "encryptionkey@0"
I20260807 04:16:52.530691 16968 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 04:16:52.534420 16984 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:52.535802 16968 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 04:16:52.536036 16968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "9a36350b77b9449d98dcb89b2ed8b133"
format_stamp: "Formatted at 2026-08-07 04:16:52 on dist-test-slave-qg60"
server_key: "ba29e0395151219d32e8643efa50b6c8"
server_key_iv: "367ac0e217d04ff813c043b724f4f85b"
server_key_version: "encryptionkey@0"
I20260807 04:16:52.536269 16968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:52.562803 16968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:52.568182 16968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:52.568609 16968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:52.570096 16968 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:16:52.572137 16968 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:52.572239 16968 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:52.572374 16968 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:52.572438 16968 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:52.610546 16968 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:37395
I20260807 04:16:52.610661 17106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:37395 every 8 connection(s)
I20260807 04:16:52.611850 16968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:16:52.617897 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 16968
I20260807 04:16:52.618132 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance
I20260807 04:16:52.618903 7971 external_mini_cluster.cc:1428] Setting key 9003ca137b7b0bb718c24e14d07a9ce2
Aug 07 04:16:52 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076212, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:16:52.634477 17109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:52.614548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:42559 (local address 127.7.200.254:40131)
0807 04:16:52.615090 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:52.615098 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:52.616078 (+ 980us) server_negotiation.cc:407] Connection header received
0807 04:16:52.618059 (+ 1981us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:52.618066 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:52.618168 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:52.618297 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:52.620234 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:52.621197 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:52.622995 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:52.623461 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:52.623623 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:52.627890 (+ 4267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:52.627896 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:52.627900 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:52.627939 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:52.630913 (+ 2974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:52.631744 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:52.631751 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:52.631755 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:52.631893 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:52.632425 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:52.632430 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:52.632436 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:52.632792 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:52.632962 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:52.633783 (+ 821us) server_negotiation.cc:299] Negotiation successful
0807 04:16:52.634045 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":230,"threads_started":1}
I20260807 04:16:52.635543 17110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:52.615160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.193:42559)
0807 04:16:52.615906 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:52.615949 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:52.617761 (+ 1812us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:52.618582 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:52.618591 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:52.619370 (+ 779us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:52.620028 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:52.620049 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:52.621391 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:52.621395 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:52.622805 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:52.622829 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:52.623742 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:52.623753 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:52.624042 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:52.624897 (+ 855us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:52.624935 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:52.627621 (+ 2686us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:52.631082 (+ 3461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:52.631092 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:52.631111 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:52.631605 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:52.632019 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:52.632024 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:52.632028 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:52.632285 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:52.632952 (+ 667us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:52.632961 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:52.633359 (+ 398us) client_negotiation.cc:769] Sending connection context
0807 04:16:52.633666 (+ 307us) client_negotiation.cc:240] Negotiation successful
0807 04:16:52.634272 (+ 606us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":289,"threads_started":1}
I20260807 04:16:52.637495 17107 heartbeater.cc:347] Connected to a master server at 127.7.200.254:40131
I20260807 04:16:52.637832 17107 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:52.638602 17107 heartbeater.cc:511] Master 127.7.200.254:40131 requested a full tablet report, sending...
I20260807 04:16:52.641206 16902 ts_manager.cc:194] Registered new tserver with Master: 9a36350b77b9449d98dcb89b2ed8b133 (127.7.200.193:37395)
I20260807 04:16:52.643524 16902 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.193@KRBTEST.COM'} at 127.7.200.193:42559
WARNING: no policy specified for kudu/127.7.200.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
I20260807 04:16:52.683933 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:0
--local_ip_for_outbound_sockets=127.7.200.194
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:40131
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:41415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:53.038751 17113 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:53.039063 17113 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:53.039220 17113 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:53.046657 17113 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:53.046768 17113 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:53.046980 17113 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:16:53.057165 17113 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:41415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:40131
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:53.058552 17113 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:53.059944 17113 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:53.074110 17119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:53.074051 17120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:53.074105 17122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:53.075407 17113 server_base.cc:1034] running on GCE node
I20260807 04:16:53.076028 17113 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:53.077142 17113 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:53.078439 17113 hybrid_clock.cc:648] HybridClock initialized: now 1786076213078356 us; error 72 us; skew 500 ppm
I20260807 04:16:53.078856 17113 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:53 dist-test-slave-qg60 krb5kdc[16857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076213, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:53.082455 17113 init.cc:377] Logged in from keytab as kudu/127.7.200.194@KRBTEST.COM (short username kudu)
I20260807 04:16:53.083959 17113 webserver.cc:460] Webserver started at http://127.7.200.194:38229/ using document root <none> and password file <none>
I20260807 04:16:53.084672 17113 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:53.084859 17113 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:53.085194 17113 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:53.088284 17113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/data/instance:
uuid: "4bb434442bb14a4bae0d369a8599b866"
format_stamp: "Formatted at 2026-08-07 04:16:53 on dist-test-slave-qg60"
server_key: "610553a4ecf9aabf418e45c1fccb1d39"
server_key_iv: "7b38318ba37174d9795b89fb59ab1fc9"
server_key_version: "encryptionkey@0"
I20260807 04:16:53.089154 17113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance:
uuid: "4bb434442bb14a4bae0d369a8599b866"
format_stamp: "Formatted at 2026-08-07 04:16:53 on dist-test-slave-qg60"
server_key: "610553a4ecf9aabf418e45c1fccb1d39"
server_key_iv: "7b38318ba37174d9795b89fb59ab1fc9"
server_key_version: "encryptionkey@0"
I20260807 04:16:53.094817 17113 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 04:16:53.098455 17130 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:53.099946 17113 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 04:16:53.100131 17113 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "4bb434442bb14a4bae0d369a8599b866"
format_stamp: "Formatted at 2026-08-07 04:16:53 on dist-test-slave-qg60"
server_key: "610553a4ecf9aabf418e45c1fccb1d39"
server_key_iv: "7b38318ba37174d9795b89fb59ab1fc9"
server_key_version: "encryptionkey@0"
I20260807 04:16:53.100344 17113 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:53.125936 17113 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:53.130491 17113 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:53.130805 17113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:53.131860 17113 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:16:53.133360 17113 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:53.133437 17113 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:53.133615 17113 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:53.133668 17113 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:53.168378 17113 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:41459
I20260807 04:16:53.168464 17249 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:41459 every 8 connection(s)
I20260807 04:16:53.169787 17113 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:16:53.175055 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 17113
I20260807 04:16:53.175252 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance
I20260807 04:16:53.175817 7971 external_mini_cluster.cc:1428] Setting key 4b2f798ec6d380956ba46febd6e13713
Aug 07 04:16:53 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076213, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:16:53.191361 17253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:53.172507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:45831 (local address 127.7.200.254:40131)
0807 04:16:53.173021 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:53.173029 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:53.173990 (+ 961us) server_negotiation.cc:407] Connection header received
0807 04:16:53.176621 (+ 2631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:53.176625 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:53.176695 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:53.176863 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:53.178661 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:53.179451 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:53.181174 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:53.181598 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:53.181728 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:53.185472 (+ 3744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:53.185476 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:53.185480 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:53.185510 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:53.188229 (+ 2719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:53.189034 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:53.189038 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:53.189041 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:53.189180 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:53.189627 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:53.189630 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:53.189632 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:53.189884 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:53.190040 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:53.190744 (+ 704us) server_negotiation.cc:299] Negotiation successful
0807 04:16:53.190967 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":264,"threads_started":1}
I20260807 04:16:53.192449 17254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:53.173128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.194:45831)
0807 04:16:53.173835 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:53.173872 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:53.176195 (+ 2323us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:53.177130 (+ 935us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:53.177142 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:53.177871 (+ 729us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:53.178483 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:53.178515 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:53.179606 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:53.179612 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:53.180991 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:53.181003 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:53.181828 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:53.181835 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:53.182058 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:53.182744 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:53.182766 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:53.185245 (+ 2479us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:53.188363 (+ 3118us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:53.188372 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:53.188388 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:53.188905 (+ 517us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:53.189301 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:53.189306 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:53.189309 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:53.189495 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:53.190020 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:53.190028 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:53.190364 (+ 336us) client_negotiation.cc:769] Sending connection context
0807 04:16:53.190634 (+ 270us) client_negotiation.cc:240] Negotiation successful
0807 04:16:53.191238 (+ 604us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":273,"threads_started":1}
I20260807 04:16:53.193871 17250 heartbeater.cc:347] Connected to a master server at 127.7.200.254:40131
I20260807 04:16:53.194206 17250 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:53.194911 17250 heartbeater.cc:511] Master 127.7.200.254:40131 requested a full tablet report, sending...
I20260807 04:16:53.196349 16902 ts_manager.cc:194] Registered new tserver with Master: 4bb434442bb14a4bae0d369a8599b866 (127.7.200.194:41459)
I20260807 04:16:53.197228 16902 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.194@KRBTEST.COM'} at 127.7.200.194:45831
WARNING: no policy specified for kudu/127.7.200.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
I20260807 04:16:53.252290 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:0
--local_ip_for_outbound_sockets=127.7.200.195
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:40131
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:41415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:53.596470 17257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:53.596820 17257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:53.597029 17257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:53.604543 17257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:53.604651 17257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:53.604836 17257 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:16:53.614698 17257 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:41415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:40131
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:53.615906 17257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:53.617246 17257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:53.630913 17264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:53.630952 17263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:53.630831 17266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:53.631853 17257 server_base.cc:1034] running on GCE node
I20260807 04:16:53.632452 17257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:53.633505 17257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:53.634755 17257 hybrid_clock.cc:648] HybridClock initialized: now 1786076213634713 us; error 51 us; skew 500 ppm
I20260807 04:16:53.635099 17257 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:53 dist-test-slave-qg60 krb5kdc[16857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076213, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:53.638329 17257 init.cc:377] Logged in from keytab as kudu/127.7.200.195@KRBTEST.COM (short username kudu)
I20260807 04:16:53.639935 17257 webserver.cc:460] Webserver started at http://127.7.200.195:42235/ using document root <none> and password file <none>
I20260807 04:16:53.640626 17257 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:53.640792 17257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:53.641178 17257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:16:53.644344 17257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/data/instance:
uuid: "0a2d012a95c7452180c2992f449ae219"
format_stamp: "Formatted at 2026-08-07 04:16:53 on dist-test-slave-qg60"
server_key: "4dad9bba28033095d452f4bb5c2285f7"
server_key_iv: "09bdd775428a345245c9b43b2d65d154"
server_key_version: "encryptionkey@0"
I20260807 04:16:53.645294 17257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance:
uuid: "0a2d012a95c7452180c2992f449ae219"
format_stamp: "Formatted at 2026-08-07 04:16:53 on dist-test-slave-qg60"
server_key: "4dad9bba28033095d452f4bb5c2285f7"
server_key_iv: "09bdd775428a345245c9b43b2d65d154"
server_key_version: "encryptionkey@0"
I20260807 04:16:53.646767 17107 heartbeater.cc:503] Master 127.7.200.254:40131 was elected leader, sending a full tablet report...
I20260807 04:16:53.651180 17257 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 04:16:53.654934 17273 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:53.656404 17257 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 04:16:53.656608 17257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "0a2d012a95c7452180c2992f449ae219"
format_stamp: "Formatted at 2026-08-07 04:16:53 on dist-test-slave-qg60"
server_key: "4dad9bba28033095d452f4bb5c2285f7"
server_key_iv: "09bdd775428a345245c9b43b2d65d154"
server_key_version: "encryptionkey@0"
I20260807 04:16:53.656893 17257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:53.682314 17257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:53.687161 17257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:53.687427 17257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:53.688401 17257 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:16:53.689906 17257 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:53.689982 17257 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:53.690124 17257 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:53.690219 17257 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:53.726763 17257 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:42635
I20260807 04:16:53.726852 17389 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:42635 every 8 connection(s)
I20260807 04:16:53.728065 17257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:16:53.731398 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 17257
I20260807 04:16:53.731580 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance
I20260807 04:16:53.732093 7971 external_mini_cluster.cc:1428] Setting key 6787b19002291abffe78de917608afdd
Aug 07 04:16:53 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076213, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:16:53.750231 17392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:53.730742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:48203 (local address 127.7.200.254:40131)
0807 04:16:53.731279 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:53.731286 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:53.732561 (+ 1275us) server_negotiation.cc:407] Connection header received
0807 04:16:53.734648 (+ 2087us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:53.734652 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:53.734721 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:53.734819 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:53.736372 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:53.737380 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:53.738915 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:53.739348 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:53.739477 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:53.743526 (+ 4049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:53.743531 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:53.743535 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:53.743596 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:53.746476 (+ 2880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:53.747600 (+ 1124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:53.747606 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:53.747611 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:53.747775 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:53.748450 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:53.748455 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:53.748458 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:53.748839 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:53.748967 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:53.749778 (+ 811us) server_negotiation.cc:299] Negotiation successful
0807 04:16:53.749953 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":266,"threads_started":1}
I20260807 04:16:53.751349 17393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:53.731369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.195:48203)
0807 04:16:53.732375 (+ 1006us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:53.732431 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:53.734303 (+ 1872us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:53.735099 (+ 796us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:53.735112 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:53.735651 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:53.736210 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:53.736227 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:53.737535 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:53.737539 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:53.738768 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:53.738781 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:53.739588 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:53.739593 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:53.739873 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:53.740691 (+ 818us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:53.740714 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:53.743287 (+ 2573us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:16:53.746681 (+ 3394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:53.746692 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:53.746712 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:53.747450 (+ 738us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:53.747902 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:16:53.747907 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:16:53.747911 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:16:53.748318 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:16:53.749030 (+ 712us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:16:53.749037 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:16:53.749404 (+ 367us) client_negotiation.cc:769] Sending connection context
0807 04:16:53.749683 (+ 279us) client_negotiation.cc:240] Negotiation successful
0807 04:16:53.750135 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":679,"thread_start_us":435,"threads_started":1}
I20260807 04:16:53.752825 17390 heartbeater.cc:347] Connected to a master server at 127.7.200.254:40131
I20260807 04:16:53.753178 17390 heartbeater.cc:464] Registering TS with master...
I20260807 04:16:53.754029 17390 heartbeater.cc:511] Master 127.7.200.254:40131 requested a full tablet report, sending...
I20260807 04:16:53.755599 16902 ts_manager.cc:194] Registered new tserver with Master: 0a2d012a95c7452180c2992f449ae219 (127.7.200.195:42635)
I20260807 04:16:53.756533 16902 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.195@KRBTEST.COM'} at 127.7.200.195:48203
I20260807 04:16:53.760852 7971 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.7.200.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.200.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.200.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.193.keytab.
Entry for principal oryx/127.7.200.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.193.keytab.
WARNING: no policy specified for oryx/127.7.200.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.200.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.200.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.194.keytab.
Entry for principal oryx/127.7.200.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.194.keytab.
WARNING: no policy specified for oryx/127.7.200.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.7.200.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.7.200.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.195.keytab.
Entry for principal oryx/127.7.200.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.195.keytab.
I20260807 04:16:53.940779 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 16968
Aug 07 04:16:53 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076211, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.193@KRBTEST.COM
I20260807 04:16:53.961220 17402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:53.942230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36692 (local address 127.7.200.193:37395)
0807 04:16:53.945292 (+ 3062us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:53.945302 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:53.945334 (+ 32us) server_negotiation.cc:407] Connection header received
0807 04:16:53.945408 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:53.945418 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:53.945755 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:53.945907 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:53.947543 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:53.948582 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:53.950001 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:53.950569 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:53.950677 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:53.955161 (+ 4484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:53.955176 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:53.955190 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:53.955228 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:53.958140 (+ 2912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:53.958859 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:53.958867 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:53.958869 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:53.959005 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:53.959414 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:53.959423 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:53.959425 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:53.959840 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:53.960163 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:53.960476 (+ 313us) server_negotiation.cc:299] Negotiation successful
0807 04:16:53.960789 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2853,"thread_start_us":2655,"threads_started":1}
I20260807 04:16:53.962649 17102 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:54.049485 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 16968
I20260807 04:16:54.071424 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 17113
Aug 07 04:16:54 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076211, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.194@KRBTEST.COM
I20260807 04:16:54.089140 17404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:54.072545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43198 (local address 127.7.200.194:41459)
0807 04:16:54.073112 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:54.073119 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:54.073145 (+ 26us) server_negotiation.cc:407] Connection header received
0807 04:16:54.073206 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:54.073212 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:54.073420 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:54.073593 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:54.074926 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:54.075948 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:54.077458 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:54.078066 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:54.078186 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:54.082699 (+ 4513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:54.082712 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:54.082727 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:54.082764 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:54.086131 (+ 3367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:54.086972 (+ 841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:54.086979 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:54.086982 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:54.087121 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:54.087451 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:54.087454 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:54.087456 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:54.087833 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:54.088149 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:54.088419 (+ 270us) server_negotiation.cc:299] Negotiation successful
0807 04:16:54.088630 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":289,"threads_started":1}
I20260807 04:16:54.090564 17245 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:54.179827 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 17113
I20260807 04:16:54.207360 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 17257
Aug 07 04:16:54 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076211, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.195@KRBTEST.COM
I20260807 04:16:54.226701 17406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:54.208581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49178 (local address 127.7.200.195:42635)
0807 04:16:54.209344 (+ 763us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:54.209351 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:54.209385 (+ 34us) server_negotiation.cc:407] Connection header received
0807 04:16:54.209450 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:54.209457 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:54.209672 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:54.209862 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:54.211440 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:54.212598 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:54.214179 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:54.214804 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:54.214981 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:54.220159 (+ 5178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:54.220172 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:54.220187 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:54.220224 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:54.223726 (+ 3502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:54.224420 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:54.224428 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:54.224430 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:54.224571 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:54.224997 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:54.225003 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:54.225007 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:54.225390 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:54.225721 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:54.226060 (+ 339us) server_negotiation.cc:299] Negotiation successful
0807 04:16:54.226342 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":600,"thread_start_us":447,"threads_started":1}
I20260807 04:16:54.228109 17385 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:54.313098 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 17257
I20260807 04:16:54.332410 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 16870
I20260807 04:16:54.333870 16934 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:16:54.442059 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 16870
I20260807 04:16:54.465539 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:40131
--webserver_interface=127.7.200.254
--webserver_port=45461
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:41415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:40131
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:16:54.808094 17409 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:54.808374 17409 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:54.808465 17409 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:54.815825 17409 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:16:54.815943 17409 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:54.815990 17409 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:54.816057 17409 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:16:54.816102 17409 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:16:54.826292 17409 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:41415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:40131
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:40131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=45461
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:54.827584 17409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:54.828943 17409 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:54.841377 17417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:54.841449 17415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:54.841332 17414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:54.843062 17409 server_base.cc:1034] running on GCE node
I20260807 04:16:54.843968 17409 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:54.845616 17409 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:54.846882 17409 hybrid_clock.cc:648] HybridClock initialized: now 1786076214846829 us; error 55 us; skew 500 ppm
I20260807 04:16:54.847277 17409 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:54 dist-test-slave-qg60 krb5kdc[16857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076214, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:54.851001 17409 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:16:54.852584 17409 webserver.cc:460] Webserver started at http://127.7.200.254:45461/ using document root <none> and password file <none>
I20260807 04:16:54.853380 17409 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:54.853550 17409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:54.859279 17409 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 04:16:54.862236 17424 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:54.863699 17409 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:16:54.863898 17409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "4f88c35c606c40abad5716a6a95e8ad6"
format_stamp: "Formatted at 2026-08-07 04:16:51 on dist-test-slave-qg60"
server_key: "ef6b6853214c4d521b1606f13cc8109c"
server_key_iv: "5272d91fd4f933d89e4af81741c8fcb8"
server_key_version: "encryptionkey@0"
I20260807 04:16:54.865016 17409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:54.879773 17409 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:54.884245 17409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:54.884546 17409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:54.903677 17409 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:40131
I20260807 04:16:54.903702 17479 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:40131 every 8 connection(s)
I20260807 04:16:54.905227 17409 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:16:54.912701 17480 sys_catalog.cc:263] Verifying existing consensus state
I20260807 04:16:54.913719 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 17409
I20260807 04:16:54.914710 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:37395
--local_ip_for_outbound_sockets=127.7.200.193
--tserver_master_addrs=127.7.200.254:40131
--webserver_port=44665
--webserver_interface=127.7.200.193
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:41415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.7.200.193
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 04:16:54.916675 17480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6: Bootstrap starting.
I20260807 04:16:54.939878 17480 log.cc:824] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6: Log is configured to *not* fsync() on all Append() calls
I20260807 04:16:54.952777 17480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 04:16:54.953431 17480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6: Bootstrap complete.
I20260807 04:16:54.967450 17480 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f88c35c606c40abad5716a6a95e8ad6" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40131 } }
I20260807 04:16:54.968708 17480 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f88c35c606c40abad5716a6a95e8ad6, State: Initialized, Role: FOLLOWER
I20260807 04:16:54.969515 17480 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f88c35c606c40abad5716a6a95e8ad6" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40131 } }
I20260807 04:16:54.969810 17480 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:16:54.969930 17480 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:16:54.970115 17480 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [term 1 FOLLOWER]: Advancing to term 2
I20260807 04:16:54.975697 17480 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f88c35c606c40abad5716a6a95e8ad6" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40131 } }
I20260807 04:16:54.976332 17480 leader_election.cc:302] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4f88c35c606c40abad5716a6a95e8ad6; no voters:
I20260807 04:16:54.977056 17480 leader_election.cc:288] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 04:16:54.977236 17484 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 04:16:54.978518 17484 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [term 2 LEADER]: Becoming Leader. State: Replica: 4f88c35c606c40abad5716a6a95e8ad6, State: Running, Role: LEADER
I20260807 04:16:54.979089 17484 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f88c35c606c40abad5716a6a95e8ad6" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40131 } }
I20260807 04:16:54.979245 17480 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:16:54.981415 17486 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f88c35c606c40abad5716a6a95e8ad6. Latest consensus state: current_term: 2 leader_uuid: "4f88c35c606c40abad5716a6a95e8ad6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f88c35c606c40abad5716a6a95e8ad6" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40131 } } }
I20260807 04:16:54.981812 17486 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:54.982402 17485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4f88c35c606c40abad5716a6a95e8ad6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f88c35c606c40abad5716a6a95e8ad6" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40131 } } }
I20260807 04:16:54.982772 17485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6 [sys.catalog]: This master's current role is: LEADER
I20260807 04:16:54.989512 17491 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:16:54.995766 17491 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:16:54.997318 17491 catalog_manager.cc:1259] Loaded cluster ID: 1cc451dfcbb34b3ba10212288cac9607
I20260807 04:16:54.997478 17491 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:16:55.001734 17491 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:16:55.003571 17491 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4f88c35c606c40abad5716a6a95e8ad6: Loaded TSK: 0
I20260807 04:16:55.005478 17491 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 04:16:55.292977 17482 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:55.293289 17482 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:55.293445 17482 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:55.301033 17482 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:55.301153 17482 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:55.301322 17482 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:16:55.311707 17482 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:41415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.193.keytab
--principal=oryx/127.7.200.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:37395
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=44665
--tserver_master_addrs=127.7.200.254:40131
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:55.313161 17482 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:55.314519 17482 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:55.328835 17510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:55.329221 17509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:55.329356 17512 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:55.329957 17482 server_base.cc:1034] running on GCE node
I20260807 04:16:55.330610 17482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:55.331664 17482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:55.332881 17482 hybrid_clock.cc:648] HybridClock initialized: now 1786076215332825 us; error 43 us; skew 500 ppm
I20260807 04:16:55.333232 17482 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:55 dist-test-slave-qg60 krb5kdc[16857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076215, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:55.340827 17482 init.cc:377] Logged in from keytab as oryx/127.7.200.193@KRBTEST.COM (short username oryx)
I20260807 04:16:55.342521 17482 webserver.cc:460] Webserver started at http://127.7.200.193:44665/ using document root <none> and password file <none>
I20260807 04:16:55.343290 17482 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:55.343443 17482 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:55.349205 17482 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 04:16:55.351989 17521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:55.353453 17482 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:16:55.353642 17482 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "9a36350b77b9449d98dcb89b2ed8b133"
format_stamp: "Formatted at 2026-08-07 04:16:52 on dist-test-slave-qg60"
server_key: "ba29e0395151219d32e8643efa50b6c8"
server_key_iv: "367ac0e217d04ff813c043b724f4f85b"
server_key_version: "encryptionkey@0"
I20260807 04:16:55.354657 17482 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:55.387499 17482 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:55.392048 17482 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:55.392334 17482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:55.393445 17482 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:16:55.394824 17482 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:55.394945 17482 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:55.395079 17482 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:55.395179 17482 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:55.430742 17482 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:37395
I20260807 04:16:55.430838 17637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:37395 every 8 connection(s)
I20260807 04:16:55.432281 17482 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:16:55.441717 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 17482
I20260807 04:16:55.442525 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:41459
--local_ip_for_outbound_sockets=127.7.200.194
--tserver_master_addrs=127.7.200.254:40131
--webserver_port=38229
--webserver_interface=127.7.200.194
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:41415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.7.200.194
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 04:16:55 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:16:55 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 04:16:55.785185 17642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:55.785456 17642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:55.785610 17642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:55.793004 17642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:55.793156 17642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:55.793360 17642 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:16:55.803090 17642 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:41415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.194.keytab
--principal=oryx/127.7.200.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:41459
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=38229
--tserver_master_addrs=127.7.200.254:40131
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:55.804548 17642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:55.805886 17642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:55.824239 17649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:55.824502 17648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:55.824669 17652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:55.826247 17642 server_base.cc:1034] running on GCE node
I20260807 04:16:55.826987 17642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:55.828097 17642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:55.829487 17642 hybrid_clock.cc:648] HybridClock initialized: now 1786076215829401 us; error 88 us; skew 500 ppm
I20260807 04:16:55.829850 17642 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:55 dist-test-slave-qg60 krb5kdc[16857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076215, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:55.833206 17642 init.cc:377] Logged in from keytab as oryx/127.7.200.194@KRBTEST.COM (short username oryx)
I20260807 04:16:55.835057 17642 webserver.cc:460] Webserver started at http://127.7.200.194:38229/ using document root <none> and password file <none>
I20260807 04:16:55.835793 17642 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:55.836012 17642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:55.842491 17642 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 04:16:55.846060 17659 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:55.847781 17642 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260807 04:16:55.847995 17642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "4bb434442bb14a4bae0d369a8599b866"
format_stamp: "Formatted at 2026-08-07 04:16:53 on dist-test-slave-qg60"
server_key: "610553a4ecf9aabf418e45c1fccb1d39"
server_key_iv: "7b38318ba37174d9795b89fb59ab1fc9"
server_key_version: "encryptionkey@0"
I20260807 04:16:55.849195 17642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:55.876650 17642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:16:55.882040 17642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:55.882346 17642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:55.885035 17642 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:16:55.886718 17642 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:55.886818 17642 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:55.887001 17642 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:55.887104 17642 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:55.943532 17642 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:41459
I20260807 04:16:55.943599 17780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:41459 every 8 connection(s)
I20260807 04:16:55.945431 17642 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:16:55.955204 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 17642
I20260807 04:16:55.956096 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:42635
--local_ip_for_outbound_sockets=127.7.200.195
--tserver_master_addrs=127.7.200.254:40131
--webserver_port=42235
--webserver_interface=127.7.200.195
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:41415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.7.200.195
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 04:16:55 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:16:55 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 04:16:56.621852 17785 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:16:56.622153 17785 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:16:56.622314 17785 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:16:56.631772 17785 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:16:56.631928 17785 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:16:56.632120 17785 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:16:56.647641 17785 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:41415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/krb5kdc/oryx_127.7.200.195.keytab
--principal=oryx/127.7.200.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:42635
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=42235
--tserver_master_addrs=127.7.200.254:40131
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:16:56.649715 17785 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:16:56.651188 17785 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:16:56.674011 17792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:56.674459 17791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:16:56.676446 17794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:16:56.680950 17785 server_base.cc:1034] running on GCE node
I20260807 04:16:56.681675 17785 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:16:56.682917 17785 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:16:56.684139 17785 hybrid_clock.cc:648] HybridClock initialized: now 1786076216684062 us; error 59 us; skew 500 ppm
I20260807 04:16:56.684497 17785 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:16:56 dist-test-slave-qg60 krb5kdc[16857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076216, etypes {rep=17 tkt=17 ses=17}, oryx/127.7.200.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:16:56.688045 17785 init.cc:377] Logged in from keytab as oryx/127.7.200.195@KRBTEST.COM (short username oryx)
I20260807 04:16:56.689944 17785 webserver.cc:460] Webserver started at http://127.7.200.195:42235/ using document root <none> and password file <none>
I20260807 04:16:56.690742 17785 fs_manager.cc:359] Metadata directory not provided
I20260807 04:16:56.690898 17785 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:16:56.696986 17785 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 04:16:56.700333 17802 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:56.702299 17785 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 04:16:56.702502 17785 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "0a2d012a95c7452180c2992f449ae219"
format_stamp: "Formatted at 2026-08-07 04:16:53 on dist-test-slave-qg60"
server_key: "4dad9bba28033095d452f4bb5c2285f7"
server_key_iv: "09bdd775428a345245c9b43b2d65d154"
server_key_version: "encryptionkey@0"
I20260807 04:16:56.704039 17785 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:16:56.728245 17785 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
W20260807 04:16:56.728590 17641 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.282s user 0.007s sys 0.010s
W20260807 04:16:56.731833 17640 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:16:55.435384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:54139 (local address 127.7.200.254:40131)
0807 04:16:55.436203 (+ 819us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:55.436219 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:55.436667 (+ 448us) server_negotiation.cc:407] Connection header received
0807 04:16:55.438849 (+ 2182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:55.438862 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:55.439171 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:55.439497 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:55.440941 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:55.442924 (+ 1983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:55.444478 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:55.445603 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:55.445789 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:56.730755 (+1284966us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.193:54139: BlockingRecv error: recv got EOF from 127.7.200.193:54139 (error 108)
Metrics: {"server-negotiator.queue_time_us":520,"thread_start_us":270,"threads_started":1}
I20260807 04:16:56.732524 17641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:55.435453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.193:54139)
0807 04:16:55.436500 (+ 1047us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:55.436538 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:55.438337 (+ 1799us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:55.439655 (+ 1318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:55.439662 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:55.440190 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:55.440712 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:55.440782 (+ 70us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:55.443107 (+ 2325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:55.443111 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:55.444329 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:55.444342 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:55.445822 (+ 1480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:55.445827 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:55.446039 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:55.446757 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:55.446781 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:56.730354 (+1283573us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":790,"thread_start_us":633,"threads_started":1}
W20260807 04:16:56.733754 17638 heartbeater.cc:644] Failed to heartbeat to 127.7.200.254:40131 (0 consecutive failures): Not authorized: Failed to ping master at 127.7.200.254:40131: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
I20260807 04:16:56.734241 17785 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:16:56.734578 17785 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:16:56.735850 17785 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:16:56.737833 17785 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:16:56.738016 17785 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:16:56.738152 17785 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:16:56.738257 17785 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 04:16:56 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:16:56 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:16:56.749735 17641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:56.734510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.193:43671)
0807 04:16:56.734823 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:56.734842 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:56.734966 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:56.735928 (+ 962us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:56.735936 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:56.736394 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:56.736628 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:56.736643 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:56.739002 (+ 2359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:56.739008 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:56.740610 (+ 1602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:56.740627 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:56.742173 (+ 1546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:56.742181 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:56.742425 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:56.743400 (+ 975us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:56.743435 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:56.749274 (+ 5839us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184}
W20260807 04:16:56.752545 17640 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:16:56.734825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:43671 (local address 127.7.200.254:40131)
0807 04:16:56.735280 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:56.735290 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:56.735319 (+ 29us) server_negotiation.cc:407] Connection header received
0807 04:16:56.735409 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:56.735418 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:56.735527 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:56.735691 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:56.736828 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:56.738720 (+ 1892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:56.740851 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:56.741852 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:56.751540 (+ 9688us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:56.752161 (+ 621us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.193:43671: BlockingRecv error: recv got EOF from 127.7.200.193:43671 (error 108)
Metrics: {"server-negotiator.queue_time_us":279}
Aug 07 04:16:56 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:16:56 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 04:16:56.767946 17640 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:16:56.751358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:38867 (local address 127.7.200.254:40131)
0807 04:16:56.752907 (+ 1549us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:56.752916 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:56.755934 (+ 3018us) server_negotiation.cc:407] Connection header received
0807 04:16:56.756696 (+ 762us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:56.756702 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:56.756804 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:56.756871 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:56.757914 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:56.758988 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:56.760886 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:56.761529 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:56.761623 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:56.767668 (+ 6045us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.193:38867: BlockingRecv error: recv got EOF from 127.7.200.193:38867 (error 108)
Metrics: {"server-negotiator.queue_time_us":1390,"thread_start_us":3407,"threads_started":1}
I20260807 04:16:56.768868 17641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:56.750923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.193:38867)
0807 04:16:56.755833 (+ 4910us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:56.755855 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:56.756296 (+ 441us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:56.757082 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:56.757087 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:56.757505 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:56.757753 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:56.757765 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:56.759209 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:56.759214 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:56.760677 (+ 1463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:56.760691 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:56.761871 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:56.761877 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:56.762092 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:56.762976 (+ 884us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:56.762998 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:56.768541 (+ 5543us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":4802,"thread_start_us":5437,"threads_started":1}
W20260807 04:16:56.769412 17638 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 04:16:56.810910 17923 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:42635 every 8 connection(s)
I20260807 04:16:56.810915 17785 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:42635
I20260807 04:16:56.813715 17785 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:16:56.823259 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 17785
Aug 07 04:16:56 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:16:56 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:16:56.841969 17814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:56.824245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42612 (local address 127.7.200.254:40131)
0807 04:16:56.824475 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:56.824484 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:56.825070 (+ 586us) server_negotiation.cc:407] Connection header received
0807 04:16:56.825261 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:56.825266 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:56.825386 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:56.825521 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:56.827483 (+ 1962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:56.829346 (+ 1863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:56.831019 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:56.831550 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:56.831692 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:56.834905 (+ 3213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:16:56.834914 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:16:56.834938 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:16:56.834975 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:16:56.838422 (+ 3447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:56.839169 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:56.839177 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:56.839185 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:56.839381 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:16:56.839797 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:16:56.839804 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:16:56.839807 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:16:56.840326 (+ 519us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:16:56.840657 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0807 04:16:56.841180 (+ 523us) server_negotiation.cc:299] Negotiation successful
0807 04:16:56.841615 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260807 04:16:57.241258 17784 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.274s user 0.007s sys 0.023s
W20260807 04:16:57.242985 17783 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:16:55.949407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:45567 (local address 127.7.200.254:40131)
0807 04:16:55.950064 (+ 657us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:55.950073 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:55.951392 (+ 1319us) server_negotiation.cc:407] Connection header received
0807 04:16:55.955561 (+ 4169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:55.955570 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:55.955698 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:55.955843 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:55.959084 (+ 3241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:55.960464 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:55.964148 (+ 3684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:55.965010 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:55.965183 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:57.242725 (+1277542us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.194:45567: BlockingRecv error: recv got EOF from 127.7.200.194:45567 (error 108)
Metrics: {"server-negotiator.queue_time_us":486,"thread_start_us":324,"threads_started":1}
I20260807 04:16:57.244588 17784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:55.949945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.194:45567)
0807 04:16:55.951117 (+ 1172us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:55.951200 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:55.955106 (+ 3906us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:55.956236 (+ 1130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:55.956255 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:55.957421 (+ 1166us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:55.958762 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:55.958800 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:55.960703 (+ 1903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:55.960712 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:55.963911 (+ 3199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:55.963936 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:55.965349 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:55.965361 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:55.965853 (+ 492us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:55.967002 (+ 1149us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:55.967048 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:57.242619 (+1275571us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":735,"thread_start_us":419,"threads_started":1}
W20260807 04:16:57.245647 17781 heartbeater.cc:644] Failed to heartbeat to 127.7.200.254:40131 (0 consecutive failures): Not authorized: Failed to ping master at 127.7.200.254:40131: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Aug 07 04:16:57 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:16:57 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 04:16:57.259621 17783 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:16:57.246569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:44643 (local address 127.7.200.254:40131)
0807 04:16:57.246792 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:57.246797 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:57.247015 (+ 218us) server_negotiation.cc:407] Connection header received
0807 04:16:57.247263 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:57.247266 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:57.247332 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:57.247410 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:57.248773 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:57.249543 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:57.252247 (+ 2704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:57.252648 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:57.252799 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:57.259391 (+ 6592us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.194:44643: BlockingRecv error: recv got EOF from 127.7.200.194:44643 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 04:16:57.260007 17784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:57.246485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.194:44643)
0807 04:16:57.246890 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:57.246921 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:57.247109 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:57.247495 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:57.247503 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:57.248199 (+ 696us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:57.248562 (+ 363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:57.248579 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:57.249714 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:57.249723 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:57.252071 (+ 2348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:57.252093 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:57.252886 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:57.252897 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:57.253167 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:57.254050 (+ 883us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:57.254085 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:57.259238 (+ 5153us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204}
Aug 07 04:16:57 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:16:57 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 04:16:57.271206 17783 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:16:57.261298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:46043 (local address 127.7.200.254:40131)
0807 04:16:57.261553 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:57.261563 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:57.261588 (+ 25us) server_negotiation.cc:407] Connection header received
0807 04:16:57.261666 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:57.261674 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:57.261806 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:57.261953 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:57.262697 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:57.263585 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:57.265230 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:57.265649 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:57.265782 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:57.270967 (+ 5185us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.194:46043: BlockingRecv error: recv got EOF from 127.7.200.194:46043 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 04:16:57.271216 17784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:57.260945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.194:46043)
0807 04:16:57.261111 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:57.261137 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:57.261258 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:57.261972 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:57.261975 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:57.262364 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:57.262544 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:57.262554 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:57.263748 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:57.263760 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:57.265090 (+ 1330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:57.265102 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:57.265811 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:57.265817 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:57.266001 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:57.266758 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:57.266775 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:57.270777 (+ 4002us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":56}
W20260807 04:16:57.271660 17781 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 07 04:16:57 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:16:57 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:16:57.780507 17929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:57.770265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.193:45943)
0807 04:16:57.770865 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:57.770882 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:57.771061 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:57.771446 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:57.771451 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:57.771919 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:57.772072 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:57.772080 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:57.773161 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:57.773167 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:57.774416 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:57.774433 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:57.775616 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:57.775623 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:57.775808 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:57.776536 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:57.776555 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:57.780267 (+ 3712us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":380,"threads_started":1}
W20260807 04:16:57.781085 17783 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:16:57.770231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:45943 (local address 127.7.200.254:40131)
0807 04:16:57.770402 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:57.770407 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:57.770981 (+ 574us) server_negotiation.cc:407] Connection header received
0807 04:16:57.771198 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:57.771204 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:57.771301 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:57.771406 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:57.772225 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:57.773015 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:57.774591 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:57.775242 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:57.775378 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:57.780687 (+ 5309us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.193:45943: BlockingRecv error: recv got EOF from 127.7.200.193:45943 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260807 04:16:57.981056 17926 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.148s user 0.006s sys 0.023s
W20260807 04:16:57.982295 17640 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:16:56.816898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:53529 (local address 127.7.200.254:40131)
0807 04:16:56.817099 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:56.817105 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:56.818773 (+ 1668us) server_negotiation.cc:407] Connection header received
0807 04:16:56.822939 (+ 4166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:56.822945 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:56.823059 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:56.823184 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:56.826277 (+ 3093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:56.827426 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:56.829345 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:56.830028 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:56.830165 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:57.982067 (+1151902us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.195:53529: BlockingRecv error: recv got EOF from 127.7.200.195:53529 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 04:16:57.982812 17926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:56.817382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.195:53529)
0807 04:16:56.818480 (+ 1098us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:56.818577 (+ 97us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:56.822398 (+ 3821us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:56.823616 (+ 1218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:56.823635 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:56.824799 (+ 1164us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:56.826025 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:56.826059 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:56.827617 (+ 1558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:56.827622 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:56.829194 (+ 1572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:56.829207 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:56.830361 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:56.830371 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:56.830871 (+ 500us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:56.832815 (+ 1944us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:56.832863 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:57.981846 (+1148983us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":657,"thread_start_us":407,"threads_started":1}
W20260807 04:16:57.983958 17924 heartbeater.cc:644] Failed to heartbeat to 127.7.200.254:40131 (0 consecutive failures): Not authorized: Failed to ping master at 127.7.200.254:40131: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Aug 07 04:16:57 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:16:57 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:16:57.993891 17926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:57.984824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.195:39939)
0807 04:16:57.985005 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:57.985021 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:57.985145 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:57.985520 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:57.985525 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:57.985891 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:57.986050 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:57.986059 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:57.987145 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:57.987149 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:57.988096 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:57.988107 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:57.988908 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:57.988914 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:57.989088 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:57.989728 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:57.989746 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:57.993565 (+ 3819us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":56}
W20260807 04:16:57.994082 17640 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:16:57.985010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:39939 (local address 127.7.200.254:40131)
0807 04:16:57.985265 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:57.985270 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:57.985292 (+ 22us) server_negotiation.cc:407] Connection header received
0807 04:16:57.985333 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:57.985336 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:57.985391 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:57.985487 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:57.986198 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:57.986992 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:57.988246 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:57.988686 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:57.988869 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:57.993834 (+ 4965us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.195:39939: BlockingRecv error: recv got EOF from 127.7.200.195:39939 (error 108)
Metrics: {"server-negotiator.queue_time_us":129}
Aug 07 04:16:57 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:16:57 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:16:58.003559 17926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:57.994808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.195:46569)
0807 04:16:57.995004 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:57.995020 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:57.995117 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:57.995382 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:57.995385 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:57.995832 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:57.995994 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:57.996003 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:57.997118 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:57.997124 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:57.998080 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:57.998091 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:57.998807 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:57.998813 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:57.998998 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:57.999568 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:57.999586 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:58.003330 (+ 3744us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":91}
W20260807 04:16:58.003849 17640 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:16:57.994957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:46569 (local address 127.7.200.254:40131)
0807 04:16:57.995136 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:57.995140 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:57.995158 (+ 18us) server_negotiation.cc:407] Connection header received
0807 04:16:57.995201 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:57.995204 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:57.995257 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:57.995332 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:57.996147 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:57.996979 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:57.998230 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:57.998660 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:57.998793 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:58.003562 (+ 4769us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.195:46569: BlockingRecv error: recv got EOF from 127.7.200.195:46569 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260807 04:16:58.003986 17924 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 07 04:16:58 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:16:58 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:16:58.282560 17930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:58.272245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.194:59423)
0807 04:16:58.272953 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:58.272970 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:58.273138 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:58.273524 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:58.273529 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:58.274041 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:58.274199 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:58.274208 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:58.275318 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:58.275324 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:58.276340 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:58.276352 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:58.277206 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:58.277214 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:58.277386 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:58.278037 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:58.278054 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:58.282316 (+ 4262us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":583,"thread_start_us":393,"threads_started":1}
W20260807 04:16:58.282840 17640 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:16:58.272397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:59423 (local address 127.7.200.254:40131)
0807 04:16:58.272704 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:58.272712 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:58.273070 (+ 358us) server_negotiation.cc:407] Connection header received
0807 04:16:58.273279 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:58.273286 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:58.273370 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:58.273490 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:58.274362 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:58.275164 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:58.276500 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:58.276994 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:58.277135 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:58.282580 (+ 5445us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.194:59423: BlockingRecv error: recv got EOF from 127.7.200.194:59423 (error 108)
Metrics: {"server-negotiator.queue_time_us":121}
Aug 07 04:16:58 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:16:58 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:16:58.791711 17931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:58.781641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.193:59157)
0807 04:16:58.782168 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:58.782185 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:58.782304 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:58.782624 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:58.782628 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:58.783154 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:58.783370 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:58.783380 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:58.784476 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:58.784480 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:58.785625 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:58.785645 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:58.786682 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:58.786690 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:58.786902 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:58.787514 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:58.787544 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:58.791427 (+ 3883us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":282,"threads_started":1}
W20260807 04:16:58.792071 17640 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:16:58.781848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:59157 (local address 127.7.200.254:40131)
0807 04:16:58.782105 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:58.782110 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:58.782263 (+ 153us) server_negotiation.cc:407] Connection header received
0807 04:16:58.782410 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:58.782414 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:58.782484 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:58.782581 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:58.783506 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:58.784339 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:58.785789 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:58.786484 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:58.786639 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:58.791647 (+ 5008us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.193:59157: BlockingRecv error: recv got EOF from 127.7.200.193:59157 (error 108)
Metrics: {"server-negotiator.queue_time_us":130}
Aug 07 04:16:59 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:16:59 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:16:59.014961 17932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:59.004830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.195:43117)
0807 04:16:59.005449 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:59.005466 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:59.005639 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:59.006021 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:59.006026 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:59.006535 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:59.006735 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:59.006747 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:59.008116 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:59.008120 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:59.009380 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:59.009393 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:59.010240 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:59.010245 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:59.010369 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:59.011022 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:59.011059 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:59.014715 (+ 3656us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":386,"threads_started":1}
W20260807 04:16:59.015232 17640 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:16:59.004905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:43117 (local address 127.7.200.254:40131)
0807 04:16:59.005225 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:59.005235 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:59.005579 (+ 344us) server_negotiation.cc:407] Connection header received
0807 04:16:59.005785 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:59.005791 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:59.005877 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:59.005988 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:59.006932 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:59.007932 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:59.009536 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:59.010070 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:59.010174 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:59.014928 (+ 4754us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.195:43117: BlockingRecv error: recv got EOF from 127.7.200.195:43117 (error 108)
Metrics: {"server-negotiator.queue_time_us":152}
Aug 07 04:16:59 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:16:59 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:16:59.295409 17933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:59.283526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.194:49679)
0807 04:16:59.284091 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:59.284111 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:59.284258 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:59.284686 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:59.284691 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:59.285321 (+ 630us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:59.285580 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:59.285594 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:59.287265 (+ 1671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:59.287271 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:59.288895 (+ 1624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:59.288911 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:59.290020 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:59.290026 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:59.290210 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:59.291038 (+ 828us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:59.291060 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:59.295136 (+ 4076us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":334,"threads_started":1}
W20260807 04:16:59.295573 17640 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:16:59.283616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:49679 (local address 127.7.200.254:40131)
0807 04:16:59.283836 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:59.283844 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:59.284205 (+ 361us) server_negotiation.cc:407] Connection header received
0807 04:16:59.284410 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:59.284418 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:59.284514 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:59.284635 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:59.285761 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:59.287074 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:59.289056 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:59.289857 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:59.290015 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:59.295341 (+ 5326us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.194:49679: BlockingRecv error: recv got EOF from 127.7.200.194:49679 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 07 04:16:59 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:16:59 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:16:59.802109 17934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:16:59.792719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.193:45005)
0807 04:16:59.793474 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0807 04:16:59.793494 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 04:16:59.793659 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:16:59.794014 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:16:59.794019 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:16:59.794462 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:16:59.794648 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:59.794658 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:59.795702 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:59.795708 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:59.796654 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:16:59.796665 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:16:59.797448 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:16:59.797453 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:16:59.797655 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:59.798324 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:16:59.798342 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:16:59.801731 (+ 3389us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":583,"thread_start_us":419,"threads_started":1}
W20260807 04:16:59.802204 17640 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:16:59.792877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:45005 (local address 127.7.200.254:40131)
0807 04:16:59.793119 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0807 04:16:59.793126 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:16:59.793588 (+ 462us) server_negotiation.cc:407] Connection header received
0807 04:16:59.793792 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:16:59.793797 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:16:59.793875 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:16:59.793975 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:16:59.794803 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:59.795548 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:59.796841 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:16:59.797302 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:16:59.797435 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:16:59.801945 (+ 4510us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.193:45005: BlockingRecv error: recv got EOF from 127.7.200.193:45005 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 07 04:17:00 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:00 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:00.026044 17935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:00.015972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.195:43921)
0807 04:17:00.016511 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:00.016526 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:00.016706 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:00.017091 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:00.017096 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:00.017539 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:00.017730 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:00.017738 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:00.018783 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:00.018791 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:00.019722 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:00.019734 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:00.020429 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:00.020435 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:00.020630 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:00.021270 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:00.021288 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:00.025617 (+ 4329us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":309,"threads_started":1}
W20260807 04:17:00.026170 17640 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:00.016090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:43921 (local address 127.7.200.254:40131)
0807 04:17:00.016308 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:00.016316 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:00.016629 (+ 313us) server_negotiation.cc:407] Connection header received
0807 04:17:00.016862 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:00.016867 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:00.016949 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:00.017055 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:00.017878 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:00.018646 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:00.019864 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:00.020275 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:00.020414 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:00.025844 (+ 5430us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.195:43921: BlockingRecv error: recv got EOF from 127.7.200.195:43921 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 07 04:17:00 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:00 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:00.306685 17936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:00.296424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.194:49271)
0807 04:17:00.297038 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:00.297057 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:00.297187 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:00.297477 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:00.297481 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:00.297880 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:00.298122 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:00.298132 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:00.299260 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:00.299264 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:00.300330 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:00.300344 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:00.301164 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:00.301169 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:00.301303 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:00.301990 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:00.302011 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:00.306330 (+ 4319us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":321,"threads_started":1}
W20260807 04:17:00.306808 17640 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:00.296641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:49271 (local address 127.7.200.254:40131)
0807 04:17:00.296887 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:00.296894 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:00.297144 (+ 250us) server_negotiation.cc:407] Connection header received
0807 04:17:00.297280 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:00.297283 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:00.297346 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:00.297426 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:00.298292 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:00.299105 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:00.300476 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:00.301023 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:00.301131 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:00.306554 (+ 5423us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.194:49271: BlockingRecv error: recv got EOF from 127.7.200.194:49271 (error 108)
Metrics: {"server-negotiator.queue_time_us":102}
Aug 07 04:17:00 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:00 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:00.818300 17937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:00.803296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.193:49649)
0807 04:17:00.803905 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:00.803922 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:00.804037 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:00.804328 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:00.804332 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:00.804774 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:00.804951 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:00.804960 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:00.805963 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:00.805967 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:00.806990 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:00.807001 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:00.807834 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:00.807840 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:00.808020 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:00.814079 (+ 6059us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:00.814099 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:00.817923 (+ 3824us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":359,"threads_started":1}
W20260807 04:17:00.818454 17640 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:00.803429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:49649 (local address 127.7.200.254:40131)
0807 04:17:00.803602 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:00.803607 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:00.804042 (+ 435us) server_negotiation.cc:407] Connection header received
0807 04:17:00.804126 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:00.804130 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:00.804192 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:00.804276 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:00.805104 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:00.805830 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:00.807200 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:00.807657 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:00.807795 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:00.818196 (+ 10401us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.193:49649: BlockingRecv error: recv got EOF from 127.7.200.193:49649 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 07 04:17:01 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:01 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:01.037573 17938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:01.027328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.195:54173)
0807 04:17:01.027915 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:01.027935 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:01.028080 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:01.028487 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:01.028491 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:01.028933 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:01.029126 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:01.029137 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:01.030210 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:01.030215 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:01.031543 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:01.031562 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:01.032461 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:01.032465 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:01.032667 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:01.033348 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:01.033366 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:01.037321 (+ 3955us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":340,"threads_started":1}
W20260807 04:17:01.037847 17640 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:01.027415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:54173 (local address 127.7.200.254:40131)
0807 04:17:01.027617 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:01.027622 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:01.028054 (+ 432us) server_negotiation.cc:407] Connection header received
0807 04:17:01.028192 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:01.028196 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:01.028281 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:01.028373 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:01.029284 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:01.030067 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:01.031715 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:01.032269 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:01.032412 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:01.037545 (+ 5133us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.195:54173: BlockingRecv error: recv got EOF from 127.7.200.195:54173 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 07 04:17:01 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:01 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:01.317510 17939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:01.307896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.194:47871)
0807 04:17:01.308460 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:01.308476 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:01.308629 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:01.309090 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:01.309095 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:01.309702 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:01.309872 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:01.309883 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:01.310918 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:01.310926 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:01.311938 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:01.311951 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:01.312686 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:01.312691 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:01.312909 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:01.313514 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:01.313531 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:01.317094 (+ 3563us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":304,"threads_started":1}
W20260807 04:17:01.317622 17640 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:01.307980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:47871 (local address 127.7.200.254:40131)
0807 04:17:01.308228 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:01.308237 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:01.308567 (+ 330us) server_negotiation.cc:407] Connection header received
0807 04:17:01.308780 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:01.308789 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:01.308870 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:01.309068 (+ 198us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:01.310025 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:01.310780 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:01.312103 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:01.312537 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:01.312673 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:01.317325 (+ 4652us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.194:47871: BlockingRecv error: recv got EOF from 127.7.200.194:47871 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 07 04:17:01 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:01 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:01.829471 17940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:01.819486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.193:39237)
0807 04:17:01.820067 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:01.820085 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:01.820193 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:01.820534 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:01.820538 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:01.821110 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:01.821277 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:01.821286 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:01.822510 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:01.822514 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:01.823720 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:01.823734 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:01.824867 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:01.824872 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:01.825034 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:01.825628 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:01.825646 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:01.829222 (+ 3576us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":280,"threads_started":1}
W20260807 04:17:01.829829 17941 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:01.819600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:39237 (local address 127.7.200.254:40131)
0807 04:17:01.820160 (+ 560us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:01.820164 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:01.820183 (+ 19us) server_negotiation.cc:407] Connection header received
0807 04:17:01.820302 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:01.820306 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:01.820367 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:01.820465 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:01.821492 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:01.822345 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:01.823878 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:01.824683 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:01.824858 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:01.829458 (+ 4600us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.193:39237: BlockingRecv error: recv got EOF from 127.7.200.193:39237 (error 108)
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":354,"threads_started":1}
Aug 07 04:17:02 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:02 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:02.049431 17942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:02.038641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.195:59801)
0807 04:17:02.039402 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:02.039421 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:02.039568 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:02.039989 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:02.039998 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:02.040410 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:02.040606 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:02.040615 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:02.041764 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:02.041768 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:02.042953 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:02.042966 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:02.043673 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:02.043678 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:02.043822 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:02.044548 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:02.044568 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:02.049042 (+ 4474us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":642,"thread_start_us":476,"threads_started":1}
W20260807 04:17:02.049572 17941 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:02.038742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:59801 (local address 127.7.200.254:40131)
0807 04:17:02.039084 (+ 342us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:02.039091 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:02.039523 (+ 432us) server_negotiation.cc:407] Connection header received
0807 04:17:02.039720 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:02.039725 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:02.039809 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:02.039902 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:02.040812 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:02.041616 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:02.043104 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:02.043521 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:02.043634 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:02.049302 (+ 5668us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.195:59801: BlockingRecv error: recv got EOF from 127.7.200.195:59801 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
Aug 07 04:17:02 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:02 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:02.329560 17943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:02.318741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.194:55621)
0807 04:17:02.319318 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:02.319335 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:02.319460 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:02.319800 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:02.319804 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:02.320348 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:02.320516 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:02.320525 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:02.321722 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:02.321726 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:02.322986 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:02.323001 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:02.323726 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:02.323731 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:02.323868 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:02.324691 (+ 823us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:02.324711 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:02.329196 (+ 4485us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":323,"threads_started":1}
W20260807 04:17:02.329697 17941 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:02.318998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:55621 (local address 127.7.200.254:40131)
0807 04:17:02.319205 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:02.319209 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:02.319457 (+ 248us) server_negotiation.cc:407] Connection header received
0807 04:17:02.319551 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:02.319555 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:02.319621 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:02.319725 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:02.320675 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:02.321563 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:02.323136 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:02.323577 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:02.323681 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:02.329408 (+ 5727us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.194:55621: BlockingRecv error: recv got EOF from 127.7.200.194:55621 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 07 04:17:02 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:02 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:02.840958 17944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:02.830631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.193:44997)
0807 04:17:02.831293 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:02.831313 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:02.831447 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:02.831806 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:02.831810 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:02.832314 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:02.832533 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:02.832543 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:02.833823 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:02.833828 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:02.835187 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:02.835204 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:02.835993 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:02.835997 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:02.836128 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:02.836797 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:02.836829 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:02.840623 (+ 3794us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":381,"threads_started":1}
W20260807 04:17:02.841404 17946 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:02.830717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:44997 (local address 127.7.200.254:40131)
0807 04:17:02.831330 (+ 613us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:02.831335 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:02.831391 (+ 56us) server_negotiation.cc:407] Connection header received
0807 04:17:02.831558 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:02.831562 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:02.831644 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:02.831739 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:02.832709 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:02.833662 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:02.835338 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:02.835793 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:02.835916 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:02.841157 (+ 5241us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.193:44997: BlockingRecv error: recv got EOF from 127.7.200.193:44997 (error 108)
Metrics: {"server-negotiator.queue_time_us":504,"thread_start_us":333,"threads_started":1}
Aug 07 04:17:03 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:03 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:03.060509 17947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:03.050558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.195:40067)
0807 04:17:03.051212 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:03.051230 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:03.051347 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:03.051718 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:03.051721 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:03.052198 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:03.052353 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:03.052362 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:03.053498 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:03.053510 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:03.054518 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:03.054538 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:03.055249 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:03.055254 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:03.055455 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:03.056153 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:03.056181 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:03.060276 (+ 4095us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":389,"threads_started":1}
W20260807 04:17:03.060961 17946 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:03.050671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:40067 (local address 127.7.200.254:40131)
0807 04:17:03.050858 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:03.050863 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:03.051321 (+ 458us) server_negotiation.cc:407] Connection header received
0807 04:17:03.051457 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:03.051461 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:03.051543 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:03.051631 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:03.052528 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:03.053311 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:03.054678 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:03.055097 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:03.055232 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:03.060529 (+ 5297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.195:40067: BlockingRecv error: recv got EOF from 127.7.200.195:40067 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 07 04:17:03 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:03 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:03.340708 17948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:03.330953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.194:55673)
0807 04:17:03.331682 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:03.331698 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:03.331866 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:03.332222 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:03.332230 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:03.332679 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:03.332896 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:03.332907 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:03.334031 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:03.334036 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:03.334968 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:03.334978 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:03.335698 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:03.335703 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:03.335892 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:03.336509 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:03.336526 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:03.340440 (+ 3914us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":454,"threads_started":1}
W20260807 04:17:03.341046 17946 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:03.330985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:55673 (local address 127.7.200.254:40131)
0807 04:17:03.331219 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:03.331226 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:03.331785 (+ 559us) server_negotiation.cc:407] Connection header received
0807 04:17:03.331991 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:03.331997 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:03.332080 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:03.332182 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:03.333068 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:03.333871 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:03.335114 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:03.335536 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:03.335680 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:03.340661 (+ 4981us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.194:55673: BlockingRecv error: recv got EOF from 127.7.200.194:55673 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 07 04:17:03 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:03 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:03.853546 17950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:03.842184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.193:59309)
0807 04:17:03.843009 (+ 825us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:03.843038 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:03.843208 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:03.843733 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:03.843739 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:03.844307 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:03.844588 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:03.844603 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:03.846125 (+ 1522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:03.846130 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:03.847180 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:03.847196 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:03.848016 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:03.848021 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:03.848139 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:03.848969 (+ 830us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:03.848990 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:03.853285 (+ 4295us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":303,"threads_started":1}
W20260807 04:17:03.853991 17951 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:03.842315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:59309 (local address 127.7.200.254:40131)
0807 04:17:03.842888 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:03.842896 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:03.843137 (+ 241us) server_negotiation.cc:407] Connection header received
0807 04:17:03.843441 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:03.843458 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:03.843544 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:03.843648 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:03.844809 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:03.845957 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:03.847332 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:03.847789 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:03.847889 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:03.853524 (+ 5635us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.193:59309: BlockingRecv error: recv got EOF from 127.7.200.193:59309 (error 108)
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":311,"threads_started":1}
Aug 07 04:17:04 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:04 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:04.071581 17952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:04.061622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.195:57325)
0807 04:17:04.062241 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:04.062268 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:04.062388 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:04.062728 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:04.062731 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:04.063212 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:04.063391 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:04.063402 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:04.064588 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:04.064592 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:04.065598 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:04.065610 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:04.066329 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:04.066333 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:04.066472 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:04.067085 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:04.067104 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:04.071223 (+ 4119us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":389,"threads_started":1}
W20260807 04:17:04.071659 17951 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:04.061695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:57325 (local address 127.7.200.254:40131)
0807 04:17:04.061896 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:04.061901 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:04.062351 (+ 450us) server_negotiation.cc:407] Connection header received
0807 04:17:04.062524 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:04.062528 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:04.062592 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:04.062686 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:04.063553 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:04.064446 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:04.065743 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:04.066157 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:04.066255 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:04.071423 (+ 5168us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.195:57325: BlockingRecv error: recv got EOF from 127.7.200.195:57325 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 07 04:17:04 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:04 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:04.352818 17953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:04.341938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.194:33425)
0807 04:17:04.342563 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:04.342582 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:04.342711 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:04.343059 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:04.343063 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:04.343663 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:04.343955 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:04.343973 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:04.345608 (+ 1635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:04.345622 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:04.346686 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:04.346699 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:04.347464 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:04.347468 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:04.347604 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:04.348375 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:04.348401 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:04.352454 (+ 4053us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":302,"threads_started":1}
W20260807 04:17:04.353026 17951 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:04.342077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:33425 (local address 127.7.200.254:40131)
0807 04:17:04.342390 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:04.342398 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:04.342684 (+ 286us) server_negotiation.cc:407] Connection header received
0807 04:17:04.342825 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:04.342829 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:04.342911 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:04.343018 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:04.344135 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:04.345451 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:04.346847 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:04.347302 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:04.347405 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:04.352670 (+ 5265us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.194:33425: BlockingRecv error: recv got EOF from 127.7.200.194:33425 (error 108)
Metrics: {"server-negotiator.queue_time_us":134}
Aug 07 04:17:04 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:04 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:04.865275 17955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:04.854696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.193:45295)
0807 04:17:04.855241 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:04.855260 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:04.855370 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:04.855851 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:04.855854 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:04.856281 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:04.856489 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:04.856497 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:04.857738 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:04.857742 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:04.858796 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:04.858809 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:04.859748 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:04.859754 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:04.859898 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:04.860799 (+ 901us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:04.860818 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:04.864971 (+ 4153us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":248,"threads_started":1}
W20260807 04:17:04.865504 17954 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:04.854708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:45295 (local address 127.7.200.254:40131)
0807 04:17:04.855558 (+ 850us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:04.855563 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:04.855579 (+ 16us) server_negotiation.cc:407] Connection header received
0807 04:17:04.855629 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:04.855633 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:04.855707 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:04.855804 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:04.856640 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:04.857593 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:04.858938 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:04.859556 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:04.859660 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:04.865207 (+ 5547us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.193:45295: BlockingRecv error: recv got EOF from 127.7.200.193:45295 (error 108)
Metrics: {"server-negotiator.queue_time_us":755,"thread_start_us":636,"threads_started":1}
Aug 07 04:17:05 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:05 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:05.082782 17956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:05.072682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.195:35745)
0807 04:17:05.073472 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:05.073488 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:05.073652 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:05.074018 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:05.074023 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:05.074480 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:05.074655 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:05.074663 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:05.075729 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:05.075734 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:05.076786 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:05.076798 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:05.077772 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:05.077777 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:05.077963 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:05.078576 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:05.078594 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:05.082403 (+ 3809us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":674,"thread_start_us":402,"threads_started":1}
W20260807 04:17:05.082860 17954 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:05.072907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:35745 (local address 127.7.200.254:40131)
0807 04:17:05.073119 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:05.073125 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:05.073581 (+ 456us) server_negotiation.cc:407] Connection header received
0807 04:17:05.073799 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:05.073804 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:05.073874 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:05.073986 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:05.074813 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:05.075579 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:05.076927 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:05.077579 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:05.077745 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:05.082605 (+ 4860us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.195:35745: BlockingRecv error: recv got EOF from 127.7.200.195:35745 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 07 04:17:05 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:05 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:05.364403 17957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:05.353941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.194:54907)
0807 04:17:05.354648 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:05.354667 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:05.354785 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:05.355142 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:05.355145 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:05.355686 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:05.355871 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:05.355881 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:05.357170 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:05.357174 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:05.358477 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:05.358502 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:05.359456 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:05.359465 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:05.359634 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:05.360406 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:05.360429 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:05.364148 (+ 3719us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":387,"threads_started":1}
W20260807 04:17:05.364671 17954 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:05.354173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:54907 (local address 127.7.200.254:40131)
0807 04:17:05.354398 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:05.354402 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:05.354753 (+ 351us) server_negotiation.cc:407] Connection header received
0807 04:17:05.354889 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:05.354894 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:05.355009 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:05.355098 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:05.356045 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:05.357004 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:05.358663 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:05.359246 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:05.359392 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:05.364396 (+ 5004us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.194:54907: BlockingRecv error: recv got EOF from 127.7.200.194:54907 (error 108)
Metrics: {"server-negotiator.queue_time_us":113}
Aug 07 04:17:05 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:05 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:05.881570 17958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:05.866390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.193:60989)
0807 04:17:05.866952 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:05.866978 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:05.867123 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:05.867569 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:05.867577 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:05.868060 (+ 483us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:05.868282 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:05.868293 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:05.869517 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:05.869523 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:05.871019 (+ 1496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:05.871033 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:05.871815 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:05.871821 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:05.872013 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:05.877300 (+ 5287us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:05.877321 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:05.881203 (+ 3882us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":299,"threads_started":1}
W20260807 04:17:05.881739 17959 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:05.866485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:60989 (local address 127.7.200.254:40131)
0807 04:17:05.867251 (+ 766us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:05.867259 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:05.867279 (+ 20us) server_negotiation.cc:407] Connection header received
0807 04:17:05.867322 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:05.867326 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:05.867409 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:05.867523 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:05.868434 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:05.869379 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:05.871175 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:05.871643 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:05.871796 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:05.881424 (+ 9628us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.193:60989: BlockingRecv error: recv got EOF from 127.7.200.193:60989 (error 108)
Metrics: {"server-negotiator.queue_time_us":617,"thread_start_us":500,"threads_started":1}
Aug 07 04:17:06 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:06 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:06.094262 17960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:06.083991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.195:37807)
0807 04:17:06.084593 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:06.084614 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:06.084798 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:06.085238 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:06.085243 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:06.085702 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:06.085905 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:06.085915 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:06.087013 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:06.087016 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:06.088068 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:06.088081 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:06.089001 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:06.089008 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:06.089137 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:06.089773 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:06.089792 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:06.093909 (+ 4117us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":310,"threads_started":1}
W20260807 04:17:06.094480 17959 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:06.084092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:37807 (local address 127.7.200.254:40131)
0807 04:17:06.084305 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:06.084312 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:06.084732 (+ 420us) server_negotiation.cc:407] Connection header received
0807 04:17:06.084960 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:06.084965 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:06.085053 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:06.085149 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:06.086113 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:06.086848 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:06.088228 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:06.088652 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:06.088785 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:06.094212 (+ 5427us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.195:37807: BlockingRecv error: recv got EOF from 127.7.200.195:37807 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 07 04:17:06 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:06 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:06.375152 17961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:06.365431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.194:44507)
0807 04:17:06.366060 (+ 629us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:06.366081 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:06.366234 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:06.366692 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:06.366697 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:06.367350 (+ 653us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:06.367539 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:06.367548 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:06.368580 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:06.368587 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:06.369660 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:06.369672 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:06.370440 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:06.370446 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:06.370631 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:06.371299 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:06.371318 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:06.374913 (+ 3595us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":277,"threads_started":1}
W20260807 04:17:06.375458 17959 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:06.365607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:44507 (local address 127.7.200.254:40131)
0807 04:17:06.365882 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:06.365889 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:06.366194 (+ 305us) server_negotiation.cc:407] Connection header received
0807 04:17:06.366379 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:06.366384 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:06.366526 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:06.366653 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:06.367686 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:06.368436 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:06.369812 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:06.370273 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:06.370427 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:06.375111 (+ 4684us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.194:44507: BlockingRecv error: recv got EOF from 127.7.200.194:44507 (error 108)
Metrics: {"server-negotiator.queue_time_us":110}
Aug 07 04:17:06 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:06 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:06.893247 17962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:06.882732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.193:54647)
0807 04:17:06.883380 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:06.883398 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:06.883539 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:06.883865 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:06.883869 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:06.884326 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:06.884510 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:06.884520 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:06.885869 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:06.885874 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:06.886994 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:06.887008 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:06.887765 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:06.887770 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:06.887896 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:06.888621 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:06.888640 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:06.892959 (+ 4319us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":393,"threads_started":1}
W20260807 04:17:06.893392 17963 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:06.882800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:54647 (local address 127.7.200.254:40131)
0807 04:17:06.883369 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:06.883374 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:06.883507 (+ 133us) server_negotiation.cc:407] Connection header received
0807 04:17:06.883647 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:06.883651 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:06.883727 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:06.883819 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:06.884682 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:06.885739 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:06.887145 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:06.887610 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:06.887717 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:06.893177 (+ 5460us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.193:54647: BlockingRecv error: recv got EOF from 127.7.200.193:54647 (error 108)
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":313,"threads_started":1}
Aug 07 04:17:07 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:07 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:07.105880 17964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:07.095349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.195:43585)
0807 04:17:07.095979 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:07.095997 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:07.096174 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:07.096581 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:07.096586 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:07.097116 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:07.097277 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:07.097287 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:07.098436 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:07.098445 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:07.099506 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:07.099518 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:07.100290 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:07.100297 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:07.100508 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:07.101317 (+ 809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:07.101350 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:07.105654 (+ 4304us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":342,"threads_started":1}
W20260807 04:17:07.106300 17963 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:07.095424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:43585 (local address 127.7.200.254:40131)
0807 04:17:07.095678 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:07.095687 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:07.096104 (+ 417us) server_negotiation.cc:407] Connection header received
0807 04:17:07.096322 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:07.096330 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:07.096401 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:07.096550 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:07.097441 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:07.098284 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:07.099663 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:07.100112 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:07.100264 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:07.105850 (+ 5586us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.195:43585: BlockingRecv error: recv got EOF from 127.7.200.195:43585 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 07 04:17:07 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:07 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:07.386288 17965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:07.376222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.194:55063)
0807 04:17:07.376961 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:07.376979 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:07.377095 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:07.377399 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:07.377403 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:07.377828 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:07.378014 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:07.378025 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:07.379156 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:07.379160 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:07.380328 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:07.380342 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:07.381177 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:07.381183 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:07.381324 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:07.382175 (+ 851us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:07.382195 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:07.386036 (+ 3841us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":499,"threads_started":1}
W20260807 04:17:07.386536 17963 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:07.376350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:55063 (local address 127.7.200.254:40131)
0807 04:17:07.376563 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:07.376567 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:07.377053 (+ 486us) server_negotiation.cc:407] Connection header received
0807 04:17:07.377193 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:07.377197 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:07.377260 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:07.377347 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:07.378184 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:07.378945 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:07.380476 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:07.381014 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:07.381114 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:07.386240 (+ 5126us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.194:55063: BlockingRecv error: recv got EOF from 127.7.200.194:55063 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 07 04:17:07 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:07 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:07.904775 17966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:07.894407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.193:60663)
0807 04:17:07.894978 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:07.895003 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:07.895135 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:07.895539 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:07.895549 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:07.896006 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:07.896198 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:07.896215 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:07.897420 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:07.897424 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:07.898411 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:07.898425 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:07.899256 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:07.899260 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:07.899401 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:07.900089 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:07.900109 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:07.904329 (+ 4220us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":318,"threads_started":1}
W20260807 04:17:07.905025 17967 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:07.894663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:60663 (local address 127.7.200.254:40131)
0807 04:17:07.895177 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:07.895182 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:07.895198 (+ 16us) server_negotiation.cc:407] Connection header received
0807 04:17:07.895247 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:07.895250 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:07.895332 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:07.895436 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:07.896383 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:07.897260 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:07.898580 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:07.899094 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:07.899207 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:07.904710 (+ 5503us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.193:60663: BlockingRecv error: recv got EOF from 127.7.200.193:60663 (error 108)
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":325,"threads_started":1}
Aug 07 04:17:08 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:08 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:08.116163 17968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:08.106776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.195:44119)
0807 04:17:08.107349 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:08.107366 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:08.107495 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:08.107814 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:08.107817 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:08.108271 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:08.108451 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:08.108463 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:08.109706 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:08.109711 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:08.110711 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:08.110724 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:08.111427 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:08.111431 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:08.111558 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:08.112278 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:08.112297 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:08.115919 (+ 3622us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":358,"threads_started":1}
W20260807 04:17:08.116539 17967 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:08.106956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:44119 (local address 127.7.200.254:40131)
0807 04:17:08.107206 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:08.107212 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:08.107453 (+ 241us) server_negotiation.cc:407] Connection header received
0807 04:17:08.107604 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:08.107607 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:08.107673 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:08.107757 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:08.108624 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:08.109575 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:08.110857 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:08.111287 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:08.111385 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:08.116290 (+ 4905us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.195:44119: BlockingRecv error: recv got EOF from 127.7.200.195:44119 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 07 04:17:08 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:08 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:08.398377 17969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:08.387393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.194:48835)
0807 04:17:08.388076 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:08.388095 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:08.388286 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:08.388800 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:08.388808 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:08.389383 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:08.389619 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:08.389630 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:08.390885 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:08.390893 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:08.392200 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:08.392214 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:08.393087 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:08.393093 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:08.393306 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:08.393961 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:08.393980 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:08.398049 (+ 4069us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":374,"threads_started":1}
W20260807 04:17:08.398666 17967 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:08.387588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:48835 (local address 127.7.200.254:40131)
0807 04:17:08.387910 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:08.387917 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:08.388206 (+ 289us) server_negotiation.cc:407] Connection header received
0807 04:17:08.388464 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:08.388510 (+ 46us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:08.388593 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:08.388724 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:08.389789 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:08.390736 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:08.392355 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:08.392908 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:08.393065 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:08.398381 (+ 5316us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.194:48835: BlockingRecv error: recv got EOF from 127.7.200.194:48835 (error 108)
Metrics: {"server-negotiator.queue_time_us":111}
Aug 07 04:17:08 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:08 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:08.916069 17970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:08.905964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.193:54573)
0807 04:17:08.906551 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:08.906568 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:08.906690 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:08.907100 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:08.907104 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:08.907517 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:08.907691 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:08.907700 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:08.909093 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:08.909097 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:08.910268 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:08.910283 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:08.911099 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:08.911105 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:08.911282 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:08.911972 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:08.911991 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:08.915758 (+ 3767us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":321,"threads_started":1}
W20260807 04:17:08.916272 17971 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:08.905997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:54573 (local address 127.7.200.254:40131)
0807 04:17:08.906556 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:08.906561 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:08.906649 (+ 88us) server_negotiation.cc:407] Connection header received
0807 04:17:08.906795 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:08.906799 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:08.906943 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:08.907041 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:08.907864 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:08.908860 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:08.910441 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:08.910883 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:08.911032 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:08.915992 (+ 4960us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.193:54573: BlockingRecv error: recv got EOF from 127.7.200.193:54573 (error 108)
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":306,"threads_started":1}
Aug 07 04:17:09 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:09 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:09.127619 17972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:09.117525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.195:35491)
0807 04:17:09.118096 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:09.118115 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:09.118249 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:09.118604 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:09.118608 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:09.119140 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:09.119344 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:09.119353 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:09.120426 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:09.120431 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:09.121506 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:09.121520 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:09.122484 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:09.122492 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:09.122698 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:09.123474 (+ 776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:09.123494 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:09.127347 (+ 3853us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":329,"threads_started":1}
W20260807 04:17:09.127979 17971 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:09.117572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:35491 (local address 127.7.200.254:40131)
0807 04:17:09.117774 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:09.117778 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:09.118236 (+ 458us) server_negotiation.cc:407] Connection header received
0807 04:17:09.118355 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:09.118358 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:09.118424 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:09.118545 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:09.119527 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:09.120282 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:09.121682 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:09.122276 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:09.122469 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:09.127574 (+ 5105us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.195:35491: BlockingRecv error: recv got EOF from 127.7.200.195:35491 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 07 04:17:09 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:09 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:09.409458 17973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:09.399460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.194:47689)
0807 04:17:09.400123 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:09.400139 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:09.400260 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:09.400631 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:09.400635 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:09.401073 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:09.401250 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:09.401258 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:09.402369 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:09.402379 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:09.403333 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:09.403345 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:09.404281 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:09.404287 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:09.404425 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:09.405119 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:09.405137 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:09.409096 (+ 3959us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":376,"threads_started":1}
W20260807 04:17:09.409617 17971 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:09.399504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:47689 (local address 127.7.200.254:40131)
0807 04:17:09.399715 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:09.399719 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:09.400245 (+ 526us) server_negotiation.cc:407] Connection header received
0807 04:17:09.400366 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:09.400370 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:09.400449 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:09.400540 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:09.401397 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:09.402184 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:09.403640 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:09.404103 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:09.404208 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:09.409363 (+ 5155us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.194:47689: BlockingRecv error: recv got EOF from 127.7.200.194:47689 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
Aug 07 04:17:09 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:09 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:09.927235 17974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:09.917285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.193:35847)
0807 04:17:09.917766 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:09.917784 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:09.917903 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:09.918387 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:09.918391 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:09.918853 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:09.919042 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:09.919052 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:09.919985 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:09.919989 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:09.920987 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:09.921001 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:09.921771 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:09.921775 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:09.921905 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:09.922653 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:09.922672 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:09.926870 (+ 4198us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":251,"threads_started":1}
W20260807 04:17:09.927544 17975 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:09.917387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:35847 (local address 127.7.200.254:40131)
0807 04:17:09.918096 (+ 709us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:09.918100 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:09.918116 (+ 16us) server_negotiation.cc:407] Connection header received
0807 04:17:09.918161 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:09.918165 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:09.918233 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:09.918318 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:09.919178 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:09.919857 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:09.921153 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:09.921629 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:09.921735 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:09.927108 (+ 5373us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.193:35847: BlockingRecv error: recv got EOF from 127.7.200.193:35847 (error 108)
Metrics: {"server-negotiator.queue_time_us":619,"thread_start_us":504,"threads_started":1}
Aug 07 04:17:10 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:10 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:10.139533 17976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:10.128673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.195:33237)
0807 04:17:10.129357 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:10.129374 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:10.129499 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:10.129894 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:10.129897 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:10.130360 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:10.130567 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:10.130577 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:10.132206 (+ 1629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:10.132210 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:10.133248 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:10.133261 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:10.134052 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:10.134058 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:10.134205 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:10.135008 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:10.135037 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:10.139270 (+ 4233us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":417,"threads_started":1}
W20260807 04:17:10.139778 17975 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:10.128830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:33237 (local address 127.7.200.254:40131)
0807 04:17:10.129010 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:10.129014 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:10.129465 (+ 451us) server_negotiation.cc:407] Connection header received
0807 04:17:10.129659 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:10.129663 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:10.129729 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:10.129827 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:10.130709 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:10.132052 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:10.133406 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:10.133832 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:10.133993 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:10.139503 (+ 5510us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.195:33237: BlockingRecv error: recv got EOF from 127.7.200.195:33237 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 07 04:17:10 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:10 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:10.421238 17977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:10.410673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.194:37525)
0807 04:17:10.411318 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:10.411337 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:10.411515 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:10.411931 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:10.411939 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:10.412441 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:10.412607 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:10.412617 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:10.413858 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:10.413864 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:10.414903 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:10.414915 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:10.415771 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:10.415779 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:10.415993 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:10.416618 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:10.416637 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:10.420851 (+ 4214us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":393,"threads_started":1}
W20260807 04:17:10.421469 17975 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:10.410944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:37525 (local address 127.7.200.254:40131)
0807 04:17:10.411213 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:10.411220 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:10.411434 (+ 214us) server_negotiation.cc:407] Connection header received
0807 04:17:10.411669 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:10.411675 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:10.411757 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:10.411874 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:10.412811 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:10.413686 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:10.415071 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:10.415581 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:10.415736 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:10.421108 (+ 5372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.194:37525: BlockingRecv error: recv got EOF from 127.7.200.194:37525 (error 108)
Metrics: {"server-negotiator.queue_time_us":100}
Aug 07 04:17:10 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:10 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.193@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:10.945657 17978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:10.928506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.193:40021)
0807 04:17:10.929168 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:10.929196 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:10.929339 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:10.929759 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:10.929764 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:10.930301 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:10.930532 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:10.930543 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:10.931565 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:10.931569 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:10.932501 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:10.932513 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:10.933303 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:10.933307 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:10.933428 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:10.940972 (+ 7544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:10.941001 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:10.945324 (+ 4323us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":290,"threads_started":1}
W20260807 04:17:10.945822 17979 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:10.928605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:40021 (local address 127.7.200.254:40131)
0807 04:17:10.929414 (+ 809us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:10.929420 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:10.929439 (+ 19us) server_negotiation.cc:407] Connection header received
0807 04:17:10.929502 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:10.929507 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:10.929592 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:10.929702 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:10.930691 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:10.931424 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:10.932640 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:10.933152 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:10.933246 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:10.945588 (+ 12342us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.193:40021: BlockingRecv error: recv got EOF from 127.7.200.193:40021 (error 108)
Metrics: {"server-negotiator.queue_time_us":692,"thread_start_us":592,"threads_started":1}
Aug 07 04:17:11 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:11 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.195@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:11.152026 17980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:11.140821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.195:38367)
0807 04:17:11.141561 (+ 740us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:11.141587 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:11.141756 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:11.142437 (+ 681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:11.142443 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:11.143063 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:11.143264 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:11.143280 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:11.144927 (+ 1647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:11.144931 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:11.146001 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:11.146015 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:11.146856 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:11.146861 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:11.147059 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:11.147742 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:11.147760 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:11.151682 (+ 3922us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":581,"thread_start_us":417,"threads_started":1}
W20260807 04:17:11.152222 17979 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:11.140930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:38367 (local address 127.7.200.254:40131)
0807 04:17:11.141317 (+ 387us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:11.141326 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:11.141722 (+ 396us) server_negotiation.cc:407] Connection header received
0807 04:17:11.142116 (+ 394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:11.142122 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:11.142221 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:11.142333 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:11.143472 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:11.144768 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:11.146180 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:11.146652 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:11.146781 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:11.151910 (+ 5129us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.195:38367: BlockingRecv error: recv got EOF from 127.7.200.195:38367 (error 108)
Metrics: {"server-negotiator.queue_time_us":168}
Aug 07 04:17:11 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 04:17:11 dist-test-slave-qg60 krb5kdc[16857](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.7.200.194@KRBTEST.COM for oryx/127.7.200.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 04:17:11.432799 17981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:11.422558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40131 (local address 127.7.200.194:56741)
0807 04:17:11.423193 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:11.423211 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:11.423326 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:11.423731 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:11.423736 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:11.424160 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:11.424358 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:11.424367 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:11.425512 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:11.425517 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:11.426541 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:11.426555 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:11.427414 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:11.427420 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:11.427604 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:11.428336 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:11.428356 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:11.432363 (+ 4007us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.7.200.254:40131: Server oryx/127.7.200.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":379,"threads_started":1}
W20260807 04:17:11.432933 17979 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:11.422681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:56741 (local address 127.7.200.254:40131)
0807 04:17:11.422861 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:11.422865 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:11.423311 (+ 446us) server_negotiation.cc:407] Connection header received
0807 04:17:11.423446 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:11.423450 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:11.423530 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:11.423626 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:11.424506 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:11.425358 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:11.426713 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:11.427227 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:11.427345 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:11.432601 (+ 5256us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.7.200.194:56741: BlockingRecv error: recv got EOF from 127.7.200.194:56741 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 04:17:11.834240 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 17482
I20260807 04:17:11.847791 17983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:11.835577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50980 (local address 127.7.200.193:37395)
0807 04:17:11.836277 (+ 700us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:11.836286 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:11.836313 (+ 27us) server_negotiation.cc:407] Connection header received
0807 04:17:11.836384 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:11.836390 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:11.836637 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:11.836890 (+ 253us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:11.838377 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:11.839402 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:11.840890 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:11.841496 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:11.841613 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:11.844185 (+ 2572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:17:11.844193 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:17:11.844208 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:17:11.844253 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:17:11.847229 (+ 2976us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.7.200.193@KRBTEST.COM not found in keytab (ticket kvno 2)
0807 04:17:11.847557 (+ 328us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50980: Request ticket server kudu/127.7.200.193@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":500,"thread_start_us":394,"threads_started":1}
W20260807 04:17:11.847924 17983 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50980: Request ticket server kudu/127.7.200.193@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260807 04:17:11.847944 7971 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 17482: Not authorized: Client connection negotiation failed: client connection to 127.7.200.193:37395: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.7.200.193@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260807 04:17:11.848182 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 17482
I20260807 04:17:11.869082 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 17642
I20260807 04:17:11.884543 17984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:11.870427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60766 (local address 127.7.200.194:41459)
0807 04:17:11.871216 (+ 789us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:11.871222 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:11.871253 (+ 31us) server_negotiation.cc:407] Connection header received
0807 04:17:11.871331 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:11.871338 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:11.871579 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:11.871791 (+ 212us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:11.874104 (+ 2313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:11.875254 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:11.876591 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:11.877399 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:11.877550 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:11.880820 (+ 3270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:17:11.880831 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:17:11.880846 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:17:11.880901 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:17:11.883867 (+ 2966us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.7.200.194@KRBTEST.COM not found in keytab (ticket kvno 2)
0807 04:17:11.884223 (+ 356us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60766: Request ticket server kudu/127.7.200.194@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":598,"thread_start_us":398,"threads_started":1}
W20260807 04:17:11.884694 17984 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60766: Request ticket server kudu/127.7.200.194@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260807 04:17:11.884826 7971 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 17642: Not authorized: Client connection negotiation failed: client connection to 127.7.200.194:41459: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.7.200.194@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260807 04:17:11.884995 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 17642
I20260807 04:17:11.907004 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 17785
I20260807 04:17:11.921363 17985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:11.908341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53942 (local address 127.7.200.195:42635)
0807 04:17:11.909100 (+ 759us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:11.909108 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:11.909134 (+ 26us) server_negotiation.cc:407] Connection header received
0807 04:17:11.909200 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:11.909207 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:11.909466 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:11.909727 (+ 261us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:11.911706 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:11.912948 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:11.914368 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:11.914960 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:11.915070 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:11.917904 (+ 2834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:17:11.917913 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:17:11.917927 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:17:11.918032 (+ 105us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:17:11.920700 (+ 2668us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.7.200.195@KRBTEST.COM not found in keytab (ticket kvno 2)
0807 04:17:11.921060 (+ 360us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53942: Request ticket server kudu/127.7.200.195@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":503,"thread_start_us":374,"threads_started":1}
W20260807 04:17:11.921475 17985 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53942: Request ticket server kudu/127.7.200.195@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260807 04:17:11.921507 7971 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 17785: Not authorized: Client connection negotiation failed: client connection to 127.7.200.195:42635: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.7.200.195@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260807 04:17:11.921736 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 17785
I20260807 04:17:11.941782 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 17409
I20260807 04:17:11.943311 17474 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:17:12.067674 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 17409
2026-08-07T04:17:12Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (22074 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-07T04:17:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:17:12Z Disabled control of system clock
I20260807 04:17:12.165479 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:46447
--webserver_interface=127.7.200.254
--webserver_port=0
--builtin_ntp_servers=127.7.200.212:34647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:46447
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 04:17:12.513602 17990 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:17:12.513907 17990 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:17:12.514053 17990 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:17:12.521615 17990 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:17:12.521744 17990 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:17:12.521811 17990 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:17:12.521901 17990 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:17:12.521975 17990 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:17:12.531536 17990 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:34647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:46447
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:46447
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:17:12.533077 17990 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:17:12.534963 17990 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:17:12.548005 17996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:17:12.547989 17997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:17:12.547942 17999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:17:12.548447 17990 server_base.cc:1034] running on GCE node
I20260807 04:17:12.549664 17990 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:17:12.551144 17990 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:17:12.552448 17990 hybrid_clock.cc:648] HybridClock initialized: now 1786076232552347 us; error 39 us; skew 500 ppm
I20260807 04:17:12.553015 17990 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 04:17:12.555632 17990 webserver.cc:460] Webserver started at http://127.7.200.254:37459/ using document root <none> and password file <none>
I20260807 04:17:12.556421 17990 fs_manager.cc:359] Metadata directory not provided
I20260807 04:17:12.556571 17990 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:17:12.557010 17990 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:17:12.560204 17990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "f3f823d8346f4bcab516c7a913e7dba5"
format_stamp: "Formatted at 2026-08-07 04:17:12 on dist-test-slave-qg60"
server_key: "e66480670cf495e9d01b4eeebb40a979"
server_key_iv: "66f4cbb619c01d51681de2f8c9d3d388"
server_key_version: "encryptionkey@0"
I20260807 04:17:12.561173 17990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "f3f823d8346f4bcab516c7a913e7dba5"
format_stamp: "Formatted at 2026-08-07 04:17:12 on dist-test-slave-qg60"
server_key: "e66480670cf495e9d01b4eeebb40a979"
server_key_iv: "66f4cbb619c01d51681de2f8c9d3d388"
server_key_version: "encryptionkey@0"
I20260807 04:17:12.567210 17990 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 04:17:12.571237 18005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:17:12.572789 17990 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 04:17:12.572999 17990 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "f3f823d8346f4bcab516c7a913e7dba5"
format_stamp: "Formatted at 2026-08-07 04:17:12 on dist-test-slave-qg60"
server_key: "e66480670cf495e9d01b4eeebb40a979"
server_key_iv: "66f4cbb619c01d51681de2f8c9d3d388"
server_key_version: "encryptionkey@0"
I20260807 04:17:12.573261 17990 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:17:12.590394 17990 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:17:12.591307 17990 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:17:12.591617 17990 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:17:12.613054 17990 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:46447
I20260807 04:17:12.613090 18061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:46447 every 8 connection(s)
I20260807 04:17:12.614902 17990 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:17:12.619748 18062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:17:12.624608 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 17990
I20260807 04:17:12.624859 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:17:12.625849 7971 external_mini_cluster.cc:1428] Setting key cc4eaa4d26debfc3fa3164c4916a8353
I20260807 04:17:12.633262 18062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3f823d8346f4bcab516c7a913e7dba5: Bootstrap starting.
I20260807 04:17:12.637313 18062 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f3f823d8346f4bcab516c7a913e7dba5: Neither blocks nor log segments found. Creating new log.
I20260807 04:17:12.638823 18062 log.cc:824] T 00000000000000000000000000000000 P f3f823d8346f4bcab516c7a913e7dba5: Log is configured to *not* fsync() on all Append() calls
I20260807 04:17:12.641390 18065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:12.628265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38432 (local address 127.7.200.254:46447)
0807 04:17:12.629358 (+ 1093us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:12.629369 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:12.629409 (+ 40us) server_negotiation.cc:407] Connection header received
0807 04:17:12.631413 (+ 2004us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:12.631436 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:12.631891 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:12.632225 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:12.633039 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:12.634360 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:12.636514 (+ 2154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:12.637277 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:12.637419 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:12.638777 (+ 1358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:17:12.638784 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:17:12.638797 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:17:12.639448 (+ 651us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:17:12.639594 (+ 146us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:17:12.639625 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:17:12.639759 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0807 04:17:12.640054 (+ 295us) server_negotiation.cc:299] Negotiation successful
0807 04:17:12.640388 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":680,"thread_start_us":436,"threads_started":1}
I20260807 04:17:12.642257 18062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3f823d8346f4bcab516c7a913e7dba5: No bootstrap required, opened a new log
I20260807 04:17:12.650727 18062 raft_consensus.cc:348] T 00000000000000000000000000000000 P f3f823d8346f4bcab516c7a913e7dba5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3f823d8346f4bcab516c7a913e7dba5" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 46447 } }
I20260807 04:17:12.651165 18062 raft_consensus.cc:374] T 00000000000000000000000000000000 P f3f823d8346f4bcab516c7a913e7dba5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:17:12.651309 18062 raft_consensus.cc:729] T 00000000000000000000000000000000 P f3f823d8346f4bcab516c7a913e7dba5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3f823d8346f4bcab516c7a913e7dba5, State: Initialized, Role: FOLLOWER
I20260807 04:17:12.651926 18062 consensus_queue.cc:260] T 00000000000000000000000000000000 P f3f823d8346f4bcab516c7a913e7dba5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3f823d8346f4bcab516c7a913e7dba5" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 46447 } }
I20260807 04:17:12.652174 18062 raft_consensus.cc:388] T 00000000000000000000000000000000 P f3f823d8346f4bcab516c7a913e7dba5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:17:12.652351 18062 raft_consensus.cc:482] T 00000000000000000000000000000000 P f3f823d8346f4bcab516c7a913e7dba5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:17:12.652570 18062 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f3f823d8346f4bcab516c7a913e7dba5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:17:12.655134 18062 raft_consensus.cc:504] T 00000000000000000000000000000000 P f3f823d8346f4bcab516c7a913e7dba5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3f823d8346f4bcab516c7a913e7dba5" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 46447 } }
I20260807 04:17:12.655730 18062 leader_election.cc:302] T 00000000000000000000000000000000 P f3f823d8346f4bcab516c7a913e7dba5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f3f823d8346f4bcab516c7a913e7dba5; no voters:
I20260807 04:17:12.656462 18062 leader_election.cc:288] T 00000000000000000000000000000000 P f3f823d8346f4bcab516c7a913e7dba5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:17:12.656621 18067 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f3f823d8346f4bcab516c7a913e7dba5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:17:12.657414 18067 raft_consensus.cc:686] T 00000000000000000000000000000000 P f3f823d8346f4bcab516c7a913e7dba5 [term 1 LEADER]: Becoming Leader. State: Replica: f3f823d8346f4bcab516c7a913e7dba5, State: Running, Role: LEADER
I20260807 04:17:12.658043 18067 consensus_queue.cc:237] T 00000000000000000000000000000000 P f3f823d8346f4bcab516c7a913e7dba5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3f823d8346f4bcab516c7a913e7dba5" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 46447 } }
I20260807 04:17:12.658882 18062 sys_catalog.cc:564] T 00000000000000000000000000000000 P f3f823d8346f4bcab516c7a913e7dba5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:17:12.661126 18070 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3f823d8346f4bcab516c7a913e7dba5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f3f823d8346f4bcab516c7a913e7dba5. Latest consensus state: current_term: 1 leader_uuid: "f3f823d8346f4bcab516c7a913e7dba5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3f823d8346f4bcab516c7a913e7dba5" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 46447 } } }
I20260807 04:17:12.661700 18070 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3f823d8346f4bcab516c7a913e7dba5 [sys.catalog]: This master's current role is: LEADER
I20260807 04:17:12.661295 18069 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3f823d8346f4bcab516c7a913e7dba5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f3f823d8346f4bcab516c7a913e7dba5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3f823d8346f4bcab516c7a913e7dba5" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 46447 } } }
I20260807 04:17:12.661952 18069 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3f823d8346f4bcab516c7a913e7dba5 [sys.catalog]: This master's current role is: LEADER
I20260807 04:17:12.665000 18076 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:17:12.669978 18076 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:17:12.679713 18076 catalog_manager.cc:1347] Generated new cluster ID: 96df507a3f034430ab4388709171a419
I20260807 04:17:12.679884 18076 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:17:12.709612 18076 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:17:12.711066 18076 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:17:12.717643 18076 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f3f823d8346f4bcab516c7a913e7dba5: Generated new TSK 0
I20260807 04:17:12.718621 18076 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:17:12.731542 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:0
--local_ip_for_outbound_sockets=127.7.200.193
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:46447
--builtin_ntp_servers=127.7.200.212:34647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260807 04:17:13.093053 18087 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:17:13.093334 18087 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:17:13.093474 18087 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:17:13.100767 18087 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:17:13.100912 18087 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:17:13.101080 18087 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:17:13.110155 18087 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:34647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:46447
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:17:13.111572 18087 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:17:13.113485 18087 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:17:13.128414 18094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:17:13.128482 18096 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:17:13.128486 18093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:17:13.133205 18087 server_base.cc:1034] running on GCE node
I20260807 04:17:13.133909 18087 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:17:13.134955 18087 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:17:13.136264 18087 hybrid_clock.cc:648] HybridClock initialized: now 1786076233136206 us; error 38 us; skew 500 ppm
I20260807 04:17:13.136646 18087 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 04:17:13.139286 18087 webserver.cc:460] Webserver started at http://127.7.200.193:37527/ using document root <none> and password file <none>
I20260807 04:17:13.140105 18087 fs_manager.cc:359] Metadata directory not provided
I20260807 04:17:13.140256 18087 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:17:13.140704 18087 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:17:13.144376 18087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/data/instance:
uuid: "d2f6da36010149b79a40d748bbce606a"
format_stamp: "Formatted at 2026-08-07 04:17:13 on dist-test-slave-qg60"
server_key: "e233f6a6af69a6ceb04cab431eb3cdf8"
server_key_iv: "685756f988e41066941b6567c715dc94"
server_key_version: "encryptionkey@0"
I20260807 04:17:13.145362 18087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance:
uuid: "d2f6da36010149b79a40d748bbce606a"
format_stamp: "Formatted at 2026-08-07 04:17:13 on dist-test-slave-qg60"
server_key: "e233f6a6af69a6ceb04cab431eb3cdf8"
server_key_iv: "685756f988e41066941b6567c715dc94"
server_key_version: "encryptionkey@0"
I20260807 04:17:13.151558 18087 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.005s
I20260807 04:17:13.155658 18102 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:17:13.157297 18087 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:17:13.157495 18087 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "d2f6da36010149b79a40d748bbce606a"
format_stamp: "Formatted at 2026-08-07 04:17:13 on dist-test-slave-qg60"
server_key: "e233f6a6af69a6ceb04cab431eb3cdf8"
server_key_iv: "685756f988e41066941b6567c715dc94"
server_key_version: "encryptionkey@0"
I20260807 04:17:13.157733 18087 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:17:13.177000 18087 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:17:13.177991 18087 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:17:13.178323 18087 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:17:13.179360 18087 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:17:13.180958 18087 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:17:13.181087 18087 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:17:13.181227 18087 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:17:13.181315 18087 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:17:13.216709 18087 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:37877
I20260807 04:17:13.216806 18216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:37877 every 8 connection(s)
I20260807 04:17:13.218115 18087 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:17:13.223579 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 18087
I20260807 04:17:13.223773 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance
I20260807 04:17:13.224406 7971 external_mini_cluster.cc:1428] Setting key c819dc8c85438ce49a6681693499e7d2
I20260807 04:17:13.227133 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:0
--local_ip_for_outbound_sockets=127.7.200.194
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:46447
--builtin_ntp_servers=127.7.200.212:34647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 04:17:13.231608 18219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:13.220909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:48355 (local address 127.7.200.254:46447)
0807 04:17:13.221396 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:13.221401 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:13.222647 (+ 1246us) server_negotiation.cc:407] Connection header received
0807 04:17:13.224661 (+ 2014us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:13.224666 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:13.224810 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:13.224945 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:13.226018 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:13.226753 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:13.228465 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:13.228946 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:13.229093 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:13.230621 (+ 1528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:17:13.230627 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:17:13.230631 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:17:13.230657 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:17:13.230701 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:17:13.230714 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:17:13.230828 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 04:17:13.231099 (+ 271us) server_negotiation.cc:299] Negotiation successful
0807 04:17:13.231211 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":249,"threads_started":1}
I20260807 04:17:13.232784 18220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:13.221571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:46447 (local address 127.7.200.193:48355)
0807 04:17:13.222481 (+ 910us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:13.222519 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:13.224339 (+ 1820us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:13.225181 (+ 842us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:13.225189 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:13.225276 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:13.225849 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:13.225866 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:13.226925 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:13.226930 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:13.228282 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:13.228299 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:13.229196 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:13.229203 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:13.229444 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:13.230216 (+ 772us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 04:17:13.230219 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:13.230263 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 04:17:13.230345 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:17:13.230826 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:17:13.230839 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:17:13.230850 (+ 11us) client_negotiation.cc:769] Sending connection context
0807 04:17:13.231068 (+ 218us) client_negotiation.cc:240] Negotiation successful
0807 04:17:13.231521 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":278,"threads_started":1}
I20260807 04:17:13.234670 18217 heartbeater.cc:347] Connected to a master server at 127.7.200.254:46447
I20260807 04:17:13.235008 18217 heartbeater.cc:464] Registering TS with master...
I20260807 04:17:13.235862 18217 heartbeater.cc:511] Master 127.7.200.254:46447 requested a full tablet report, sending...
I20260807 04:17:13.238552 18024 ts_manager.cc:194] Registered new tserver with Master: d2f6da36010149b79a40d748bbce606a (127.7.200.193:37877)
I20260807 04:17:13.240350 18024 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.200.193:48355
W20260807 04:17:13.583452 18221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:17:13.583796 18221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:17:13.583972 18221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:17:13.591564 18221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:17:13.591722 18221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:17:13.591909 18221 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:17:13.601619 18221 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:34647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:46447
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:17:13.603045 18221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:17:13.604961 18221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:17:13.618600 18226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:17:13.618604 18227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:17:13.618860 18229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:17:13.619350 18221 server_base.cc:1034] running on GCE node
I20260807 04:17:13.620337 18221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:17:13.621351 18221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:17:13.622622 18221 hybrid_clock.cc:648] HybridClock initialized: now 1786076233622553 us; error 56 us; skew 500 ppm
I20260807 04:17:13.623026 18221 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 04:17:13.625468 18221 webserver.cc:460] Webserver started at http://127.7.200.194:37171/ using document root <none> and password file <none>
I20260807 04:17:13.626230 18221 fs_manager.cc:359] Metadata directory not provided
I20260807 04:17:13.626372 18221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:17:13.626711 18221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:17:13.629729 18221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/data/instance:
uuid: "2671eb841111434b90e42ba8c3893f4f"
format_stamp: "Formatted at 2026-08-07 04:17:13 on dist-test-slave-qg60"
server_key: "054b032e0afb315dcf786c8cefbedbfb"
server_key_iv: "de78435a9003d0e7986990d032792e26"
server_key_version: "encryptionkey@0"
I20260807 04:17:13.630553 18221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance:
uuid: "2671eb841111434b90e42ba8c3893f4f"
format_stamp: "Formatted at 2026-08-07 04:17:13 on dist-test-slave-qg60"
server_key: "054b032e0afb315dcf786c8cefbedbfb"
server_key_iv: "de78435a9003d0e7986990d032792e26"
server_key_version: "encryptionkey@0"
I20260807 04:17:13.635785 18221 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 04:17:13.639583 18235 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:17:13.641096 18221 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 04:17:13.641283 18221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "2671eb841111434b90e42ba8c3893f4f"
format_stamp: "Formatted at 2026-08-07 04:17:13 on dist-test-slave-qg60"
server_key: "054b032e0afb315dcf786c8cefbedbfb"
server_key_iv: "de78435a9003d0e7986990d032792e26"
server_key_version: "encryptionkey@0"
I20260807 04:17:13.641510 18221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:17:13.655508 18221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:17:13.656431 18221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:17:13.656817 18221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:17:13.657814 18221 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:17:13.659459 18221 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:17:13.659585 18221 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:17:13.659723 18221 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:17:13.659827 18221 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:17:13.696188 18221 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:46453
I20260807 04:17:13.696277 18352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:46453 every 8 connection(s)
I20260807 04:17:13.697587 18221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:17:13.701063 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 18221
I20260807 04:17:13.701242 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance
I20260807 04:17:13.701987 7971 external_mini_cluster.cc:1428] Setting key 2f61290420d11b77e55246a6c594f1d1
I20260807 04:17:13.705435 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:0
--local_ip_for_outbound_sockets=127.7.200.195
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:46447
--builtin_ntp_servers=127.7.200.212:34647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 04:17:13.713274 18219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:13.700371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:43189 (local address 127.7.200.254:46447)
0807 04:17:13.700699 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:13.700707 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:13.702400 (+ 1693us) server_negotiation.cc:407] Connection header received
0807 04:17:13.704882 (+ 2482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:13.704886 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:13.704959 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:13.705062 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:13.706660 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:13.707378 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:13.710099 (+ 2721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:13.710534 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:13.710643 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:13.712381 (+ 1738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:17:13.712386 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:17:13.712389 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:17:13.712408 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:17:13.712439 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:17:13.712451 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:17:13.712528 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 04:17:13.712877 (+ 349us) server_negotiation.cc:299] Negotiation successful
0807 04:17:13.713026 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140}
I20260807 04:17:13.714872 18356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:13.700937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:46447 (local address 127.7.200.194:43189)
0807 04:17:13.702184 (+ 1247us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:13.702248 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:13.704498 (+ 2250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:13.705367 (+ 869us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:13.705382 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:13.705529 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:13.706453 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:13.706485 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:13.707543 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:13.707552 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:13.709918 (+ 2366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:13.709938 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:13.710782 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:13.710792 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:13.711144 (+ 352us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:13.711979 (+ 835us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 04:17:13.711985 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:13.712045 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 04:17:13.712160 (+ 115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:17:13.712559 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:17:13.712573 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:17:13.712585 (+ 12us) client_negotiation.cc:769] Sending connection context
0807 04:17:13.712836 (+ 251us) client_negotiation.cc:240] Negotiation successful
0807 04:17:13.713302 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":647,"thread_start_us":438,"threads_started":1}
I20260807 04:17:13.716432 18353 heartbeater.cc:347] Connected to a master server at 127.7.200.254:46447
I20260807 04:17:13.716805 18353 heartbeater.cc:464] Registering TS with master...
I20260807 04:17:13.717867 18353 heartbeater.cc:511] Master 127.7.200.254:46447 requested a full tablet report, sending...
I20260807 04:17:13.719501 18024 ts_manager.cc:194] Registered new tserver with Master: 2671eb841111434b90e42ba8c3893f4f (127.7.200.194:46453)
I20260807 04:17:13.720788 18024 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.200.194:43189
W20260807 04:17:14.053376 18357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:17:14.053659 18357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:17:14.053750 18357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:17:14.061218 18357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:17:14.061323 18357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:17:14.061474 18357 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:17:14.071318 18357 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:34647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:46447
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:17:14.072592 18357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:17:14.074401 18357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:17:14.088927 18365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:17:14.088994 18363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:17:14.088958 18362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:17:14.089797 18357 server_base.cc:1034] running on GCE node
I20260807 04:17:14.090462 18357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:17:14.091455 18357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:17:14.092680 18357 hybrid_clock.cc:648] HybridClock initialized: now 1786076234092615 us; error 49 us; skew 500 ppm
I20260807 04:17:14.093065 18357 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 04:17:14.095613 18357 webserver.cc:460] Webserver started at http://127.7.200.195:45181/ using document root <none> and password file <none>
I20260807 04:17:14.096364 18357 fs_manager.cc:359] Metadata directory not provided
I20260807 04:17:14.096457 18357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:17:14.096905 18357 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:17:14.100024 18357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/data/instance:
uuid: "b19247bb38444da899a5eda268ec58b2"
format_stamp: "Formatted at 2026-08-07 04:17:14 on dist-test-slave-qg60"
server_key: "636a2285403e75e31cf624430b0222cf"
server_key_iv: "ceb129e57241dcc109e700c82ee664df"
server_key_version: "encryptionkey@0"
I20260807 04:17:14.100939 18357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance:
uuid: "b19247bb38444da899a5eda268ec58b2"
format_stamp: "Formatted at 2026-08-07 04:17:14 on dist-test-slave-qg60"
server_key: "636a2285403e75e31cf624430b0222cf"
server_key_iv: "ceb129e57241dcc109e700c82ee664df"
server_key_version: "encryptionkey@0"
I20260807 04:17:14.106617 18357 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 04:17:14.110960 18371 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:17:14.112576 18357 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 04:17:14.112833 18357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "b19247bb38444da899a5eda268ec58b2"
format_stamp: "Formatted at 2026-08-07 04:17:14 on dist-test-slave-qg60"
server_key: "636a2285403e75e31cf624430b0222cf"
server_key_iv: "ceb129e57241dcc109e700c82ee664df"
server_key_version: "encryptionkey@0"
I20260807 04:17:14.113126 18357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:17:14.140623 18357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:17:14.141762 18357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:17:14.142107 18357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:17:14.143232 18357 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:17:14.145117 18357 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:17:14.145213 18357 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:17:14.145373 18357 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:17:14.145439 18357 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:17:14.182379 18357 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:45861
I20260807 04:17:14.182520 18489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:45861 every 8 connection(s)
I20260807 04:17:14.183760 18357 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:17:14.188861 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 18357
I20260807 04:17:14.189060 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance
I20260807 04:17:14.189544 7971 external_mini_cluster.cc:1428] Setting key 494008af6a145fc936dc0e69212808e5
I20260807 04:17:14.196846 18219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:14.186547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:46507 (local address 127.7.200.254:46447)
0807 04:17:14.186773 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:14.186778 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:14.188220 (+ 1442us) server_negotiation.cc:407] Connection header received
0807 04:17:14.190317 (+ 2097us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:14.190323 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:14.190428 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:14.190548 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:14.191609 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:14.192374 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:14.193980 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:14.194378 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:14.194526 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:14.195966 (+ 1440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:17:14.195971 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:17:14.195974 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:17:14.195994 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:17:14.196028 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:17:14.196040 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:17:14.196138 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 04:17:14.196371 (+ 233us) server_negotiation.cc:299] Negotiation successful
0807 04:17:14.196484 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260807 04:17:14.198006 18492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:14.187002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:46447 (local address 127.7.200.195:46507)
0807 04:17:14.187907 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:14.187995 (+ 88us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:14.190030 (+ 2035us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:14.190778 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:14.190786 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:14.190878 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:14.191438 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:14.191453 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:14.192559 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:14.192563 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:14.193818 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:14.193830 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:14.194619 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:14.194627 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:14.194863 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:14.195622 (+ 759us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 04:17:14.195625 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:14.195666 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 04:17:14.195750 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:17:14.196140 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:17:14.196155 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:17:14.196165 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 04:17:14.196357 (+ 192us) client_negotiation.cc:240] Negotiation successful
0807 04:17:14.196789 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":284,"threads_started":1}
I20260807 04:17:14.199558 18490 heartbeater.cc:347] Connected to a master server at 127.7.200.254:46447
I20260807 04:17:14.199898 18490 heartbeater.cc:464] Registering TS with master...
I20260807 04:17:14.200788 18490 heartbeater.cc:511] Master 127.7.200.254:46447 requested a full tablet report, sending...
I20260807 04:17:14.202324 18024 ts_manager.cc:194] Registered new tserver with Master: b19247bb38444da899a5eda268ec58b2 (127.7.200.195:45861)
I20260807 04:17:14.203315 18024 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.200.195:46507
I20260807 04:17:14.205298 7971 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 04:17:14.211719 18219 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:14.209903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36904 (local address 127.7.200.254:46447)
0807 04:17:14.210203 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:14.210211 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:14.210591 (+ 380us) server_negotiation.cc:407] Connection header received
0807 04:17:14.210813 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:14.210818 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:14.210901 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:14.211005 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:14.211458 (+ 453us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36904: BlockingRecv error: recv got EOF from 127.0.0.1:36904 (error 108)
Metrics: {"server-negotiator.queue_time_us":156}
I20260807 04:17:14.212431 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 18087
I20260807 04:17:14.221554 18499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:14.213452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60528 (local address 127.7.200.193:37877)
0807 04:17:14.214015 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:14.214022 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:14.214048 (+ 26us) server_negotiation.cc:407] Connection header received
0807 04:17:14.214116 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:14.214122 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:14.214327 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:14.214508 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:14.214921 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:14.216002 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:14.217483 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:14.218424 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:14.218555 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:14.219884 (+ 1329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:17:14.219894 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:17:14.219909 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:17:14.220634 (+ 725us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:17:14.220694 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:17:14.220721 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:17:14.220898 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0807 04:17:14.221043 (+ 145us) server_negotiation.cc:299] Negotiation successful
0807 04:17:14.221171 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":252,"threads_started":1}
I20260807 04:17:14.222854 18212 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:17:14.305613 18217 heartbeater.cc:503] Master 127.7.200.254:46447 was elected leader, sending a full tablet report...
I20260807 04:17:14.306890 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 18087
W20260807 04:17:14.326294 18010 connection.cc:535] server connection from 127.7.200.193:48355 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 04:17:14.326540 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 18221
I20260807 04:17:14.335148 18501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:14.327480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58458 (local address 127.7.200.194:46453)
0807 04:17:14.328064 (+ 584us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:14.328071 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:14.328101 (+ 30us) server_negotiation.cc:407] Connection header received
0807 04:17:14.328173 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:14.328179 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:14.328394 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:14.328541 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:14.329014 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:14.330036 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:14.331586 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:14.332261 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:14.332368 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:14.333698 (+ 1330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:17:14.333706 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:17:14.333720 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:17:14.334349 (+ 629us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:17:14.334397 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:17:14.334421 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:17:14.334524 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 04:17:14.334704 (+ 180us) server_negotiation.cc:299] Negotiation successful
0807 04:17:14.334836 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":308,"threads_started":1}
I20260807 04:17:14.336503 18347 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:17:14.419159 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 18221
I20260807 04:17:14.437889 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 18357
I20260807 04:17:14.446386 18503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:14.438915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32974 (local address 127.7.200.195:45861)
0807 04:17:14.439642 (+ 727us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:14.439650 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:14.439692 (+ 42us) server_negotiation.cc:407] Connection header received
0807 04:17:14.439755 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:14.439761 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:14.440017 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:14.440146 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:14.440647 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:14.441805 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:14.443057 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:14.443637 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:14.443744 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:14.444842 (+ 1098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:17:14.444851 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:17:14.444865 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:17:14.445522 (+ 657us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:17:14.445570 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:17:14.445589 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:17:14.445680 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 04:17:14.445846 (+ 166us) server_negotiation.cc:299] Negotiation successful
0807 04:17:14.446000 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":333,"threads_started":1}
I20260807 04:17:14.447821 18485 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:17:14.531868 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 18357
I20260807 04:17:14.551191 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 17990
I20260807 04:17:14.552642 18057 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:17:14.658809 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 17990
2026-08-07T04:17:14Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2583 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-07T04:17:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:17:14Z Disabled control of system clock
I20260807 04:17:14.745101 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:44197
--webserver_interface=127.7.200.254
--webserver_port=0
--builtin_ntp_servers=127.7.200.212:35101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:44197
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 04:17:15.087579 18509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:17:15.087885 18509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:17:15.087975 18509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:17:15.095414 18509 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:17:15.095538 18509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:17:15.095577 18509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:17:15.095628 18509 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:17:15.095674 18509 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:17:15.105445 18509 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:35101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:44197
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:44197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:17:15.106765 18509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:17:15.108564 18509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:17:15.120955 18517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:17:15.121024 18515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:17:15.121054 18514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:17:15.126497 18509 server_base.cc:1034] running on GCE node
I20260807 04:17:15.127453 18509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:17:15.129070 18509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:17:15.130336 18509 hybrid_clock.cc:648] HybridClock initialized: now 1786076235130288 us; error 39 us; skew 500 ppm
I20260807 04:17:15.130729 18509 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 04:17:15.133329 18509 webserver.cc:460] Webserver started at http://127.7.200.254:38259/ using document root <none> and password file <none>
I20260807 04:17:15.134080 18509 fs_manager.cc:359] Metadata directory not provided
I20260807 04:17:15.134220 18509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:17:15.134578 18509 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:17:15.137799 18509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "3b149899f6b042bc8106d119b58c348d"
format_stamp: "Formatted at 2026-08-07 04:17:15 on dist-test-slave-qg60"
server_key: "896f2196aaffc291c3982ddfae03c97a"
server_key_iv: "192b45dec1e9112fc8e5165baff775ad"
server_key_version: "encryptionkey@0"
I20260807 04:17:15.138650 18509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "3b149899f6b042bc8106d119b58c348d"
format_stamp: "Formatted at 2026-08-07 04:17:15 on dist-test-slave-qg60"
server_key: "896f2196aaffc291c3982ddfae03c97a"
server_key_iv: "192b45dec1e9112fc8e5165baff775ad"
server_key_version: "encryptionkey@0"
I20260807 04:17:15.144301 18509 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 04:17:15.148125 18523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:17:15.149612 18509 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:17:15.149809 18509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "3b149899f6b042bc8106d119b58c348d"
format_stamp: "Formatted at 2026-08-07 04:17:15 on dist-test-slave-qg60"
server_key: "896f2196aaffc291c3982ddfae03c97a"
server_key_iv: "192b45dec1e9112fc8e5165baff775ad"
server_key_version: "encryptionkey@0"
I20260807 04:17:15.150055 18509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:17:15.156432 18509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:17:15.157303 18509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:17:15.157620 18509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:17:15.177389 18509 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:44197
I20260807 04:17:15.177435 18576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:44197 every 8 connection(s)
I20260807 04:17:15.178865 18509 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:17:15.182808 18577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:17:15.184211 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 18509
I20260807 04:17:15.184456 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:17:15.185201 7971 external_mini_cluster.cc:1428] Setting key a3450bbc80d5e8bbe9b207f58429e350
I20260807 04:17:15.193758 18580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:15.187267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53270 (local address 127.7.200.254:44197)
0807 04:17:15.188369 (+ 1102us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:15.188379 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:15.188423 (+ 44us) server_negotiation.cc:407] Connection header received
0807 04:17:15.190143 (+ 1720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:15.190166 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:15.190565 (+ 399us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:15.190875 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:15.192079 (+ 1204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:17:15.192084 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:17:15.192096 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:17:15.192113 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:17:15.192176 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:17:15.192193 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:17:15.192370 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0807 04:17:15.192501 (+ 131us) server_negotiation.cc:299] Negotiation successful
0807 04:17:15.192841 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":671,"thread_start_us":430,"threads_started":1}
I20260807 04:17:15.195408 18577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b149899f6b042bc8106d119b58c348d: Bootstrap starting.
I20260807 04:17:15.198554 18577 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b149899f6b042bc8106d119b58c348d: Neither blocks nor log segments found. Creating new log.
I20260807 04:17:15.199558 18577 log.cc:824] T 00000000000000000000000000000000 P 3b149899f6b042bc8106d119b58c348d: Log is configured to *not* fsync() on all Append() calls
I20260807 04:17:15.202821 18577 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b149899f6b042bc8106d119b58c348d: No bootstrap required, opened a new log
I20260807 04:17:15.210501 18577 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b149899f6b042bc8106d119b58c348d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b149899f6b042bc8106d119b58c348d" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44197 } }
I20260807 04:17:15.210853 18577 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3b149899f6b042bc8106d119b58c348d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:17:15.210932 18577 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b149899f6b042bc8106d119b58c348d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b149899f6b042bc8106d119b58c348d, State: Initialized, Role: FOLLOWER
I20260807 04:17:15.211581 18577 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b149899f6b042bc8106d119b58c348d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b149899f6b042bc8106d119b58c348d" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44197 } }
I20260807 04:17:15.211843 18577 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3b149899f6b042bc8106d119b58c348d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:17:15.212042 18577 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3b149899f6b042bc8106d119b58c348d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:17:15.212211 18577 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b149899f6b042bc8106d119b58c348d [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:17:15.214483 18577 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3b149899f6b042bc8106d119b58c348d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b149899f6b042bc8106d119b58c348d" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44197 } }
I20260807 04:17:15.214993 18577 leader_election.cc:302] T 00000000000000000000000000000000 P 3b149899f6b042bc8106d119b58c348d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3b149899f6b042bc8106d119b58c348d; no voters:
I20260807 04:17:15.215658 18577 leader_election.cc:288] T 00000000000000000000000000000000 P 3b149899f6b042bc8106d119b58c348d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:17:15.215832 18582 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3b149899f6b042bc8106d119b58c348d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:17:15.216974 18582 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3b149899f6b042bc8106d119b58c348d [term 1 LEADER]: Becoming Leader. State: Replica: 3b149899f6b042bc8106d119b58c348d, State: Running, Role: LEADER
I20260807 04:17:15.217489 18582 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3b149899f6b042bc8106d119b58c348d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b149899f6b042bc8106d119b58c348d" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44197 } }
I20260807 04:17:15.217869 18577 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b149899f6b042bc8106d119b58c348d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:17:15.220232 18585 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b149899f6b042bc8106d119b58c348d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b149899f6b042bc8106d119b58c348d. Latest consensus state: current_term: 1 leader_uuid: "3b149899f6b042bc8106d119b58c348d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b149899f6b042bc8106d119b58c348d" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44197 } } }
I20260807 04:17:15.220646 18585 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b149899f6b042bc8106d119b58c348d [sys.catalog]: This master's current role is: LEADER
I20260807 04:17:15.220257 18583 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b149899f6b042bc8106d119b58c348d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3b149899f6b042bc8106d119b58c348d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b149899f6b042bc8106d119b58c348d" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44197 } } }
I20260807 04:17:15.221829 18583 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b149899f6b042bc8106d119b58c348d [sys.catalog]: This master's current role is: LEADER
I20260807 04:17:15.224264 18588 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:17:15.230159 18588 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:17:15.240705 18588 catalog_manager.cc:1347] Generated new cluster ID: 25b2ba8f812e4acc9af581113b13ace6
I20260807 04:17:15.240891 18588 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:17:15.255412 18588 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:17:15.255927 18588 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:17:15.276104 18588 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3b149899f6b042bc8106d119b58c348d: Generated new TSK 0
I20260807 04:17:15.277091 18588 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:17:15.291777 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:0
--local_ip_for_outbound_sockets=127.7.200.193
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:44197
--builtin_ntp_servers=127.7.200.212:35101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 04:17:15.642897 18603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:17:15.643236 18603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:17:15.643404 18603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:17:15.651124 18603 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:17:15.651269 18603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:17:15.651501 18603 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:17:15.661185 18603 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:35101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:44197
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:17:15.662572 18603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:17:15.664397 18603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:17:15.678850 18608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:17:15.678929 18609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:17:15.678926 18612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:17:15.679700 18603 server_base.cc:1034] running on GCE node
I20260807 04:17:15.680333 18603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:17:15.681423 18603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:17:15.682632 18603 hybrid_clock.cc:648] HybridClock initialized: now 1786076235682579 us; error 42 us; skew 500 ppm
I20260807 04:17:15.682967 18603 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 04:17:15.685554 18603 webserver.cc:460] Webserver started at http://127.7.200.193:41793/ using document root <none> and password file <none>
I20260807 04:17:15.686269 18603 fs_manager.cc:359] Metadata directory not provided
I20260807 04:17:15.686389 18603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:17:15.686759 18603 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:17:15.689765 18603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/data/instance:
uuid: "63df925bc5f74c34b07c8e71f0056a88"
format_stamp: "Formatted at 2026-08-07 04:17:15 on dist-test-slave-qg60"
server_key: "3dfb1df619029c26f6c52c3c7b516df4"
server_key_iv: "9f4b8f9a40cc4f0ae05a2c4d564ff2e8"
server_key_version: "encryptionkey@0"
I20260807 04:17:15.690613 18603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance:
uuid: "63df925bc5f74c34b07c8e71f0056a88"
format_stamp: "Formatted at 2026-08-07 04:17:15 on dist-test-slave-qg60"
server_key: "3dfb1df619029c26f6c52c3c7b516df4"
server_key_iv: "9f4b8f9a40cc4f0ae05a2c4d564ff2e8"
server_key_version: "encryptionkey@0"
I20260807 04:17:15.696496 18603 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260807 04:17:15.700057 18619 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:17:15.701611 18603 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:17:15.701803 18603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "63df925bc5f74c34b07c8e71f0056a88"
format_stamp: "Formatted at 2026-08-07 04:17:15 on dist-test-slave-qg60"
server_key: "3dfb1df619029c26f6c52c3c7b516df4"
server_key_iv: "9f4b8f9a40cc4f0ae05a2c4d564ff2e8"
server_key_version: "encryptionkey@0"
I20260807 04:17:15.702124 18603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:17:15.707826 18603 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:17:15.708593 18603 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:17:15.708956 18603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:17:15.709889 18603 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:17:15.711262 18603 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:17:15.711349 18603 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:17:15.711432 18603 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:17:15.711490 18603 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:17:15.746733 18603 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:44573
I20260807 04:17:15.746836 18735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:44573 every 8 connection(s)
I20260807 04:17:15.748090 18603 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:17:15.753346 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 18603
I20260807 04:17:15.753568 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance
I20260807 04:17:15.754287 7971 external_mini_cluster.cc:1428] Setting key 17d137dc3328b60cdcef0616517b47de
I20260807 04:17:15.757747 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:0
--local_ip_for_outbound_sockets=127.7.200.194
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:44197
--builtin_ntp_servers=127.7.200.212:35101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260807 04:17:15.758020 18738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:15.750921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:52619 (local address 127.7.200.254:44197)
0807 04:17:15.751484 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:15.751489 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:15.752687 (+ 1198us) server_negotiation.cc:407] Connection header received
0807 04:17:15.755057 (+ 2370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:15.755062 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:15.755170 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:15.755293 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:15.757126 (+ 1833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:17:15.757130 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:17:15.757133 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:17:15.757149 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:17:15.757191 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:17:15.757204 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:17:15.757307 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0807 04:17:15.757596 (+ 289us) server_negotiation.cc:299] Negotiation successful
0807 04:17:15.757651 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":316,"threads_started":1}
I20260807 04:17:15.759155 18739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:15.751504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:44197 (local address 127.7.200.193:52619)
0807 04:17:15.752509 (+ 1005us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:15.752549 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:15.754684 (+ 2135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:15.755714 (+ 1030us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:15.755726 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:15.755844 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:15.756681 (+ 837us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 04:17:15.756685 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:15.756733 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 04:17:15.756884 (+ 151us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:17:15.757312 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:17:15.757325 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:17:15.757336 (+ 11us) client_negotiation.cc:769] Sending connection context
0807 04:17:15.757628 (+ 292us) client_negotiation.cc:240] Negotiation successful
0807 04:17:15.757901 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":304,"threads_started":1}
I20260807 04:17:15.760844 18736 heartbeater.cc:347] Connected to a master server at 127.7.200.254:44197
I20260807 04:17:15.761174 18736 heartbeater.cc:464] Registering TS with master...
I20260807 04:17:15.761772 18736 heartbeater.cc:511] Master 127.7.200.254:44197 requested a full tablet report, sending...
I20260807 04:17:15.763748 18541 ts_manager.cc:194] Registered new tserver with Master: 63df925bc5f74c34b07c8e71f0056a88 (127.7.200.193:44573)
W20260807 04:17:16.103168 18740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:17:16.103468 18740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:17:16.103655 18740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:17:16.111168 18740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:17:16.111279 18740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:17:16.111466 18740 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:17:16.121268 18740 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:35101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:44197
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:17:16.122581 18740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:17:16.124411 18740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:17:16.139237 18745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:17:16.139343 18746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:17:16.139462 18748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:17:16.140254 18740 server_base.cc:1034] running on GCE node
I20260807 04:17:16.140962 18740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:17:16.141973 18740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:17:16.143184 18740 hybrid_clock.cc:648] HybridClock initialized: now 1786076236143113 us; error 55 us; skew 500 ppm
I20260807 04:17:16.143515 18740 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 04:17:16.151510 18740 webserver.cc:460] Webserver started at http://127.7.200.194:36313/ using document root <none> and password file <none>
I20260807 04:17:16.152307 18740 fs_manager.cc:359] Metadata directory not provided
I20260807 04:17:16.152405 18740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:17:16.152868 18740 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:17:16.156162 18740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/data/instance:
uuid: "5b8c259febb04397a3b9092bb70f01e4"
format_stamp: "Formatted at 2026-08-07 04:17:16 on dist-test-slave-qg60"
server_key: "04f2f24bf372f0fcb21223551317f384"
server_key_iv: "7d3a2c35a40ea89b91ed561584165759"
server_key_version: "encryptionkey@0"
I20260807 04:17:16.157274 18740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance:
uuid: "5b8c259febb04397a3b9092bb70f01e4"
format_stamp: "Formatted at 2026-08-07 04:17:16 on dist-test-slave-qg60"
server_key: "04f2f24bf372f0fcb21223551317f384"
server_key_iv: "7d3a2c35a40ea89b91ed561584165759"
server_key_version: "encryptionkey@0"
I20260807 04:17:16.162808 18740 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260807 04:17:16.166714 18754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:17:16.168282 18740 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 04:17:16.168462 18740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "5b8c259febb04397a3b9092bb70f01e4"
format_stamp: "Formatted at 2026-08-07 04:17:16 on dist-test-slave-qg60"
server_key: "04f2f24bf372f0fcb21223551317f384"
server_key_iv: "7d3a2c35a40ea89b91ed561584165759"
server_key_version: "encryptionkey@0"
I20260807 04:17:16.168715 18740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:17:16.174916 18740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:17:16.175819 18740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:17:16.176119 18740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:17:16.177398 18740 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:17:16.178963 18740 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:17:16.179054 18740 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:17:16.179211 18740 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:17:16.179320 18740 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:17:16.217182 18740 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:42525
I20260807 04:17:16.217279 18870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:42525 every 8 connection(s)
I20260807 04:17:16.218695 18740 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:17:16.227522 18738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:16.221539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:56797 (local address 127.7.200.254:44197)
0807 04:17:16.221764 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:16.221769 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:16.223164 (+ 1395us) server_negotiation.cc:407] Connection header received
0807 04:17:16.225069 (+ 1905us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:16.225075 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:16.225159 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:16.225272 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:16.226701 (+ 1429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:17:16.226707 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:17:16.226712 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:17:16.226741 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:17:16.226775 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:17:16.226788 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:17:16.227004 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0807 04:17:16.227148 (+ 144us) server_negotiation.cc:299] Negotiation successful
0807 04:17:16.227225 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260807 04:17:16.228544 18873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:16.222073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:44197 (local address 127.7.200.194:56797)
0807 04:17:16.223006 (+ 933us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:16.223042 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:16.224793 (+ 1751us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:16.225529 (+ 736us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:16.225538 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:16.225631 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:16.226372 (+ 741us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 04:17:16.226374 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:16.226431 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 04:17:16.226520 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:17:16.226891 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:17:16.226902 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:17:16.226910 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 04:17:16.227228 (+ 318us) client_negotiation.cc:240] Negotiation successful
0807 04:17:16.227505 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":308,"threads_started":1}
I20260807 04:17:16.228834 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 18740
I20260807 04:17:16.229075 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance
I20260807 04:17:16.229548 7971 external_mini_cluster.cc:1428] Setting key 2ed8d861d958dad69838097f393dd9ae
I20260807 04:17:16.230144 18871 heartbeater.cc:347] Connected to a master server at 127.7.200.254:44197
I20260807 04:17:16.230515 18871 heartbeater.cc:464] Registering TS with master...
I20260807 04:17:16.231156 18871 heartbeater.cc:511] Master 127.7.200.254:44197 requested a full tablet report, sending...
I20260807 04:17:16.232538 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:0
--local_ip_for_outbound_sockets=127.7.200.195
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:44197
--builtin_ntp_servers=127.7.200.212:35101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260807 04:17:16.232887 18541 ts_manager.cc:194] Registered new tserver with Master: 5b8c259febb04397a3b9092bb70f01e4 (127.7.200.194:42525)
W20260807 04:17:16.578650 18874 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:17:16.578958 18874 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:17:16.579109 18874 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:17:16.586591 18874 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:17:16.586694 18874 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:17:16.586884 18874 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:17:16.596626 18874 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:35101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:44197
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:17:16.597998 18874 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:17:16.600225 18874 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:17:16.614223 18879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:17:16.614265 18880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:17:16.614176 18882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:17:16.615082 18874 server_base.cc:1034] running on GCE node
I20260807 04:17:16.615692 18874 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:17:16.616643 18874 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:17:16.617874 18874 hybrid_clock.cc:648] HybridClock initialized: now 1786076236617819 us; error 48 us; skew 500 ppm
I20260807 04:17:16.618252 18874 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 04:17:16.620604 18874 webserver.cc:460] Webserver started at http://127.7.200.195:40913/ using document root <none> and password file <none>
I20260807 04:17:16.621393 18874 fs_manager.cc:359] Metadata directory not provided
I20260807 04:17:16.621529 18874 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:17:16.621863 18874 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:17:16.624871 18874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/data/instance:
uuid: "ff6aaba4d5d744efb2e7104f7f9b2d35"
format_stamp: "Formatted at 2026-08-07 04:17:16 on dist-test-slave-qg60"
server_key: "52b56697081a1512883a59fedd354cd3"
server_key_iv: "528792332b1ccdafff52b31ba5446bfb"
server_key_version: "encryptionkey@0"
I20260807 04:17:16.625785 18874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance:
uuid: "ff6aaba4d5d744efb2e7104f7f9b2d35"
format_stamp: "Formatted at 2026-08-07 04:17:16 on dist-test-slave-qg60"
server_key: "52b56697081a1512883a59fedd354cd3"
server_key_iv: "528792332b1ccdafff52b31ba5446bfb"
server_key_version: "encryptionkey@0"
I20260807 04:17:16.631280 18874 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 04:17:16.635176 18888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:17:16.636487 18874 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 04:17:16.636670 18874 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "ff6aaba4d5d744efb2e7104f7f9b2d35"
format_stamp: "Formatted at 2026-08-07 04:17:16 on dist-test-slave-qg60"
server_key: "52b56697081a1512883a59fedd354cd3"
server_key_iv: "528792332b1ccdafff52b31ba5446bfb"
server_key_version: "encryptionkey@0"
I20260807 04:17:16.636976 18874 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:17:16.642612 18874 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:17:16.643410 18874 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:17:16.643688 18874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:17:16.644625 18874 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:17:16.646118 18874 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:17:16.646243 18874 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:17:16.646379 18874 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:17:16.646467 18874 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:17:16.682268 18874 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:41781
I20260807 04:17:16.682322 19004 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:41781 every 8 connection(s)
I20260807 04:17:16.683634 18874 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:17:16.691884 18738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:16.686332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:33283 (local address 127.7.200.254:44197)
0807 04:17:16.686557 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:16.686564 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:16.688050 (+ 1486us) server_negotiation.cc:407] Connection header received
0807 04:17:16.689788 (+ 1738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:16.689794 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:16.689852 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:16.689951 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:16.691239 (+ 1288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:17:16.691243 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:17:16.691246 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:17:16.691262 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:17:16.691295 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:17:16.691308 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:17:16.691410 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 04:17:16.691597 (+ 187us) server_negotiation.cc:299] Negotiation successful
0807 04:17:16.691651 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 04:17:16.692854 19007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:16.686963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:44197 (local address 127.7.200.195:33283)
0807 04:17:16.687886 (+ 923us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:16.687921 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:16.689530 (+ 1609us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:16.690146 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:16.690153 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:16.690236 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:16.690956 (+ 720us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 04:17:16.690958 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:16.690998 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 04:17:16.691079 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:17:16.691397 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:17:16.691404 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:17:16.691409 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 04:17:16.691643 (+ 234us) client_negotiation.cc:240] Negotiation successful
0807 04:17:16.691829 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":286,"threads_started":1}
I20260807 04:17:16.693166 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 18874
I20260807 04:17:16.693367 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance
I20260807 04:17:16.694006 7971 external_mini_cluster.cc:1428] Setting key 789f4cbd22303f38a21073d4f71f66f9
I20260807 04:17:16.694396 19005 heartbeater.cc:347] Connected to a master server at 127.7.200.254:44197
I20260807 04:17:16.694727 19005 heartbeater.cc:464] Registering TS with master...
I20260807 04:17:16.695384 19005 heartbeater.cc:511] Master 127.7.200.254:44197 requested a full tablet report, sending...
I20260807 04:17:16.697099 18540 ts_manager.cc:194] Registered new tserver with Master: ff6aaba4d5d744efb2e7104f7f9b2d35 (127.7.200.195:41781)
I20260807 04:17:16.709941 7971 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 04:17:16.716368 18738 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:17:16.714652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53274 (local address 127.7.200.254:44197)
0807 04:17:16.714873 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:16.714880 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:16.715429 (+ 549us) server_negotiation.cc:407] Connection header received
0807 04:17:16.715564 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:16.715569 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:16.715626 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:16.715699 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:16.716138 (+ 439us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53274: BlockingRecv error: recv got EOF from 127.0.0.1:53274 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 04:17:16.717278 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 18603
I20260807 04:17:16.720934 19015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:16.718280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55272 (local address 127.7.200.193:44573)
0807 04:17:16.718890 (+ 610us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:16.718896 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:16.718921 (+ 25us) server_negotiation.cc:407] Connection header received
0807 04:17:16.718988 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:16.718994 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:16.719212 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:16.719335 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:16.720229 (+ 894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:17:16.720235 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:17:16.720247 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:17:16.720266 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:17:16.720306 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:17:16.720321 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:17:16.720423 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 04:17:16.720535 (+ 112us) server_negotiation.cc:299] Negotiation successful
0807 04:17:16.720616 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":476,"thread_start_us":282,"threads_started":1}
I20260807 04:17:16.722234 18731 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:17:16.807443 18736 heartbeater.cc:503] Master 127.7.200.254:44197 was elected leader, sending a full tablet report...
I20260807 04:17:16.809136 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 18603
W20260807 04:17:16.827683 18524 connection.cc:535] server connection from 127.7.200.193:52619 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 04:17:16.828044 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 18740
I20260807 04:17:16.831897 19017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:16.829136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39176 (local address 127.7.200.194:42525)
0807 04:17:16.829650 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:16.829657 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:16.829683 (+ 26us) server_negotiation.cc:407] Connection header received
0807 04:17:16.829747 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:16.829753 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:16.829979 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:16.830151 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:16.831167 (+ 1016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:17:16.831172 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:17:16.831184 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:17:16.831202 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:17:16.831240 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:17:16.831254 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:17:16.831401 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 04:17:16.831534 (+ 133us) server_negotiation.cc:299] Negotiation successful
0807 04:17:16.831639 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":259,"threads_started":1}
I20260807 04:17:16.833166 18866 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:17:16.915978 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 18740
I20260807 04:17:16.935599 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 18874
I20260807 04:17:16.940336 19019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:16.936834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56512 (local address 127.7.200.195:41781)
0807 04:17:16.937653 (+ 819us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:16.937670 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:16.937704 (+ 34us) server_negotiation.cc:407] Connection header received
0807 04:17:16.937775 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:16.937781 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:16.938024 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:16.938162 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:16.939411 (+ 1249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:17:16.939418 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:17:16.939430 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:17:16.939448 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:17:16.939499 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:17:16.939516 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:17:16.939666 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 04:17:16.939862 (+ 196us) server_negotiation.cc:299] Negotiation successful
0807 04:17:16.940023 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":653,"thread_start_us":467,"threads_started":1}
I20260807 04:17:16.941804 19000 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:17:17.025895 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 18874
I20260807 04:17:17.045264 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 18509
I20260807 04:17:17.046639 18572 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:17:17.152114 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 18509
2026-08-07T04:17:17Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2494 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:17:17 dist-test-slave-qg60 krb5kdc[19024](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:17:17 dist-test-slave-qg60 krb5kdc[19024](info): set up 2 sockets
Aug 07 04:17:17 dist-test-slave-qg60 krb5kdc[19024](info): commencing operation
krb5kdc: starting...
W20260807 04:17:18.318817 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.003s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:17:18 dist-test-slave-qg60 krb5kdc[19024](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076238, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:17:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:17:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
I20260807 04:17:18.616920 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:42673
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:37295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:42673
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:17:18.961658 19037 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:17:18.961956 19037 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:17:18.962087 19037 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:17:18.969463 19037 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:17:18.969585 19037 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:17:18.969679 19037 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:17:18.969786 19037 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:17:18.969864 19037 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:17:18.980043 19037 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:37295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:42673
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:42673
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:17:18.981523 19037 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:17:18.982899 19037 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:17:18.995266 19043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:17:18.995354 19045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:17:18.995332 19042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:17:18.995976 19037 server_base.cc:1034] running on GCE node
I20260807 04:17:18.996978 19037 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:17:18.998572 19037 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:17:18.999835 19037 hybrid_clock.cc:648] HybridClock initialized: now 1786076238999732 us; error 80 us; skew 500 ppm
I20260807 04:17:19.000259 19037 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:17:18 dist-test-slave-qg60 krb5kdc[19024](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076238, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:17:19.003903 19037 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:17:19.006120 19037 webserver.cc:460] Webserver started at http://127.7.200.254:34011/ using document root <none> and password file <none>
I20260807 04:17:19.007191 19037 fs_manager.cc:359] Metadata directory not provided
I20260807 04:17:19.007432 19037 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:17:19.007858 19037 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:17:19.011633 19037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "977b6a376fed469d926b69097af22b2b"
format_stamp: "Formatted at 2026-08-07 04:17:19 on dist-test-slave-qg60"
server_key: "48db7f23f2a9063d6505790a27ba3196"
server_key_iv: "640367573e8eec0d10beb3160ed99ce7"
server_key_version: "encryptionkey@0"
I20260807 04:17:19.012460 19037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "977b6a376fed469d926b69097af22b2b"
format_stamp: "Formatted at 2026-08-07 04:17:19 on dist-test-slave-qg60"
server_key: "48db7f23f2a9063d6505790a27ba3196"
server_key_iv: "640367573e8eec0d10beb3160ed99ce7"
server_key_version: "encryptionkey@0"
I20260807 04:17:19.018301 19037 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 04:17:19.022251 19052 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:17:19.023713 19037 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:17:19.023926 19037 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "977b6a376fed469d926b69097af22b2b"
format_stamp: "Formatted at 2026-08-07 04:17:19 on dist-test-slave-qg60"
server_key: "48db7f23f2a9063d6505790a27ba3196"
server_key_iv: "640367573e8eec0d10beb3160ed99ce7"
server_key_version: "encryptionkey@0"
I20260807 04:17:19.024147 19037 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:17:19.039314 19037 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:17:19.044127 19037 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:17:19.044436 19037 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:17:19.063702 19037 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:42673
I20260807 04:17:19.063753 19106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:42673 every 8 connection(s)
I20260807 04:17:19.065246 19037 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:17:19.067262 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 19037
I20260807 04:17:19.067549 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:17:19.068234 7971 external_mini_cluster.cc:1428] Setting key 62f15509d8832c174f2f53200d901bbc
I20260807 04:17:19.069344 19107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 04:17:19 dist-test-slave-qg60 krb5kdc[19024](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076238, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:17:19.084259 19107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 977b6a376fed469d926b69097af22b2b: Bootstrap starting.
I20260807 04:17:19.088500 19107 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 977b6a376fed469d926b69097af22b2b: Neither blocks nor log segments found. Creating new log.
I20260807 04:17:19.090018 19107 log.cc:824] T 00000000000000000000000000000000 P 977b6a376fed469d926b69097af22b2b: Log is configured to *not* fsync() on all Append() calls
I20260807 04:17:19.093179 19107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 977b6a376fed469d926b69097af22b2b: No bootstrap required, opened a new log
I20260807 04:17:19.094342 19110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:19.070605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39254 (local address 127.7.200.254:42673)
0807 04:17:19.071442 (+ 837us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:19.071459 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:19.071510 (+ 51us) server_negotiation.cc:407] Connection header received
0807 04:17:19.073343 (+ 1833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:19.073373 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:19.073924 (+ 551us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:19.074374 (+ 450us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:19.075959 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:19.078078 (+ 2119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:19.079405 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:19.080440 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:19.080651 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:19.085395 (+ 4744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:17:19.085406 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:17:19.085424 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:17:19.085472 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:17:19.089761 (+ 4289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:17:19.090723 (+ 962us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:17:19.090734 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:17:19.090741 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:17:19.090945 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:17:19.091374 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:17:19.091380 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:17:19.091385 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:17:19.091956 (+ 571us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:17:19.092296 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0807 04:17:19.092791 (+ 495us) server_negotiation.cc:299] Negotiation successful
0807 04:17:19.093277 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":348,"threads_started":1}
I20260807 04:17:19.101620 19107 raft_consensus.cc:348] T 00000000000000000000000000000000 P 977b6a376fed469d926b69097af22b2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "977b6a376fed469d926b69097af22b2b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42673 } }
I20260807 04:17:19.102025 19107 raft_consensus.cc:374] T 00000000000000000000000000000000 P 977b6a376fed469d926b69097af22b2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:17:19.102136 19107 raft_consensus.cc:729] T 00000000000000000000000000000000 P 977b6a376fed469d926b69097af22b2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 977b6a376fed469d926b69097af22b2b, State: Initialized, Role: FOLLOWER
I20260807 04:17:19.102754 19107 consensus_queue.cc:260] T 00000000000000000000000000000000 P 977b6a376fed469d926b69097af22b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "977b6a376fed469d926b69097af22b2b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42673 } }
I20260807 04:17:19.102996 19107 raft_consensus.cc:388] T 00000000000000000000000000000000 P 977b6a376fed469d926b69097af22b2b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:17:19.103143 19107 raft_consensus.cc:482] T 00000000000000000000000000000000 P 977b6a376fed469d926b69097af22b2b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:17:19.103324 19107 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 977b6a376fed469d926b69097af22b2b [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:17:19.105697 19107 raft_consensus.cc:504] T 00000000000000000000000000000000 P 977b6a376fed469d926b69097af22b2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "977b6a376fed469d926b69097af22b2b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42673 } }
I20260807 04:17:19.106285 19107 leader_election.cc:302] T 00000000000000000000000000000000 P 977b6a376fed469d926b69097af22b2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 977b6a376fed469d926b69097af22b2b; no voters:
I20260807 04:17:19.107124 19107 leader_election.cc:288] T 00000000000000000000000000000000 P 977b6a376fed469d926b69097af22b2b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:17:19.107224 19112 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 977b6a376fed469d926b69097af22b2b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:17:19.107933 19112 raft_consensus.cc:686] T 00000000000000000000000000000000 P 977b6a376fed469d926b69097af22b2b [term 1 LEADER]: Becoming Leader. State: Replica: 977b6a376fed469d926b69097af22b2b, State: Running, Role: LEADER
I20260807 04:17:19.108507 19112 consensus_queue.cc:237] T 00000000000000000000000000000000 P 977b6a376fed469d926b69097af22b2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "977b6a376fed469d926b69097af22b2b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42673 } }
I20260807 04:17:19.109644 19107 sys_catalog.cc:564] T 00000000000000000000000000000000 P 977b6a376fed469d926b69097af22b2b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:17:19.111752 19114 sys_catalog.cc:455] T 00000000000000000000000000000000 P 977b6a376fed469d926b69097af22b2b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 977b6a376fed469d926b69097af22b2b. Latest consensus state: current_term: 1 leader_uuid: "977b6a376fed469d926b69097af22b2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "977b6a376fed469d926b69097af22b2b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42673 } } }
I20260807 04:17:19.112287 19114 sys_catalog.cc:458] T 00000000000000000000000000000000 P 977b6a376fed469d926b69097af22b2b [sys.catalog]: This master's current role is: LEADER
I20260807 04:17:19.113029 19113 sys_catalog.cc:455] T 00000000000000000000000000000000 P 977b6a376fed469d926b69097af22b2b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "977b6a376fed469d926b69097af22b2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "977b6a376fed469d926b69097af22b2b" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42673 } } }
I20260807 04:17:19.113453 19113 sys_catalog.cc:458] T 00000000000000000000000000000000 P 977b6a376fed469d926b69097af22b2b [sys.catalog]: This master's current role is: LEADER
I20260807 04:17:19.119002 19117 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:17:19.124958 19117 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:17:19.133821 19117 catalog_manager.cc:1347] Generated new cluster ID: 834aaffc0970462182225c31d33e40e5
I20260807 04:17:19.133948 19117 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:17:19.151736 19117 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:17:19.153214 19117 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:17:19.161001 19117 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 977b6a376fed469d926b69097af22b2b: Generated new TSK 0
I20260807 04:17:19.162012 19117 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.200.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
I20260807 04:17:19.249320 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:0
--local_ip_for_outbound_sockets=127.7.200.193
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:42673
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:37295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:17:19.610792 19133 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:17:19.611150 19133 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:17:19.611326 19133 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:17:19.618633 19133 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:17:19.618785 19133 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:17:19.618974 19133 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:17:19.628842 19133 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:37295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:42673
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:17:19.630257 19133 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:17:19.631742 19133 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:17:19.645710 19142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:17:19.645761 19139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:17:19.645663 19138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:17:19.646672 19133 server_base.cc:1034] running on GCE node
I20260807 04:17:19.647233 19133 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:17:19.648119 19133 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:17:19.649369 19133 hybrid_clock.cc:648] HybridClock initialized: now 1786076239649329 us; error 48 us; skew 500 ppm
I20260807 04:17:19.649708 19133 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:17:19 dist-test-slave-qg60 krb5kdc[19024](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076239, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:17:19.653031 19133 init.cc:377] Logged in from keytab as kudu/127.7.200.193@KRBTEST.COM (short username kudu)
I20260807 04:17:19.654560 19133 webserver.cc:460] Webserver started at http://127.7.200.193:44145/ using document root <none> and password file <none>
I20260807 04:17:19.655210 19133 fs_manager.cc:359] Metadata directory not provided
I20260807 04:17:19.655313 19133 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:17:19.655572 19133 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:17:19.658551 19133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/data/instance:
uuid: "7b553cf5817343db9afcdbed4e583963"
format_stamp: "Formatted at 2026-08-07 04:17:19 on dist-test-slave-qg60"
server_key: "7b7b112816517ceb9fc40836e537562f"
server_key_iv: "4d9144c51a969365e71b3d79b8d92f17"
server_key_version: "encryptionkey@0"
I20260807 04:17:19.659317 19133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance:
uuid: "7b553cf5817343db9afcdbed4e583963"
format_stamp: "Formatted at 2026-08-07 04:17:19 on dist-test-slave-qg60"
server_key: "7b7b112816517ceb9fc40836e537562f"
server_key_iv: "4d9144c51a969365e71b3d79b8d92f17"
server_key_version: "encryptionkey@0"
I20260807 04:17:19.664814 19133 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 04:17:19.668299 19149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:17:19.669801 19133 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 04:17:19.669973 19133 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "7b553cf5817343db9afcdbed4e583963"
format_stamp: "Formatted at 2026-08-07 04:17:19 on dist-test-slave-qg60"
server_key: "7b7b112816517ceb9fc40836e537562f"
server_key_iv: "4d9144c51a969365e71b3d79b8d92f17"
server_key_version: "encryptionkey@0"
I20260807 04:17:19.670176 19133 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:17:19.682804 19133 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:17:19.686882 19133 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:17:19.687142 19133 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:17:19.688031 19133 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:17:19.689494 19133 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:17:19.689568 19133 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:17:19.689652 19133 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:17:19.689697 19133 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:17:19.725000 19133 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:39313
I20260807 04:17:19.725123 19266 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:39313 every 8 connection(s)
I20260807 04:17:19.726349 19133 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:17:19.729768 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 19133
I20260807 04:17:19.730005 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance
I20260807 04:17:19.730887 7971 external_mini_cluster.cc:1428] Setting key 51513b023c7b56c1b5ee221ccf1d7c05
Aug 07 04:17:19 dist-test-slave-qg60 krb5kdc[19024](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076239, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:17:19.751971 19269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:19.729243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:48577 (local address 127.7.200.254:42673)
0807 04:17:19.729781 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:19.729788 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:19.730915 (+ 1127us) server_negotiation.cc:407] Connection header received
0807 04:17:19.732973 (+ 2058us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:19.732979 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:19.733052 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:19.733138 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:19.735479 (+ 2341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:19.736188 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:19.738729 (+ 2541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:19.739125 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:19.739231 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:19.744331 (+ 5100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:17:19.744337 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:17:19.744340 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:17:19.744379 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:17:19.748049 (+ 3670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:17:19.749024 (+ 975us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:17:19.749033 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:17:19.749039 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:17:19.749205 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:17:19.749701 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:17:19.749709 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:17:19.749715 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:17:19.750116 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:17:19.750281 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 04:17:19.751168 (+ 887us) server_negotiation.cc:299] Negotiation successful
0807 04:17:19.751450 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":264,"threads_started":1}
I20260807 04:17:19.752697 19270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:19.729793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42673 (local address 127.7.200.193:48577)
0807 04:17:19.730718 (+ 925us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:19.730784 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:19.732642 (+ 1858us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:19.733443 (+ 801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:19.733456 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:19.734255 (+ 799us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:19.735259 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:19.735297 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:19.736365 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:19.736374 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:19.738556 (+ 2182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:19.738574 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:19.739378 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:19.739386 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:19.739733 (+ 347us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:19.740544 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:19.740580 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:19.744027 (+ 3447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:17:19.748244 (+ 4217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:17:19.748253 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:17:19.748269 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:17:19.748827 (+ 558us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:17:19.749355 (+ 528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:17:19.749359 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:17:19.749361 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:17:19.749571 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:17:19.750292 (+ 721us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:17:19.750300 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:17:19.750704 (+ 404us) client_negotiation.cc:769] Sending connection context
0807 04:17:19.750996 (+ 292us) client_negotiation.cc:240] Negotiation successful
0807 04:17:19.751460 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":327,"threads_started":1}
I20260807 04:17:19.754719 19267 heartbeater.cc:347] Connected to a master server at 127.7.200.254:42673
I20260807 04:17:19.755110 19267 heartbeater.cc:464] Registering TS with master...
I20260807 04:17:19.756143 19267 heartbeater.cc:511] Master 127.7.200.254:42673 requested a full tablet report, sending...
I20260807 04:17:19.758827 19069 ts_manager.cc:194] Registered new tserver with Master: 7b553cf5817343db9afcdbed4e583963 (127.7.200.193:39313)
I20260807 04:17:19.760362 19069 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.193@KRBTEST.COM'} at 127.7.200.193:48577
WARNING: no policy specified for kudu/127.7.200.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
I20260807 04:17:19.808037 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:0
--local_ip_for_outbound_sockets=127.7.200.194
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:42673
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:37295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:17:20.154664 19274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:17:20.155035 19274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:17:20.155210 19274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:17:20.162868 19274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:17:20.163044 19274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:17:20.163228 19274 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:17:20.173599 19274 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:37295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:42673
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:17:20.175155 19274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:17:20.176554 19274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:17:20.190303 19280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:17:20.190339 19279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:17:20.190373 19282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:17:20.191366 19274 server_base.cc:1034] running on GCE node
I20260807 04:17:20.192065 19274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:17:20.193085 19274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:17:20.194327 19274 hybrid_clock.cc:648] HybridClock initialized: now 1786076240194252 us; error 57 us; skew 500 ppm
I20260807 04:17:20.194733 19274 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:17:20 dist-test-slave-qg60 krb5kdc[19024](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076240, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:17:20.198433 19274 init.cc:377] Logged in from keytab as kudu/127.7.200.194@KRBTEST.COM (short username kudu)
I20260807 04:17:20.200052 19274 webserver.cc:460] Webserver started at http://127.7.200.194:38519/ using document root <none> and password file <none>
I20260807 04:17:20.200810 19274 fs_manager.cc:359] Metadata directory not provided
I20260807 04:17:20.200933 19274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:17:20.201218 19274 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:17:20.204232 19274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/data/instance:
uuid: "9c6d8b5d04214149ab9e07d5f77aa25c"
format_stamp: "Formatted at 2026-08-07 04:17:20 on dist-test-slave-qg60"
server_key: "232f7902b42871f4ca2ab3553fc1bfb3"
server_key_iv: "bcdee269faeb170b639ba3f346100812"
server_key_version: "encryptionkey@0"
I20260807 04:17:20.205111 19274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance:
uuid: "9c6d8b5d04214149ab9e07d5f77aa25c"
format_stamp: "Formatted at 2026-08-07 04:17:20 on dist-test-slave-qg60"
server_key: "232f7902b42871f4ca2ab3553fc1bfb3"
server_key_iv: "bcdee269faeb170b639ba3f346100812"
server_key_version: "encryptionkey@0"
I20260807 04:17:20.210824 19274 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 04:17:20.214416 19289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:17:20.216107 19274 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 04:17:20.216262 19274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "9c6d8b5d04214149ab9e07d5f77aa25c"
format_stamp: "Formatted at 2026-08-07 04:17:20 on dist-test-slave-qg60"
server_key: "232f7902b42871f4ca2ab3553fc1bfb3"
server_key_iv: "bcdee269faeb170b639ba3f346100812"
server_key_version: "encryptionkey@0"
I20260807 04:17:20.216455 19274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:17:20.239471 19274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:17:20.244427 19274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:17:20.244699 19274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:17:20.245801 19274 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:17:20.247207 19274 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:17:20.247283 19274 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:17:20.247373 19274 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:17:20.247422 19274 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:17:20.282704 19274 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:42447
I20260807 04:17:20.282806 19407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:42447 every 8 connection(s)
I20260807 04:17:20.284057 19274 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:17:20.289063 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 19274
I20260807 04:17:20.289285 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance
I20260807 04:17:20.289721 7971 external_mini_cluster.cc:1428] Setting key 090553289e025bdee000997f15eb9599
Aug 07 04:17:20 dist-test-slave-qg60 krb5kdc[19024](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076240, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:17:20.305347 19410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:20.286790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:34739 (local address 127.7.200.254:42673)
0807 04:17:20.287223 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:20.287228 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:20.288253 (+ 1025us) server_negotiation.cc:407] Connection header received
0807 04:17:20.290499 (+ 2246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:20.290506 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:20.290584 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:20.290687 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:20.292447 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:20.293244 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:20.294811 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:20.295228 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:20.295380 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:20.298986 (+ 3606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:17:20.298991 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:17:20.298994 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:17:20.299028 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:17:20.301998 (+ 2970us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:17:20.302752 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:17:20.302764 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:17:20.302766 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:17:20.302896 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:17:20.303432 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:17:20.303436 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:17:20.303438 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:17:20.303715 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:17:20.303842 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 04:17:20.304882 (+ 1040us) server_negotiation.cc:299] Negotiation successful
0807 04:17:20.305057 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":212,"threads_started":1}
I20260807 04:17:20.306874 19411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:20.287333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42673 (local address 127.7.200.194:34739)
0807 04:17:20.288084 (+ 751us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:20.288128 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:20.290199 (+ 2071us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:20.290963 (+ 764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:20.290972 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:20.291640 (+ 668us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:20.292268 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:20.292289 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:20.293423 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:20.293427 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:20.294652 (+ 1225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:20.294664 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:20.295480 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:20.295489 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:20.295735 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:20.296459 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:20.296488 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:20.298741 (+ 2253us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:17:20.302152 (+ 3411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:17:20.302161 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:17:20.302179 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:17:20.302618 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:17:20.303025 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:17:20.303030 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:17:20.303033 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:17:20.303228 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:17:20.303853 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:17:20.303861 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:17:20.304354 (+ 493us) client_negotiation.cc:769] Sending connection context
0807 04:17:20.304761 (+ 407us) client_negotiation.cc:240] Negotiation successful
0807 04:17:20.305374 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":312,"threads_started":1}
I20260807 04:17:20.308357 19408 heartbeater.cc:347] Connected to a master server at 127.7.200.254:42673
I20260807 04:17:20.308676 19408 heartbeater.cc:464] Registering TS with master...
I20260807 04:17:20.309474 19408 heartbeater.cc:511] Master 127.7.200.254:42673 requested a full tablet report, sending...
I20260807 04:17:20.310986 19069 ts_manager.cc:194] Registered new tserver with Master: 9c6d8b5d04214149ab9e07d5f77aa25c (127.7.200.194:42447)
I20260807 04:17:20.311822 19069 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.194@KRBTEST.COM'} at 127.7.200.194:34739
WARNING: no policy specified for kudu/127.7.200.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
I20260807 04:17:20.358564 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:0
--local_ip_for_outbound_sockets=127.7.200.195
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:42673
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:37295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:17:20.706241 19414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:17:20.706595 19414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:17:20.706756 19414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:17:20.714421 19414 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:17:20.714592 19414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:17:20.714787 19414 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:17:20.725099 19414 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:37295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:42673
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:17:20.726389 19414 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:17:20.727874 19414 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:17:20.741408 19420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:17:20.741511 19423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:17:20.741600 19421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:17:20.742879 19414 server_base.cc:1034] running on GCE node
I20260807 04:17:20.743768 19414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:17:20.745245 19414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:17:20.746505 19414 hybrid_clock.cc:648] HybridClock initialized: now 1786076240746440 us; error 58 us; skew 500 ppm
I20260807 04:17:20.746860 19414 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:17:20 dist-test-slave-qg60 krb5kdc[19024](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076240, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:17:20.752264 19414 init.cc:377] Logged in from keytab as kudu/127.7.200.195@KRBTEST.COM (short username kudu)
I20260807 04:17:20.754019 19414 webserver.cc:460] Webserver started at http://127.7.200.195:41321/ using document root <none> and password file <none>
I20260807 04:17:20.754700 19414 fs_manager.cc:359] Metadata directory not provided
I20260807 04:17:20.754804 19414 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:17:20.755062 19414 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:17:20.758086 19414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/data/instance:
uuid: "e052cf5e3cfa4eed947fe25e213a46a1"
format_stamp: "Formatted at 2026-08-07 04:17:20 on dist-test-slave-qg60"
server_key: "eb3e713376eaeda6140101c3e1212aaa"
server_key_iv: "de4980f845c03915f76cafeae0c1080c"
server_key_version: "encryptionkey@0"
I20260807 04:17:20.758827 19414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance:
uuid: "e052cf5e3cfa4eed947fe25e213a46a1"
format_stamp: "Formatted at 2026-08-07 04:17:20 on dist-test-slave-qg60"
server_key: "eb3e713376eaeda6140101c3e1212aaa"
server_key_iv: "de4980f845c03915f76cafeae0c1080c"
server_key_version: "encryptionkey@0"
I20260807 04:17:20.764066 19414 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 04:17:20.764482 19267 heartbeater.cc:503] Master 127.7.200.254:42673 was elected leader, sending a full tablet report...
I20260807 04:17:20.768326 19430 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:17:20.769894 19414 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260807 04:17:20.770113 19414 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "e052cf5e3cfa4eed947fe25e213a46a1"
format_stamp: "Formatted at 2026-08-07 04:17:20 on dist-test-slave-qg60"
server_key: "eb3e713376eaeda6140101c3e1212aaa"
server_key_iv: "de4980f845c03915f76cafeae0c1080c"
server_key_version: "encryptionkey@0"
I20260807 04:17:20.770345 19414 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:17:20.823590 19414 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:17:20.828476 19414 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:17:20.828933 19414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:17:20.830039 19414 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:17:20.831503 19414 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:17:20.831606 19414 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:17:20.831754 19414 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:17:20.831823 19414 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:17:20.867430 19414 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:33201
I20260807 04:17:20.867527 19549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:33201 every 8 connection(s)
I20260807 04:17:20.868894 19414 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:17:20.870622 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 19414
I20260807 04:17:20.870842 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance
I20260807 04:17:20.871330 7971 external_mini_cluster.cc:1428] Setting key c1145b195cc0c78c3e2b2be9cb0b0080
Aug 07 04:17:20 dist-test-slave-qg60 krb5kdc[19024](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076240, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:17:20.890686 19553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:20.871736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:37843 (local address 127.7.200.254:42673)
0807 04:17:20.872320 (+ 584us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:20.872326 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:20.873577 (+ 1251us) server_negotiation.cc:407] Connection header received
0807 04:17:20.876018 (+ 2441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:20.876023 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:20.876134 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:20.876253 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:20.877905 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:20.878714 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:20.880403 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:20.880873 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:20.881013 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:20.884614 (+ 3601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:17:20.884619 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:17:20.884622 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:17:20.884656 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:17:20.887481 (+ 2825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:17:20.888224 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:17:20.888231 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:17:20.888235 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:17:20.888368 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:17:20.888868 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:17:20.888890 (+ 22us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:17:20.888893 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:17:20.889152 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:17:20.889326 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0807 04:17:20.890045 (+ 719us) server_negotiation.cc:299] Negotiation successful
0807 04:17:20.890269 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":273,"threads_started":1}
I20260807 04:17:20.891695 19554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:20.872343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42673 (local address 127.7.200.195:37843)
0807 04:17:20.873400 (+ 1057us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:20.873453 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:20.875732 (+ 2279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:20.876518 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:20.876527 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:20.877141 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:17:20.877727 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:20.877746 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:20.878901 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:20.878905 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:20.880242 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:20.880254 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:20.881108 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:20.881116 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:20.881365 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:20.882107 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:17:20.882129 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:17:20.884382 (+ 2253us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:17:20.887638 (+ 3256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:17:20.887647 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:17:20.887663 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:17:20.888098 (+ 435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:17:20.888492 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:17:20.888497 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:17:20.888501 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:17:20.888705 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:17:20.889292 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:17:20.889300 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:17:20.889659 (+ 359us) client_negotiation.cc:769] Sending connection context
0807 04:17:20.889945 (+ 286us) client_negotiation.cc:240] Negotiation successful
0807 04:17:20.890488 (+ 543us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":736,"thread_start_us":391,"threads_started":1}
I20260807 04:17:20.893141 19550 heartbeater.cc:347] Connected to a master server at 127.7.200.254:42673
I20260807 04:17:20.893468 19550 heartbeater.cc:464] Registering TS with master...
I20260807 04:17:20.894207 19550 heartbeater.cc:511] Master 127.7.200.254:42673 requested a full tablet report, sending...
I20260807 04:17:20.895627 19069 ts_manager.cc:194] Registered new tserver with Master: e052cf5e3cfa4eed947fe25e213a46a1 (127.7.200.195:33201)
I20260807 04:17:20.896454 19069 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.195@KRBTEST.COM'} at 127.7.200.195:37843
I20260807 04:17:20.899894 7971 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 04:17:20.917891 19553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:20.904582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39268 (local address 127.7.200.254:42673)
0807 04:17:20.904816 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:20.904821 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:20.905332 (+ 511us) server_negotiation.cc:407] Connection header received
0807 04:17:20.905494 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:20.905498 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:20.905598 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:20.905691 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:20.907254 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:20.908049 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:20.909421 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:20.909843 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:20.909967 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:20.912494 (+ 2527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:17:20.912499 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:17:20.912502 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:17:20.912537 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:17:20.915316 (+ 2779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:17:20.916001 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:17:20.916005 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:17:20.916008 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:17:20.916136 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:17:20.916469 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:17:20.916473 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:17:20.916474 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:17:20.916894 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:17:20.917144 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0807 04:17:20.917482 (+ 338us) server_negotiation.cc:299] Negotiation successful
0807 04:17:20.917660 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 04:17:20.922405 19069 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39268:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:17:20.929744 19069 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:17:20.959568 19566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:20.943171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:42447 (local address 127.0.0.1:46264)
0807 04:17:20.944078 (+ 907us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:20.944139 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:20.944342 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:20.949883 (+ 5541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:20.949891 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:20.949924 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:17:20.950434 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:20.950449 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:20.952577 (+ 2128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:20.952586 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:20.955703 (+ 3117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:20.955717 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:20.958164 (+ 2447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:20.958173 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:20.958499 (+ 326us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:20.958580 (+ 81us) client_negotiation.cc:769] Sending connection context
0807 04:17:20.958720 (+ 140us) client_negotiation.cc:240] Negotiation successful
0807 04:17:20.959004 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":409,"threads_started":1}
I20260807 04:17:20.961391 19568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:20.943253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46264 (local address 127.7.200.194:42447)
0807 04:17:20.949165 (+ 5912us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:20.949176 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:20.949213 (+ 37us) server_negotiation.cc:407] Connection header received
0807 04:17:20.949335 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:20.949347 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:20.949619 (+ 272us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:20.949858 (+ 239us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:17:20.950698 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:20.952351 (+ 1653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:20.955918 (+ 3567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:20.957832 (+ 1914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:20.960538 (+ 2706us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:20.960776 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0807 04:17:20.960858 (+ 82us) server_negotiation.cc:299] Negotiation successful
0807 04:17:20.961046 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5746,"thread_start_us":5638,"threads_started":1}
I20260807 04:17:20.963622 19569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:20.943401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:39313 (local address 127.0.0.1:58326)
0807 04:17:20.950022 (+ 6621us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:20.950049 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:20.950201 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:20.951280 (+ 1079us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:20.951288 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:20.951324 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:17:20.951876 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:20.951892 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:20.955838 (+ 3946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:20.955846 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:20.958882 (+ 3036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:20.958905 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:20.962456 (+ 3551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:20.962465 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:20.962755 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:20.962810 (+ 55us) client_negotiation.cc:769] Sending connection context
0807 04:17:20.962920 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 04:17:20.963125 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6469,"thread_start_us":6320,"threads_started":1}
I20260807 04:17:20.964927 19570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:20.944042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58326 (local address 127.7.200.193:39313)
0807 04:17:20.949612 (+ 5570us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:20.949621 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:20.950147 (+ 526us) server_negotiation.cc:407] Connection header received
0807 04:17:20.950423 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:20.950433 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:20.950700 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:20.950938 (+ 238us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:17:20.952155 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:20.955622 (+ 3467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:20.959141 (+ 3519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:20.961774 (+ 2633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:20.961967 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:20.962275 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0807 04:17:20.964159 (+ 1884us) server_negotiation.cc:299] Negotiation successful
0807 04:17:20.964423 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5394,"thread_start_us":5233,"threads_started":1}
I20260807 04:17:20.966399 19339 tablet_service.cc:1467] Processing CreateTablet for tablet 104c9ff2c8894982bafbd6de82aeff4f (DEFAULT_TABLE table=test-table [id=8c606bb5565d4c37a16a4130b1badce4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:17:20.968017 19339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 104c9ff2c8894982bafbd6de82aeff4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:17:20.969529 19198 tablet_service.cc:1467] Processing CreateTablet for tablet 104c9ff2c8894982bafbd6de82aeff4f (DEFAULT_TABLE table=test-table [id=8c606bb5565d4c37a16a4130b1badce4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:17:20.970767 19198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 104c9ff2c8894982bafbd6de82aeff4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:17:20.974370 19566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:20.950369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:33201 (local address 127.0.0.1:55504)
0807 04:17:20.959917 (+ 9548us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:20.959941 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:20.960068 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:20.967107 (+ 7039us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:20.967112 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:20.967140 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:17:20.967314 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:20.967325 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:20.969669 (+ 2344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:20.969678 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:20.971560 (+ 1882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:20.971578 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:20.973547 (+ 1969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:20.973555 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:20.973773 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:20.973809 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 04:17:20.973891 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 04:17:20.974052 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9392,"thread_start_us":15251,"threads_started":1}
I20260807 04:17:20.975468 19572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:20.950412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55504 (local address 127.7.200.195:33201)
0807 04:17:20.966438 (+ 16026us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:20.966449 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:20.966485 (+ 36us) server_negotiation.cc:407] Connection header received
0807 04:17:20.966596 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:20.966604 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:20.966853 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:20.967541 (+ 688us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:17:20.967861 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:20.969494 (+ 1633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:20.971745 (+ 2251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:20.973353 (+ 1608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:20.974633 (+ 1280us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:20.974869 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0807 04:17:20.974938 (+ 69us) server_negotiation.cc:299] Negotiation successful
0807 04:17:20.975117 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15842,"thread_start_us":16746,"threads_started":1}
I20260807 04:17:20.979283 19482 tablet_service.cc:1467] Processing CreateTablet for tablet 104c9ff2c8894982bafbd6de82aeff4f (DEFAULT_TABLE table=test-table [id=8c606bb5565d4c37a16a4130b1badce4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:17:20.980783 19482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 104c9ff2c8894982bafbd6de82aeff4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:17:20.981405 19573 tablet_bootstrap.cc:492] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c: Bootstrap starting.
I20260807 04:17:20.984862 19574 tablet_bootstrap.cc:492] T 104c9ff2c8894982bafbd6de82aeff4f P 7b553cf5817343db9afcdbed4e583963: Bootstrap starting.
I20260807 04:17:20.985432 19573 tablet_bootstrap.cc:654] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c: Neither blocks nor log segments found. Creating new log.
I20260807 04:17:20.986817 19573 log.cc:824] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c: Log is configured to *not* fsync() on all Append() calls
I20260807 04:17:20.988451 19574 tablet_bootstrap.cc:654] T 104c9ff2c8894982bafbd6de82aeff4f P 7b553cf5817343db9afcdbed4e583963: Neither blocks nor log segments found. Creating new log.
I20260807 04:17:20.989763 19574 log.cc:824] T 104c9ff2c8894982bafbd6de82aeff4f P 7b553cf5817343db9afcdbed4e583963: Log is configured to *not* fsync() on all Append() calls
I20260807 04:17:20.990170 19573 tablet_bootstrap.cc:492] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c: No bootstrap required, opened a new log
I20260807 04:17:20.990511 19573 ts_tablet_manager.cc:1397] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.005s
I20260807 04:17:20.993208 19574 tablet_bootstrap.cc:492] T 104c9ff2c8894982bafbd6de82aeff4f P 7b553cf5817343db9afcdbed4e583963: No bootstrap required, opened a new log
I20260807 04:17:20.993973 19574 ts_tablet_manager.cc:1397] T 104c9ff2c8894982bafbd6de82aeff4f P 7b553cf5817343db9afcdbed4e583963: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260807 04:17:20.994939 19577 tablet_bootstrap.cc:492] T 104c9ff2c8894982bafbd6de82aeff4f P e052cf5e3cfa4eed947fe25e213a46a1: Bootstrap starting.
I20260807 04:17:20.997988 19577 tablet_bootstrap.cc:654] T 104c9ff2c8894982bafbd6de82aeff4f P e052cf5e3cfa4eed947fe25e213a46a1: Neither blocks nor log segments found. Creating new log.
I20260807 04:17:20.998967 19577 log.cc:824] T 104c9ff2c8894982bafbd6de82aeff4f P e052cf5e3cfa4eed947fe25e213a46a1: Log is configured to *not* fsync() on all Append() calls
I20260807 04:17:21.001163 19573 raft_consensus.cc:348] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c6d8b5d04214149ab9e07d5f77aa25c" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 42447 } } peers { permanent_uuid: "7b553cf5817343db9afcdbed4e583963" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 39313 } } peers { permanent_uuid: "e052cf5e3cfa4eed947fe25e213a46a1" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 33201 } }
I20260807 04:17:21.001662 19573 raft_consensus.cc:374] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:17:21.001775 19573 raft_consensus.cc:729] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c6d8b5d04214149ab9e07d5f77aa25c, State: Initialized, Role: FOLLOWER
I20260807 04:17:21.002012 19577 tablet_bootstrap.cc:492] T 104c9ff2c8894982bafbd6de82aeff4f P e052cf5e3cfa4eed947fe25e213a46a1: No bootstrap required, opened a new log
I20260807 04:17:21.002319 19577 ts_tablet_manager.cc:1397] T 104c9ff2c8894982bafbd6de82aeff4f P e052cf5e3cfa4eed947fe25e213a46a1: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260807 04:17:21.002429 19573 consensus_queue.cc:260] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c6d8b5d04214149ab9e07d5f77aa25c" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 42447 } } peers { permanent_uuid: "7b553cf5817343db9afcdbed4e583963" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 39313 } } peers { permanent_uuid: "e052cf5e3cfa4eed947fe25e213a46a1" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 33201 } }
I20260807 04:17:21.003674 19408 heartbeater.cc:503] Master 127.7.200.254:42673 was elected leader, sending a full tablet report...
I20260807 04:17:21.005940 19573 ts_tablet_manager.cc:1428] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c: Time spent starting tablet: real 0.015s user 0.008s sys 0.005s
I20260807 04:17:21.005339 19574 raft_consensus.cc:348] T 104c9ff2c8894982bafbd6de82aeff4f P 7b553cf5817343db9afcdbed4e583963 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c6d8b5d04214149ab9e07d5f77aa25c" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 42447 } } peers { permanent_uuid: "7b553cf5817343db9afcdbed4e583963" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 39313 } } peers { permanent_uuid: "e052cf5e3cfa4eed947fe25e213a46a1" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 33201 } }
I20260807 04:17:21.006619 19574 raft_consensus.cc:374] T 104c9ff2c8894982bafbd6de82aeff4f P 7b553cf5817343db9afcdbed4e583963 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:17:21.006736 19574 raft_consensus.cc:729] T 104c9ff2c8894982bafbd6de82aeff4f P 7b553cf5817343db9afcdbed4e583963 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b553cf5817343db9afcdbed4e583963, State: Initialized, Role: FOLLOWER
I20260807 04:17:21.007902 19574 consensus_queue.cc:260] T 104c9ff2c8894982bafbd6de82aeff4f P 7b553cf5817343db9afcdbed4e583963 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c6d8b5d04214149ab9e07d5f77aa25c" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 42447 } } peers { permanent_uuid: "7b553cf5817343db9afcdbed4e583963" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 39313 } } peers { permanent_uuid: "e052cf5e3cfa4eed947fe25e213a46a1" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 33201 } }
I20260807 04:17:21.009969 19574 ts_tablet_manager.cc:1428] T 104c9ff2c8894982bafbd6de82aeff4f P 7b553cf5817343db9afcdbed4e583963: Time spent starting tablet: real 0.016s user 0.009s sys 0.004s
I20260807 04:17:21.012427 19577 raft_consensus.cc:348] T 104c9ff2c8894982bafbd6de82aeff4f P e052cf5e3cfa4eed947fe25e213a46a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c6d8b5d04214149ab9e07d5f77aa25c" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 42447 } } peers { permanent_uuid: "7b553cf5817343db9afcdbed4e583963" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 39313 } } peers { permanent_uuid: "e052cf5e3cfa4eed947fe25e213a46a1" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 33201 } }
I20260807 04:17:21.012934 19577 raft_consensus.cc:374] T 104c9ff2c8894982bafbd6de82aeff4f P e052cf5e3cfa4eed947fe25e213a46a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:17:21.013067 19577 raft_consensus.cc:729] T 104c9ff2c8894982bafbd6de82aeff4f P e052cf5e3cfa4eed947fe25e213a46a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e052cf5e3cfa4eed947fe25e213a46a1, State: Initialized, Role: FOLLOWER
I20260807 04:17:21.013804 19577 consensus_queue.cc:260] T 104c9ff2c8894982bafbd6de82aeff4f P e052cf5e3cfa4eed947fe25e213a46a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c6d8b5d04214149ab9e07d5f77aa25c" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 42447 } } peers { permanent_uuid: "7b553cf5817343db9afcdbed4e583963" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 39313 } } peers { permanent_uuid: "e052cf5e3cfa4eed947fe25e213a46a1" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 33201 } }
I20260807 04:17:21.015139 19550 heartbeater.cc:503] Master 127.7.200.254:42673 was elected leader, sending a full tablet report...
I20260807 04:17:21.015846 19577 ts_tablet_manager.cc:1428] T 104c9ff2c8894982bafbd6de82aeff4f P e052cf5e3cfa4eed947fe25e213a46a1: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
W20260807 04:17:21.036361 19409 tablet.cc:2369] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 04:17:21.120950 19552 tablet.cc:2369] T 104c9ff2c8894982bafbd6de82aeff4f P e052cf5e3cfa4eed947fe25e213a46a1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:17:21.194289 19579 raft_consensus.cc:482] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:17:21.194623 19579 raft_consensus.cc:504] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c6d8b5d04214149ab9e07d5f77aa25c" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 42447 } } peers { permanent_uuid: "7b553cf5817343db9afcdbed4e583963" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 39313 } } peers { permanent_uuid: "e052cf5e3cfa4eed947fe25e213a46a1" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 33201 } }
I20260807 04:17:21.196372 19579 leader_election.cc:288] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b553cf5817343db9afcdbed4e583963 (127.7.200.193:39313), e052cf5e3cfa4eed947fe25e213a46a1 (127.7.200.195:33201)
I20260807 04:17:21.203572 19570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:21.196919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:48319 (local address 127.7.200.193:39313)
0807 04:17:21.197156 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:21.197161 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:21.197807 (+ 646us) server_negotiation.cc:407] Connection header received
0807 04:17:21.198177 (+ 370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:21.198191 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:21.198277 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:21.198344 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:17:21.199016 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:21.199745 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:21.201740 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:21.202615 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:21.202813 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:21.202891 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 04:17:21.203174 (+ 283us) server_negotiation.cc:299] Negotiation successful
0807 04:17:21.203301 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260807 04:17:21.203665 19582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:21.196873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:39313 (local address 127.7.200.194:48319)
0807 04:17:21.197695 (+ 822us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:21.197722 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:21.197950 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:21.198523 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:21.198526 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:21.198546 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:17:21.198863 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:21.198872 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:21.199882 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:21.199888 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:21.201580 (+ 1692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:21.201593 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:21.202830 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:21.202836 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:21.203006 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:21.203031 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 04:17:21.203143 (+ 112us) client_negotiation.cc:240] Negotiation successful
0807 04:17:21.203282 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":646,"thread_start_us":406,"threads_started":1}
I20260807 04:17:21.204063 19572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:21.197887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:38075 (local address 127.7.200.195:33201)
0807 04:17:21.198190 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:21.198198 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:21.198530 (+ 332us) server_negotiation.cc:407] Connection header received
0807 04:17:21.198800 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:21.198805 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:21.198877 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:21.198989 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:17:21.199595 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:21.200294 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:21.202219 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:21.203099 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:21.203288 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:21.203364 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 04:17:21.203664 (+ 300us) server_negotiation.cc:299] Negotiation successful
0807 04:17:21.203816 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145}
I20260807 04:17:21.204484 19583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:21.197759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:33201 (local address 127.7.200.194:38075)
0807 04:17:21.198400 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0807 04:17:21.198414 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 04:17:21.198650 (+ 236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:17:21.199004 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:17:21.199008 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:17:21.199032 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:17:21.199411 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:21.199420 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:21.200444 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:21.200449 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:21.202062 (+ 1613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:17:21.202074 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:17:21.203319 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:17:21.203326 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:17:21.203503 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:21.203525 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 04:17:21.203631 (+ 106us) client_negotiation.cc:240] Negotiation successful
0807 04:17:21.204081 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"spinlock_wait_cycles":27520,"thread_start_us":363,"threads_started":1}
I20260807 04:17:21.204872 19218 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "104c9ff2c8894982bafbd6de82aeff4f" candidate_uuid: "9c6d8b5d04214149ab9e07d5f77aa25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b553cf5817343db9afcdbed4e583963" is_pre_election: true
I20260807 04:17:21.205427 19218 raft_consensus.cc:2454] T 104c9ff2c8894982bafbd6de82aeff4f P 7b553cf5817343db9afcdbed4e583963 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c6d8b5d04214149ab9e07d5f77aa25c in term 0.
I20260807 04:17:21.205539 19502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "104c9ff2c8894982bafbd6de82aeff4f" candidate_uuid: "9c6d8b5d04214149ab9e07d5f77aa25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e052cf5e3cfa4eed947fe25e213a46a1" is_pre_election: true
I20260807 04:17:21.206115 19502 raft_consensus.cc:2454] T 104c9ff2c8894982bafbd6de82aeff4f P e052cf5e3cfa4eed947fe25e213a46a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c6d8b5d04214149ab9e07d5f77aa25c in term 0.
I20260807 04:17:21.206205 19290 leader_election.cc:302] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b553cf5817343db9afcdbed4e583963, 9c6d8b5d04214149ab9e07d5f77aa25c; no voters:
I20260807 04:17:21.206661 19579 raft_consensus.cc:2781] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:17:21.206862 19579 raft_consensus.cc:482] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:17:21.207080 19579 raft_consensus.cc:3037] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:17:21.209705 19579 raft_consensus.cc:504] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c6d8b5d04214149ab9e07d5f77aa25c" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 42447 } } peers { permanent_uuid: "7b553cf5817343db9afcdbed4e583963" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 39313 } } peers { permanent_uuid: "e052cf5e3cfa4eed947fe25e213a46a1" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 33201 } }
I20260807 04:17:21.210536 19579 leader_election.cc:288] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c [CANDIDATE]: Term 1 election: Requested vote from peers 7b553cf5817343db9afcdbed4e583963 (127.7.200.193:39313), e052cf5e3cfa4eed947fe25e213a46a1 (127.7.200.195:33201)
I20260807 04:17:21.211004 19218 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "104c9ff2c8894982bafbd6de82aeff4f" candidate_uuid: "9c6d8b5d04214149ab9e07d5f77aa25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b553cf5817343db9afcdbed4e583963"
I20260807 04:17:21.211076 19502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "104c9ff2c8894982bafbd6de82aeff4f" candidate_uuid: "9c6d8b5d04214149ab9e07d5f77aa25c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e052cf5e3cfa4eed947fe25e213a46a1"
I20260807 04:17:21.211237 19218 raft_consensus.cc:3037] T 104c9ff2c8894982bafbd6de82aeff4f P 7b553cf5817343db9afcdbed4e583963 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:17:21.211297 19502 raft_consensus.cc:3037] T 104c9ff2c8894982bafbd6de82aeff4f P e052cf5e3cfa4eed947fe25e213a46a1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:17:21.213743 19502 raft_consensus.cc:2454] T 104c9ff2c8894982bafbd6de82aeff4f P e052cf5e3cfa4eed947fe25e213a46a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c6d8b5d04214149ab9e07d5f77aa25c in term 1.
I20260807 04:17:21.214103 19218 raft_consensus.cc:2454] T 104c9ff2c8894982bafbd6de82aeff4f P 7b553cf5817343db9afcdbed4e583963 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c6d8b5d04214149ab9e07d5f77aa25c in term 1.
I20260807 04:17:21.214147 19290 leader_election.cc:302] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c6d8b5d04214149ab9e07d5f77aa25c, e052cf5e3cfa4eed947fe25e213a46a1; no voters:
I20260807 04:17:21.214498 19579 raft_consensus.cc:2781] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:17:21.215029 19579 raft_consensus.cc:686] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c [term 1 LEADER]: Becoming Leader. State: Replica: 9c6d8b5d04214149ab9e07d5f77aa25c, State: Running, Role: LEADER
I20260807 04:17:21.215569 19579 consensus_queue.cc:237] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c6d8b5d04214149ab9e07d5f77aa25c" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 42447 } } peers { permanent_uuid: "7b553cf5817343db9afcdbed4e583963" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 39313 } } peers { permanent_uuid: "e052cf5e3cfa4eed947fe25e213a46a1" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 33201 } }
I20260807 04:17:21.220613 19069 catalog_manager.cc:5495] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c6d8b5d04214149ab9e07d5f77aa25c (127.7.200.194). New cstate: current_term: 1 leader_uuid: "9c6d8b5d04214149ab9e07d5f77aa25c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c6d8b5d04214149ab9e07d5f77aa25c" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 42447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b553cf5817343db9afcdbed4e583963" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 39313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e052cf5e3cfa4eed947fe25e213a46a1" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 33201 } health_report { overall_health: UNKNOWN } } }
W20260807 04:17:21.229053 19268 tablet.cc:2369] T 104c9ff2c8894982bafbd6de82aeff4f P 7b553cf5817343db9afcdbed4e583963: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:17:21.251374 19568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:21.245902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46266 (local address 127.7.200.194:42447)
0807 04:17:21.246160 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:21.246165 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:21.246180 (+ 15us) server_negotiation.cc:407] Connection header received
0807 04:17:21.246269 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:21.246273 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:21.246361 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:21.246561 (+ 200us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:17:21.246961 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:21.247691 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:21.249115 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:21.249538 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:21.249725 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:21.250213 (+ 488us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:17:21.250734 (+ 521us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:17:21.250892 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 04:17:21.250992 (+ 100us) server_negotiation.cc:299] Negotiation successful
0807 04:17:21.251078 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 04:17:21.259442 19502 raft_consensus.cc:1261] T 104c9ff2c8894982bafbd6de82aeff4f P e052cf5e3cfa4eed947fe25e213a46a1 [term 1 FOLLOWER]: Refusing update from remote peer 9c6d8b5d04214149ab9e07d5f77aa25c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:17:21.259518 19218 raft_consensus.cc:1261] T 104c9ff2c8894982bafbd6de82aeff4f P 7b553cf5817343db9afcdbed4e583963 [term 1 FOLLOWER]: Refusing update from remote peer 9c6d8b5d04214149ab9e07d5f77aa25c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:17:21.260426 19584 consensus_queue.cc:1035] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e052cf5e3cfa4eed947fe25e213a46a1" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 33201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:17:21.260826 19579 consensus_queue.cc:1035] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b553cf5817343db9afcdbed4e583963" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 39313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:17:21.294267 19069 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39268:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:17:21.294600 19069 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39268:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:17:21.298784 19069 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 977b6a376fed469d926b69097af22b2b: Sending DeleteTablet for 3 replicas of tablet 104c9ff2c8894982bafbd6de82aeff4f
I20260807 04:17:21.299988 19339 tablet_service.cc:1514] Processing DeleteTablet for tablet 104c9ff2c8894982bafbd6de82aeff4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:17:21 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:46264
I20260807 04:17:21.300508 19482 tablet_service.cc:1514] Processing DeleteTablet for tablet 104c9ff2c8894982bafbd6de82aeff4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:17:21 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:55504
I20260807 04:17:21.300810 19198 tablet_service.cc:1514] Processing DeleteTablet for tablet 104c9ff2c8894982bafbd6de82aeff4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:17:21 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:58326
I20260807 04:17:21.304194 19599 tablet_replica.cc:330] T 104c9ff2c8894982bafbd6de82aeff4f P e052cf5e3cfa4eed947fe25e213a46a1: stopping tablet replica
I20260807 04:17:21.304673 19599 raft_consensus.cc:2229] T 104c9ff2c8894982bafbd6de82aeff4f P e052cf5e3cfa4eed947fe25e213a46a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:17:21.305248 19599 raft_consensus.cc:2258] T 104c9ff2c8894982bafbd6de82aeff4f P e052cf5e3cfa4eed947fe25e213a46a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:17:21.305287 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 19133
I20260807 04:17:21.307910 19600 tablet_replica.cc:330] T 104c9ff2c8894982bafbd6de82aeff4f P 7b553cf5817343db9afcdbed4e583963: stopping tablet replica
I20260807 04:17:21.308450 19600 raft_consensus.cc:2229] T 104c9ff2c8894982bafbd6de82aeff4f P 7b553cf5817343db9afcdbed4e583963 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:17:21.309089 19600 raft_consensus.cc:2258] T 104c9ff2c8894982bafbd6de82aeff4f P 7b553cf5817343db9afcdbed4e583963 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:17:21.310559 19598 tablet_replica.cc:330] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c: stopping tablet replica
I20260807 04:17:21.310959 19598 raft_consensus.cc:2229] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:17:21.310979 19599 ts_tablet_manager.cc:1905] T 104c9ff2c8894982bafbd6de82aeff4f P e052cf5e3cfa4eed947fe25e213a46a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:17:21.311702 19598 raft_consensus.cc:2258] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:17:21.311765 19600 ts_tablet_manager.cc:1905] T 104c9ff2c8894982bafbd6de82aeff4f P 7b553cf5817343db9afcdbed4e583963: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:17:21.313691 19598 ts_tablet_manager.cc:1905] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:17:21.319175 19599 ts_tablet_manager.cc:1918] T 104c9ff2c8894982bafbd6de82aeff4f P e052cf5e3cfa4eed947fe25e213a46a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:17:21.319402 19599 log.cc:1196] T 104c9ff2c8894982bafbd6de82aeff4f P e052cf5e3cfa4eed947fe25e213a46a1: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-2/wal/wals/104c9ff2c8894982bafbd6de82aeff4f
I20260807 04:17:21.319988 19599 ts_tablet_manager.cc:1939] T 104c9ff2c8894982bafbd6de82aeff4f P e052cf5e3cfa4eed947fe25e213a46a1: Deleting consensus metadata
I20260807 04:17:21.320304 19600 ts_tablet_manager.cc:1918] T 104c9ff2c8894982bafbd6de82aeff4f P 7b553cf5817343db9afcdbed4e583963: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:17:21.320546 19600 log.cc:1196] T 104c9ff2c8894982bafbd6de82aeff4f P 7b553cf5817343db9afcdbed4e583963: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-0/wal/wals/104c9ff2c8894982bafbd6de82aeff4f
I20260807 04:17:21.321179 19598 ts_tablet_manager.cc:1918] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:17:21.321358 19598 log.cc:1196] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786076137270840-7971-0/minicluster-data/ts-1/wal/wals/104c9ff2c8894982bafbd6de82aeff4f
I20260807 04:17:21.321400 19600 ts_tablet_manager.cc:1939] T 104c9ff2c8894982bafbd6de82aeff4f P 7b553cf5817343db9afcdbed4e583963: Deleting consensus metadata
I20260807 04:17:21.321924 19598 ts_tablet_manager.cc:1939] T 104c9ff2c8894982bafbd6de82aeff4f P 9c6d8b5d04214149ab9e07d5f77aa25c: Deleting consensus metadata
I20260807 04:17:21.322532 19053 catalog_manager.cc:4841] TS e052cf5e3cfa4eed947fe25e213a46a1 (127.7.200.195:33201): tablet 104c9ff2c8894982bafbd6de82aeff4f (table test-table [id=8c606bb5565d4c37a16a4130b1badce4]) successfully deleted
I20260807 04:17:21.323522 19053 catalog_manager.cc:4841] TS 7b553cf5817343db9afcdbed4e583963 (127.7.200.193:39313): tablet 104c9ff2c8894982bafbd6de82aeff4f (table test-table [id=8c606bb5565d4c37a16a4130b1badce4]) successfully deleted
I20260807 04:17:21.324260 19054 catalog_manager.cc:4841] TS 9c6d8b5d04214149ab9e07d5f77aa25c (127.7.200.194:42447): tablet 104c9ff2c8894982bafbd6de82aeff4f (table test-table [id=8c606bb5565d4c37a16a4130b1badce4]) successfully deleted
Aug 07 04:17:21 dist-test-slave-qg60 krb5kdc[19024](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076238, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.193@KRBTEST.COM
I20260807 04:17:21.334333 19570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:21.306436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58334 (local address 127.7.200.193:39313)
0807 04:17:21.306631 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:21.306638 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:21.310429 (+ 3791us) server_negotiation.cc:407] Connection header received
0807 04:17:21.310665 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:21.310671 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:21.310766 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:21.310845 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:21.312865 (+ 2020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:21.314072 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:21.315903 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:21.316585 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:21.316691 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:21.327132 (+ 10441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:17:21.327150 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:17:21.327170 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:17:21.327224 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:17:21.331158 (+ 3934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:17:21.331932 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:17:21.331942 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:17:21.331946 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:17:21.332111 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:17:21.332511 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:17:21.332517 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:17:21.332520 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:17:21.333057 (+ 537us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:17:21.333382 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0807 04:17:21.333700 (+ 318us) server_negotiation.cc:299] Negotiation successful
0807 04:17:21.333939 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 04:17:21.335210 19262 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:17:21.427899 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 19133
I20260807 04:17:21.449097 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 19274
Aug 07 04:17:21 dist-test-slave-qg60 krb5kdc[19024](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076238, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.194@KRBTEST.COM
I20260807 04:17:21.467223 19568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:21.449939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46282 (local address 127.7.200.194:42447)
0807 04:17:21.450177 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:21.450183 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:21.450207 (+ 24us) server_negotiation.cc:407] Connection header received
0807 04:17:21.450368 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:21.450374 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:21.450487 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:21.450620 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:21.451870 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:21.453206 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:21.454521 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:21.455231 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:21.455353 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:21.459629 (+ 4276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:17:21.459650 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:17:21.459674 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:17:21.459735 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:17:21.463980 (+ 4245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:17:21.464914 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:17:21.464923 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:17:21.464927 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:17:21.465099 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:17:21.465502 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:17:21.465507 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:17:21.465511 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:17:21.466010 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:17:21.466362 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0807 04:17:21.466557 (+ 195us) server_negotiation.cc:299] Negotiation successful
0807 04:17:21.466818 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260807 04:17:21.467998 19403 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:17:21.585072 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 19274
I20260807 04:17:21.608043 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 19414
Aug 07 04:17:21 dist-test-slave-qg60 krb5kdc[19024](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076238, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.195@KRBTEST.COM
I20260807 04:17:21.624548 19572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:17:21.608934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55516 (local address 127.7.200.195:33201)
0807 04:17:21.609116 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0807 04:17:21.609121 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:17:21.609212 (+ 91us) server_negotiation.cc:407] Connection header received
0807 04:17:21.609428 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:17:21.609432 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:17:21.609555 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:17:21.609648 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:17:21.611191 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:21.611931 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:21.613445 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:17:21.613892 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:17:21.614033 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:17:21.618678 (+ 4645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:17:21.618694 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:17:21.618709 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:17:21.618745 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:17:21.621989 (+ 3244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:17:21.622740 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:17:21.622748 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:17:21.622750 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:17:21.622904 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:17:21.623243 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:17:21.623246 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:17:21.623248 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:17:21.623607 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:17:21.623843 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0807 04:17:21.624099 (+ 256us) server_negotiation.cc:299] Negotiation successful
0807 04:17:21.624268 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 04:17:21.625360 19545 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:17:21.717336 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 19414
I20260807 04:17:21.737058 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 19037
I20260807 04:17:21.738278 19101 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:17:21.851102 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 19037
2026-08-07T04:17:21Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4699 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:17:21 dist-test-slave-qg60 krb5kdc[19608](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:17:21 dist-test-slave-qg60 krb5kdc[19608](info): set up 2 sockets
Aug 07 04:17:21 dist-test-slave-qg60 krb5kdc[19608](info): commencing operation
krb5kdc: starting...
W20260807 04:17:23.044572 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.148s user 0.000s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:17:23 dist-test-slave-qg60 krb5kdc[19608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076243, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:17:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:17:23Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.7.200.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.7.200.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.7.200.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/rangeradmin_127.7.200.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.7.200.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/rangeradmin_127.7.200.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.7.200.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.7.200.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.7.200.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/rangerlookup_127.7.200.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.7.200.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/rangerlookup_127.7.200.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.7.200.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.7.200.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.7.200.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/HTTP_127.7.200.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.7.200.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/HTTP_127.7.200.212@KRBTEST.COM.keytab.
I20260807 04:17:23.490309 7971 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskMk3R5R/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/postgres -l logfile start
2026-08-07 04:17:26.231 UTC [19640] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 04:17:26.231 UTC [19640] LOG: listening on IPv4 address "127.7.200.212", port 59017
2026-08-07 04:17:26.236 UTC [19640] LOG: listening on Unix socket "/tmp/.s.PGSQL.59017"
2026-08-07 04:17:26.263 UTC [19642] LOG: database system was shut down at 2026-08-07 04:17:24 UTC
2026-08-07 04:17:26.267 UTC [19640] LOG: database system is ready to accept connections
I20260807 04:17:27.350051 7971 mini_postgres.cc:96] Postgres bound to 59017
2026-08-07 04:17:27.376 UTC [19651] FATAL: database "slave" does not exist
127.7.200.212:59017 - accepting connections
I20260807 04:17:27.377939 7971 mini_ranger.cc:161] Starting Ranger...
I20260807 04:17:27.413825 7971 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 04:17:27.962839 7971 mini_ranger.cc:87] Created ranger Postgres database
I20260807 04:17:27.962987 7971 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ranger-admin
2026-08-07 04:17:28,317 [I] DB FLAVOR :POSTGRES
2026-08-07 04:17:28,318 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 04:17:28,318 [I] Checking connection..
2026-08-07 04:17:28,318 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 04:17:28,590 [I] Checking connection passed.
2026-08-07 04:17:28,590 [I] --------- Verifying version history table ---------
2026-08-07 04:17:28,590 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 04:17:28,891 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 04:17:28,892 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 04:17:29,158 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 04:17:29,159 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 04:17:29,159 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 04:17:29.410 UTC [19719] WARNING: there is no transaction in progress
2026-08-07 04:17:29,420 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 04:17:29,421 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 04:17:29,679 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 04:17:29,679 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 04:17:29,679 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 04:17:29,910 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 04:17:30,165 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-qg60.c.gcp-upstream.internal','N') ;"
2026-08-07 04:17:30,400 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 04:17:30,647 [I] Table x_portal_user does not exist in database ranger
2026-08-07 04:17:30,647 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 04:17:30,930 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 04:17:30,931 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 04:17:31,189 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 04:17:31,454 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 04:17:31,454 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 04:17:32.480 UTC [19833] WARNING: there is no transaction in progress
2026-08-07 04:17:32.497 UTC [19833] WARNING: there is no transaction in progress
2026-08-07 04:17:32.514 UTC [19833] WARNING: there is no transaction in progress
2026-08-07 04:17:32.530 UTC [19833] WARNING: there is no transaction in progress
2026-08-07 04:17:32.547 UTC [19833] WARNING: there is no transaction in progress
2026-08-07 04:17:32.565 UTC [19833] WARNING: there is no transaction in progress
2026-08-07 04:17:32.620 UTC [19833] WARNING: there is no transaction in progress
2026-08-07 04:17:32.627 UTC [19833] WARNING: there is no transaction in progress
2026-08-07 04:17:32.642 UTC [19833] WARNING: there is no transaction in progress
2026-08-07 04:17:32.652 UTC [19833] WARNING: there is no transaction in progress
2026-08-07 04:17:32.665 UTC [19833] WARNING: there is no transaction in progress
2026-08-07 04:17:32.679 UTC [19833] WARNING: there is no transaction in progress
2026-08-07 04:17:32.690 UTC [19833] WARNING: there is no transaction in progress
2026-08-07 04:17:32.696 UTC [19833] WARNING: there is no transaction in progress
2026-08-07 04:17:32.704 UTC [19833] WARNING: there is no transaction in progress
2026-08-07 04:17:32.711 UTC [19833] WARNING: there is no transaction in progress
2026-08-07 04:17:33,411 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 04:17:33,412 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 04:17:33,655 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 04:17:33,655 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 04:17:33,917 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 04:17:33,917 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 04:17:34,184 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 04:17:34,184 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 04:17:34,454 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 04:17:34,720 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-qg60.c.gcp-upstream.internal';"
2026-08-07 04:17:34,977 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 04:17:34,977 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:59017/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 04:17:35,231 [I] DB_PATCHES have already been applied
I20260807 04:17:35.237569 7971 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ranger-admin:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskMk3R5R/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 04:17:35.237669 7971 mini_ranger.cc:193] Using host: 127.7.200.212
I20260807 04:17:35.260234 7971 mini_ranger.cc:227] Ranger admin URL: http://127.7.200.212:43243
Aug 07, 2026 4:17:35 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 4:17:35 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 4:17:35 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 4:17:35 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 4:17:35 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 4:17:36 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 4:17:36 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 04:17:36.481359 7971 mini_ranger.cc:160] Time spent starting Ranger: real 9.103s user 0.002s sys 0.069s
Aug 07, 2026 4:17:57 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 4:17:57 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 07, 2026 4:17:57 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 4:17:57 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 4:17:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 4:17:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 4:17:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 4:17:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 4:17:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 4:17:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 4:17:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 4:17:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 4:17:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 4:17:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 4:17:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 4:17:57 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 4:17:57 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 4:17:58 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 04:17:59.476069 7971 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.7.200.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.7.200.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.7.200.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/rangerkms_127.7.200.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.7.200.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/rangerkms_127.7.200.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.7.200.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.7.200.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.7.200.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/HTTP_127.7.200.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.7.200.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/HTTP_127.7.200.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 04:17:59 dist-test-slave-qg60 krb5kdc[19608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076279, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 04:17:59.729475 7971 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 04:17:59.759521 7971 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 04:18:00.709817 7971 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 04:18:00.710095 7971 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ranger-kms
I20260807 04:18:00.710242 7971 mini_ranger_kms.cc:227] Using postgres at 127.7.200.212:59017
2026-08-07 04:18:01,610 [I] DB FLAVOR :POSTGRES
2026-08-07 04:18:01,610 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 04:18:01,610 [I] Checking connection
2026-08-07 04:18:01,610 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:59017/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 04:18:01,909 [I] connection success
2026-08-07 04:18:01,909 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 04:18:01,910 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 04:18:01,910 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:59017/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 04:18:02,183 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 04:18:02,184 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 04:18:02,184 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 04:18:02,184 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:59017/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 04:18:02,469 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 04:18:02.990345 7971 mini_ranger_kms.cc:310] Created kms service
I20260807 04:18:03.163838 7971 mini_ranger_kms.cc:326] Created kudu user
I20260807 04:18:03.217969 7971 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 04:18:03 dist-test-slave-qg60 krb5kdc[19608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076279, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.7.200.212@KRBTEST.COM
I20260807 04:18:03.624579 7971 mini_ranger_kms.cc:384] Added ranger policy
I20260807 04:18:03.626164 7971 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ranger-kms:/tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 04:18:03.626255 7971 mini_ranger_kms.cc:240] Using host: 127.7.200.212
I20260807 04:18:03.659375 7971 mini_ranger_kms.cc:276] Ranger KMS PID: 20021
I20260807 04:18:03.659600 7971 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.7.200.212:53645
Aug 07, 2026 4:18:04 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 4:18:04 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 4:18:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 4:18:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 4:18:05 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 4:18:05 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 07 04:18:05 dist-test-slave-qg60 krb5kdc[19608](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786076285, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.7.200.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:18:06.187165 7971 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.458s user 0.139s sys 0.450s
I20260807 04:18:06.187548 7971 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 04:18:06.187800 7971 mini_ranger_kms.cc:401] 127.7.200.212:53645/kms/v1/keys
Aug 07 04:18:06 dist-test-slave-qg60 krb5kdc[19608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076285, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.7.200.212@KRBTEST.COM for HTTP/127.7.200.212@KRBTEST.COM
Aug 07 04:18:06 dist-test-slave-qg60 krb5kdc[19608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076285, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.7.200.212@KRBTEST.COM for HTTP/127.7.200.212@KRBTEST.COM
Aug 07 04:18:09 dist-test-slave-qg60 krb5kdc[19608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076289, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
I20260807 04:18:09.193338 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:43641
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:38509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:43641
--ranger_config_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.200.212:53645/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:18:09.578054 20073 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:18:09.578382 20073 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:18:09.578557 20073 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:18:09.586894 20073 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:18:09.587061 20073 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:18:09.587144 20073 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:18:09.587262 20073 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:18:09.587347 20073 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:18:09.599664 20073 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:38509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/master-0/wal
--ranger_kms_url=127.7.200.212:53645/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:43641
--ranger_config_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:43641
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:18:09.601311 20073 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:18:09.602783 20073 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:18:09.620234 20079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:18:09.620616 20081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:18:09.620939 20078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:18:09.621575 20073 server_base.cc:1034] running on GCE node
I20260807 04:18:09.622587 20073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:18:09.624253 20073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:18:09.625524 20073 hybrid_clock.cc:648] HybridClock initialized: now 1786076289625461 us; error 35 us; skew 500 ppm
I20260807 04:18:09.625931 20073 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:18:09 dist-test-slave-qg60 krb5kdc[19608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076289, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:18:09.635867 20073 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:18:09.638888 20073 webserver.cc:460] Webserver started at http://127.7.200.254:43845/ using document root <none> and password file <none>
I20260807 04:18:09.639917 20073 fs_manager.cc:359] Metadata directory not provided
I20260807 04:18:09.640071 20073 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:18:09.640476 20073 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 04:18:09 dist-test-slave-qg60 krb5kdc[19608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076289, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for HTTP/127.7.200.212@KRBTEST.COM
I20260807 04:18:09.715405 20073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "3fc45151b94c4c7db2a167615d8a3436"
format_stamp: "Formatted at 2026-08-07 04:18:09 on dist-test-slave-qg60"
server_key: "e8acde0f76258aa0cd731202322681ec"
server_key_iv: "525fb8cc84b40414100cf1e0490b2c1d"
server_key_version: "kuduclusterkey@0"
I20260807 04:18:09.716600 20073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "3fc45151b94c4c7db2a167615d8a3436"
format_stamp: "Formatted at 2026-08-07 04:18:09 on dist-test-slave-qg60"
server_key: "e8acde0f76258aa0cd731202322681ec"
server_key_iv: "525fb8cc84b40414100cf1e0490b2c1d"
server_key_version: "kuduclusterkey@0"
I20260807 04:18:09.724004 20073 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.001s sys 0.005s
I20260807 04:18:09.745095 20089 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:18:09.746961 20073 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260807 04:18:09.747232 20073 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "3fc45151b94c4c7db2a167615d8a3436"
format_stamp: "Formatted at 2026-08-07 04:18:09 on dist-test-slave-qg60"
server_key: "e8acde0f76258aa0cd731202322681ec"
server_key_iv: "525fb8cc84b40414100cf1e0490b2c1d"
server_key_version: "kuduclusterkey@0"
I20260807 04:18:09.747507 20073 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:18:09.770716 20073 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:18:09.775650 20073 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:18:09.775991 20073 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:18:09.797322 20073 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:43641
I20260807 04:18:09.797341 20142 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:43641 every 8 connection(s)
I20260807 04:18:09.798862 20073 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:18:09.803069 20143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:18:09.803251 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 20073
I20260807 04:18:09.803467 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:18:09.804286 7971 external_mini_cluster.cc:1428] Setting key c286f4255c0fa08ae7593828180cabc6
I20260807 04:18:09.822129 20143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fc45151b94c4c7db2a167615d8a3436: Bootstrap starting.
I20260807 04:18:09.826133 20143 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3fc45151b94c4c7db2a167615d8a3436: Neither blocks nor log segments found. Creating new log.
I20260807 04:18:09.827507 20143 log.cc:824] T 00000000000000000000000000000000 P 3fc45151b94c4c7db2a167615d8a3436: Log is configured to *not* fsync() on all Append() calls
I20260807 04:18:09.831429 20143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fc45151b94c4c7db2a167615d8a3436: No bootstrap required, opened a new log
Aug 07 04:18:09 dist-test-slave-qg60 krb5kdc[19608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076289, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:18:09.842666 20143 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3fc45151b94c4c7db2a167615d8a3436 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fc45151b94c4c7db2a167615d8a3436" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43641 } }
I20260807 04:18:09.843140 20143 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3fc45151b94c4c7db2a167615d8a3436 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:18:09.843309 20143 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3fc45151b94c4c7db2a167615d8a3436 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fc45151b94c4c7db2a167615d8a3436, State: Initialized, Role: FOLLOWER
I20260807 04:18:09.844158 20143 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3fc45151b94c4c7db2a167615d8a3436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fc45151b94c4c7db2a167615d8a3436" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43641 } }
I20260807 04:18:09.844496 20143 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3fc45151b94c4c7db2a167615d8a3436 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:18:09.844694 20143 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3fc45151b94c4c7db2a167615d8a3436 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:18:09.844938 20143 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3fc45151b94c4c7db2a167615d8a3436 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:18:09.847721 20147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:18:09.806579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35746 (local address 127.7.200.254:43641)
0807 04:18:09.821331 (+ 14752us) server_negotiation.cc:206] Beginning negotiation
0807 04:18:09.821349 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 04:18:09.821408 (+ 59us) server_negotiation.cc:407] Connection header received
0807 04:18:09.824148 (+ 2740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:18:09.824187 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:18:09.824756 (+ 569us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:18:09.825194 (+ 438us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:18:09.827100 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:18:09.829166 (+ 2066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:18:09.831000 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:18:09.832073 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:18:09.832258 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:18:09.837590 (+ 5332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:18:09.837608 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:18:09.837633 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:18:09.837699 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:18:09.842085 (+ 4386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:18:09.843040 (+ 955us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:18:09.843050 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:18:09.843059 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:18:09.843273 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:18:09.843829 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:18:09.843834 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:18:09.843839 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:18:09.844778 (+ 939us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:18:09.845110 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0807 04:18:09.845678 (+ 568us) server_negotiation.cc:299] Negotiation successful
0807 04:18:09.846189 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14481,"thread_start_us":15669,"threads_started":1}
I20260807 04:18:09.848596 20143 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3fc45151b94c4c7db2a167615d8a3436 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fc45151b94c4c7db2a167615d8a3436" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43641 } }
I20260807 04:18:09.849308 20143 leader_election.cc:302] T 00000000000000000000000000000000 P 3fc45151b94c4c7db2a167615d8a3436 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3fc45151b94c4c7db2a167615d8a3436; no voters:
I20260807 04:18:09.850076 20143 leader_election.cc:288] T 00000000000000000000000000000000 P 3fc45151b94c4c7db2a167615d8a3436 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:18:09.850256 20149 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3fc45151b94c4c7db2a167615d8a3436 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:18:09.851606 20149 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3fc45151b94c4c7db2a167615d8a3436 [term 1 LEADER]: Becoming Leader. State: Replica: 3fc45151b94c4c7db2a167615d8a3436, State: Running, Role: LEADER
I20260807 04:18:09.852605 20149 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3fc45151b94c4c7db2a167615d8a3436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fc45151b94c4c7db2a167615d8a3436" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43641 } }
I20260807 04:18:09.853850 20143 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3fc45151b94c4c7db2a167615d8a3436 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:18:09.855685 20151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fc45151b94c4c7db2a167615d8a3436 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3fc45151b94c4c7db2a167615d8a3436" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fc45151b94c4c7db2a167615d8a3436" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43641 } } }
I20260807 04:18:09.856186 20151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fc45151b94c4c7db2a167615d8a3436 [sys.catalog]: This master's current role is: LEADER
I20260807 04:18:09.860342 20150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fc45151b94c4c7db2a167615d8a3436 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3fc45151b94c4c7db2a167615d8a3436. Latest consensus state: current_term: 1 leader_uuid: "3fc45151b94c4c7db2a167615d8a3436" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fc45151b94c4c7db2a167615d8a3436" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43641 } } }
I20260807 04:18:09.860719 20150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fc45151b94c4c7db2a167615d8a3436 [sys.catalog]: This master's current role is: LEADER
I20260807 04:18:09.865675 20155 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:18:09.872380 20155 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:18:09.873514 20143 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 04:18:09.901019 20155 catalog_manager.cc:1347] Generated new cluster ID: 27d4ced7b2ac474f9baa2196bfb752e7
I20260807 04:18:09.901253 20155 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:18:09.915376 20155 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:18:09.917624 20155 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:18:09.935722 20155 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3fc45151b94c4c7db2a167615d8a3436: Generated new TSK 0
I20260807 04:18:09.937129 20155 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.200.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
I20260807 04:18:10.906514 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.200.212:53645/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:0
--local_ip_for_outbound_sockets=127.7.200.193
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:43641
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:38509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 04:18:11 dist-test-slave-qg60 krb5kdc[19608](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786076291, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260807 04:18:11.360677 20191 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:18:11.361253 20191 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:18:11.361476 20191 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:18:11.373639 20191 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:18:11.373888 20191 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:18:11.374147 20191 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:18:11.390651 20191 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:38509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.7.200.212:53645/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:43641
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:18:11.392527 20191 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:18:11.394515 20191 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:18:11.412223 20202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:18:11.413075 20201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:18:11.417017 20204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:18:11.423991 20191 server_base.cc:1034] running on GCE node
I20260807 04:18:11.424962 20191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:18:11.431608 20191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:18:11.432978 20191 hybrid_clock.cc:648] HybridClock initialized: now 1786076291432849 us; error 120 us; skew 500 ppm
I20260807 04:18:11.433472 20191 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:18:11 dist-test-slave-qg60 krb5kdc[19608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076291, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:18:11.438355 20191 init.cc:377] Logged in from keytab as kudu/127.7.200.193@KRBTEST.COM (short username kudu)
I20260807 04:18:11.451923 20191 webserver.cc:460] Webserver started at http://127.7.200.193:40749/ using document root <none> and password file <none>
I20260807 04:18:11.453198 20191 fs_manager.cc:359] Metadata directory not provided
I20260807 04:18:11.453423 20191 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:18:11.453972 20191 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 04:18:11 dist-test-slave-qg60 krb5kdc[19608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076291, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for HTTP/127.7.200.212@KRBTEST.COM
I20260807 04:18:11.473829 20191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-0/data/instance:
uuid: "81ba25c220e74f4cbd77bbafe0f49704"
format_stamp: "Formatted at 2026-08-07 04:18:11 on dist-test-slave-qg60"
server_key: "a1428c59d6aeeee56f60ad672fb31c56"
server_key_iv: "12093dd27af4c41987e7d631cd452588"
server_key_version: "kuduclusterkey@0"
I20260807 04:18:11.475018 20191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance:
uuid: "81ba25c220e74f4cbd77bbafe0f49704"
format_stamp: "Formatted at 2026-08-07 04:18:11 on dist-test-slave-qg60"
server_key: "a1428c59d6aeeee56f60ad672fb31c56"
server_key_iv: "12093dd27af4c41987e7d631cd452588"
server_key_version: "kuduclusterkey@0"
I20260807 04:18:11.482972 20191 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.003s sys 0.003s
I20260807 04:18:11.506013 20211 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:18:11.508380 20191 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.000s sys 0.004s
I20260807 04:18:11.508713 20191 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "81ba25c220e74f4cbd77bbafe0f49704"
format_stamp: "Formatted at 2026-08-07 04:18:11 on dist-test-slave-qg60"
server_key: "a1428c59d6aeeee56f60ad672fb31c56"
server_key_iv: "12093dd27af4c41987e7d631cd452588"
server_key_version: "kuduclusterkey@0"
I20260807 04:18:11.509195 20191 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:18:11.548995 20191 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:18:11.555631 20191 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:18:11.556100 20191 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:18:11.563715 20191 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:18:11.572184 20191 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:18:11.572383 20191 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260807 04:18:11.572618 20191 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:18:11.573014 20191 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:18:11.657187 20191 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:46765
I20260807 04:18:11.657243 20331 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:46765 every 8 connection(s)
I20260807 04:18:11.659238 20191 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:18:11.665864 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 20191
I20260807 04:18:11.666123 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance
I20260807 04:18:11.667016 7971 external_mini_cluster.cc:1428] Setting key 8b68a673fc84c4cf454a874d0599367c
Aug 07 04:18:11 dist-test-slave-qg60 krb5kdc[19608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076291, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.200.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.194@KRBTEST.COM" created.
I20260807 04:18:11.720047 20335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:18:11.665026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:43641 (local address 127.7.200.193:55315)
0807 04:18:11.694393 (+ 29367us) negotiation.cc:107] Waiting for socket to connect
0807 04:18:11.694463 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0807 04:18:11.697572 (+ 3109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:18:11.698932 (+ 1360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:18:11.698963 (+ 31us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:18:11.699639 (+ 676us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:18:11.700521 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:18:11.700546 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:18:11.702261 (+ 1715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:18:11.702267 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:18:11.704471 (+ 2204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:18:11.704499 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:18:11.705852 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:18:11.705859 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:18:11.706155 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:18:11.706853 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:18:11.706891 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:18:11.710011 (+ 3120us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:18:11.714575 (+ 4564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:18:11.714589 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:18:11.714610 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:18:11.715293 (+ 683us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:18:11.715867 (+ 574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:18:11.715872 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:18:11.715876 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:18:11.716156 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:18:11.716861 (+ 705us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:18:11.716870 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:18:11.717457 (+ 587us) client_negotiation.cc:769] Sending connection context
0807 04:18:11.717882 (+ 425us) client_negotiation.cc:240] Negotiation successful
0807 04:18:11.718471 (+ 589us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28949,"thread_start_us":39638,"threads_started":1}
I20260807 04:18:11.720372 20334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:18:11.664349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:55315 (local address 127.7.200.254:43641)
0807 04:18:11.680059 (+ 15710us) server_negotiation.cc:206] Beginning negotiation
0807 04:18:11.680067 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:18:11.694620 (+ 14553us) server_negotiation.cc:407] Connection header received
0807 04:18:11.698069 (+ 3449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:18:11.698076 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:18:11.698189 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:18:11.698274 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:18:11.700774 (+ 2500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:18:11.702022 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:18:11.704670 (+ 2648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:18:11.705364 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:18:11.705471 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:18:11.710302 (+ 4831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:18:11.710309 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:18:11.710313 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:18:11.710357 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:18:11.714412 (+ 4055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:18:11.715450 (+ 1038us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:18:11.715456 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:18:11.715459 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:18:11.715665 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:18:11.716294 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:18:11.716300 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:18:11.716303 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:18:11.716680 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:18:11.716872 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0807 04:18:11.718562 (+ 1690us) server_negotiation.cc:299] Negotiation successful
0807 04:18:11.718815 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15524,"thread_start_us":15715,"threads_started":1}
I20260807 04:18:11.722715 20332 heartbeater.cc:347] Connected to a master server at 127.7.200.254:43641
I20260807 04:18:11.723073 20332 heartbeater.cc:464] Registering TS with master...
I20260807 04:18:11.723960 20332 heartbeater.cc:511] Master 127.7.200.254:43641 requested a full tablet report, sending...
Aug 07 04:18:11 dist-test-slave-qg60 krb5kdc[19608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076291, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for HTTP/127.7.200.212@KRBTEST.COM
I20260807 04:18:11.726660 20106 ts_manager.cc:194] Registered new tserver with Master: 81ba25c220e74f4cbd77bbafe0f49704 (127.7.200.193:46765)
I20260807 04:18:11.728917 20106 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.193@KRBTEST.COM'} at 127.7.200.193:55315
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
I20260807 04:18:11.766757 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.200.212:53645/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:0
--local_ip_for_outbound_sockets=127.7.200.194
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:43641
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:38509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 04:18:11 dist-test-slave-qg60 krb5kdc[19608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076291, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for HTTP/127.7.200.212@KRBTEST.COM
W20260807 04:18:12.291991 20338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:18:12.292500 20338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:18:12.292690 20338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:18:12.304596 20338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:18:12.304874 20338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:18:12.305114 20338 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:18:12.321184 20338 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:38509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.7.200.212:53645/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:43641
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:18:12.323226 20338 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:18:12.325067 20338 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:18:12.361323 20347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:18:12.361433 20346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:18:12.364490 20350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:18:12.364996 20338 server_base.cc:1034] running on GCE node
I20260807 04:18:12.366683 20338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:18:12.371912 20338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:18:12.373210 20338 hybrid_clock.cc:648] HybridClock initialized: now 1786076292373091 us; error 104 us; skew 500 ppm
I20260807 04:18:12.373708 20338 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:18:12 dist-test-slave-qg60 krb5kdc[19608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076292, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:18:12.383242 20338 init.cc:377] Logged in from keytab as kudu/127.7.200.194@KRBTEST.COM (short username kudu)
I20260807 04:18:12.399200 20338 webserver.cc:460] Webserver started at http://127.7.200.194:43413/ using document root <none> and password file <none>
I20260807 04:18:12.400188 20338 fs_manager.cc:359] Metadata directory not provided
I20260807 04:18:12.400350 20338 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:18:12.400830 20338 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 04:18:12 dist-test-slave-qg60 krb5kdc[19608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076292, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for HTTP/127.7.200.212@KRBTEST.COM
I20260807 04:18:12.426189 20338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-1/data/instance:
uuid: "aacbe894cad0491490540570ee62fbfa"
format_stamp: "Formatted at 2026-08-07 04:18:12 on dist-test-slave-qg60"
server_key: "02ad17adc95752a45e6c5703895f21f1"
server_key_iv: "0b90a217b6a861fa969ea91cefc56ec5"
server_key_version: "kuduclusterkey@0"
I20260807 04:18:12.427547 20338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance:
uuid: "aacbe894cad0491490540570ee62fbfa"
format_stamp: "Formatted at 2026-08-07 04:18:12 on dist-test-slave-qg60"
server_key: "02ad17adc95752a45e6c5703895f21f1"
server_key_iv: "0b90a217b6a861fa969ea91cefc56ec5"
server_key_version: "kuduclusterkey@0"
I20260807 04:18:12.437358 20338 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.004s sys 0.004s
I20260807 04:18:12.469523 20363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:18:12.471720 20338 fs_manager.cc:725] Time spent opening block manager: real 0.017s user 0.014s sys 0.002s
I20260807 04:18:12.472002 20338 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "aacbe894cad0491490540570ee62fbfa"
format_stamp: "Formatted at 2026-08-07 04:18:12 on dist-test-slave-qg60"
server_key: "02ad17adc95752a45e6c5703895f21f1"
server_key_iv: "0b90a217b6a861fa969ea91cefc56ec5"
server_key_version: "kuduclusterkey@0"
I20260807 04:18:12.472364 20338 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:18:12.536875 20338 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:18:12.542572 20338 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:18:12.543012 20338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:18:12.550552 20338 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:18:12.559149 20338 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:18:12.559353 20338 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260807 04:18:12.559576 20338 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:18:12.559697 20338 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:18:12.723405 20338 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:34235
I20260807 04:18:12.723434 20483 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:34235 every 8 connection(s)
I20260807 04:18:12.725221 20338 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:18:12.730552 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 20338
I20260807 04:18:12.730731 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance
I20260807 04:18:12.731297 7971 external_mini_cluster.cc:1428] Setting key 28873d87e37d788e74467d29a3750bdb
I20260807 04:18:12.733057 20332 heartbeater.cc:503] Master 127.7.200.254:43641 was elected leader, sending a full tablet report...
Aug 07 04:18:12 dist-test-slave-qg60 krb5kdc[19608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076292, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.200.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.195@KRBTEST.COM" created.
I20260807 04:18:12.785684 20486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:18:12.729003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:52967 (local address 127.7.200.254:43641)
0807 04:18:12.762019 (+ 33016us) server_negotiation.cc:206] Beginning negotiation
0807 04:18:12.762027 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:18:12.762053 (+ 26us) server_negotiation.cc:407] Connection header received
0807 04:18:12.764984 (+ 2931us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:18:12.764990 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:18:12.765073 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:18:12.765172 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:18:12.767371 (+ 2199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:18:12.768523 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:18:12.770919 (+ 2396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:18:12.771531 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:18:12.771626 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:18:12.776404 (+ 4778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:18:12.776410 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:18:12.776414 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:18:12.776472 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:18:12.781823 (+ 5351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:18:12.782817 (+ 994us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:18:12.782823 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:18:12.782827 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:18:12.782991 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:18:12.783520 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:18:12.783525 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:18:12.783529 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:18:12.783888 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:18:12.784040 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 04:18:12.785070 (+ 1030us) server_negotiation.cc:299] Negotiation successful
0807 04:18:12.785304 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32856,"thread_start_us":33048,"threads_started":1}
I20260807 04:18:12.788199 20487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:18:12.729254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:43641 (local address 127.7.200.194:52967)
0807 04:18:12.759052 (+ 29798us) negotiation.cc:107] Waiting for socket to connect
0807 04:18:12.759115 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0807 04:18:12.764476 (+ 5361us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:18:12.765624 (+ 1148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:18:12.765638 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:18:12.766327 (+ 689us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:18:12.767168 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:18:12.767199 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:18:12.768713 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:18:12.768718 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:18:12.770757 (+ 2039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:18:12.770772 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:18:12.771984 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:18:12.771991 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:18:12.772262 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:18:12.773145 (+ 883us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:18:12.773183 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:18:12.776117 (+ 2934us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:18:12.782024 (+ 5907us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:18:12.782034 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:18:12.782052 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:18:12.782665 (+ 613us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:18:12.783121 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:18:12.783126 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:18:12.783130 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:18:12.783370 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:18:12.784112 (+ 742us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:18:12.784121 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:18:12.784569 (+ 448us) client_negotiation.cc:769] Sending connection context
0807 04:18:12.786103 (+ 1534us) client_negotiation.cc:240] Negotiation successful
0807 04:18:12.786651 (+ 548us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29408,"thread_start_us":31388,"threads_started":1}
I20260807 04:18:12.790017 20484 heartbeater.cc:347] Connected to a master server at 127.7.200.254:43641
I20260807 04:18:12.790333 20484 heartbeater.cc:464] Registering TS with master...
I20260807 04:18:12.791159 20484 heartbeater.cc:511] Master 127.7.200.254:43641 requested a full tablet report, sending...
I20260807 04:18:12.792845 20106 ts_manager.cc:194] Registered new tserver with Master: aacbe894cad0491490540570ee62fbfa (127.7.200.194:34235)
I20260807 04:18:12.793918 20106 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.194@KRBTEST.COM'} at 127.7.200.194:52967
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
I20260807 04:18:12.823911 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.200.212:53645/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:0
--local_ip_for_outbound_sockets=127.7.200.195
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:43641
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:38509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:18:13.255087 20490 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:18:13.255401 20490 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:18:13.255616 20490 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:18:13.264041 20490 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:18:13.264170 20490 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:18:13.264377 20490 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:18:13.276084 20490 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:38509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.7.200.212:53645/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:43641
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:18:13.277711 20490 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:18:13.279237 20490 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:18:13.293946 20496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:18:13.293977 20497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:18:13.293900 20499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:18:13.295336 20490 server_base.cc:1034] running on GCE node
I20260807 04:18:13.296051 20490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:18:13.297269 20490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:18:13.298524 20490 hybrid_clock.cc:648] HybridClock initialized: now 1786076293298475 us; error 41 us; skew 500 ppm
I20260807 04:18:13.298882 20490 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:18:13 dist-test-slave-qg60 krb5kdc[19608](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076293, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:18:13.302556 20490 init.cc:377] Logged in from keytab as kudu/127.7.200.195@KRBTEST.COM (short username kudu)
I20260807 04:18:13.304139 20490 webserver.cc:460] Webserver started at http://127.7.200.195:37671/ using document root <none> and password file <none>
I20260807 04:18:13.304953 20490 fs_manager.cc:359] Metadata directory not provided
I20260807 04:18:13.305120 20490 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:18:13.305469 20490 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 04:18:13 dist-test-slave-qg60 krb5kdc[19608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076293, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for HTTP/127.7.200.212@KRBTEST.COM
I20260807 04:18:13.323423 20490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-2/data/instance:
uuid: "51e5184d2f3746f78be8bf376b8033a0"
format_stamp: "Formatted at 2026-08-07 04:18:13 on dist-test-slave-qg60"
server_key: "3c6d55c1d4062d82910ae80cc74155d6"
server_key_iv: "2db23b80f7a18fa2bf97687f737b45bd"
server_key_version: "kuduclusterkey@0"
I20260807 04:18:13.324538 20490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance:
uuid: "51e5184d2f3746f78be8bf376b8033a0"
format_stamp: "Formatted at 2026-08-07 04:18:13 on dist-test-slave-qg60"
server_key: "3c6d55c1d4062d82910ae80cc74155d6"
server_key_iv: "2db23b80f7a18fa2bf97687f737b45bd"
server_key_version: "kuduclusterkey@0"
I20260807 04:18:13.331597 20490 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
I20260807 04:18:13.346716 20506 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:18:13.348367 20490 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 04:18:13.348589 20490 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "51e5184d2f3746f78be8bf376b8033a0"
format_stamp: "Formatted at 2026-08-07 04:18:13 on dist-test-slave-qg60"
server_key: "3c6d55c1d4062d82910ae80cc74155d6"
server_key_iv: "2db23b80f7a18fa2bf97687f737b45bd"
server_key_version: "kuduclusterkey@0"
I20260807 04:18:13.348906 20490 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:18:13.391199 20490 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:18:13.395874 20490 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:18:13.396234 20490 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:18:13.397383 20490 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:18:13.398916 20490 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:18:13.399031 20490 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:18:13.399204 20490 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:18:13.399286 20490 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:18:13.435942 20490 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:39059
I20260807 04:18:13.435985 20625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:39059 every 8 connection(s)
I20260807 04:18:13.437420 20490 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:18:13.443713 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 20490
I20260807 04:18:13.443956 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance
I20260807 04:18:13.444522 7971 external_mini_cluster.cc:1428] Setting key 16477febfe2c07a8bb20c226ed6b7ffc
Aug 07 04:18:13 dist-test-slave-qg60 krb5kdc[19608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076293, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:18:13.459460 20628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:18:13.440268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:46811 (local address 127.7.200.254:43641)
0807 04:18:13.440767 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0807 04:18:13.440772 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:18:13.441802 (+ 1030us) server_negotiation.cc:407] Connection header received
0807 04:18:13.443696 (+ 1894us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:18:13.443703 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:18:13.443831 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:18:13.443962 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:18:13.445787 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.446768 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.448605 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.449185 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.449309 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:18:13.452924 (+ 3615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:18:13.452932 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:18:13.452937 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:18:13.452995 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:18:13.456196 (+ 3201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:18:13.457020 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:18:13.457024 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:18:13.457026 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:18:13.457169 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:18:13.457588 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:18:13.457591 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:18:13.457593 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:18:13.457854 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:18:13.457974 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 04:18:13.458850 (+ 876us) server_negotiation.cc:299] Negotiation successful
0807 04:18:13.459068 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":267,"threads_started":1}
I20260807 04:18:13.460609 20629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:18:13.440911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:43641 (local address 127.7.200.195:46811)
0807 04:18:13.441630 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0807 04:18:13.441674 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 04:18:13.443412 (+ 1738us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:18:13.444247 (+ 835us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:18:13.444261 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:18:13.444929 (+ 668us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:18:13.445618 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:18:13.445637 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.446937 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.446941 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:18:13.448433 (+ 1492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:18:13.448446 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.449392 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.449396 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:18:13.449590 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:18:13.450296 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:18:13.450323 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:18:13.452607 (+ 2284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:18:13.456334 (+ 3727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:18:13.456341 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:18:13.456353 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:18:13.456864 (+ 511us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:18:13.457272 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:18:13.457275 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:18:13.457277 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:18:13.457482 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:18:13.458016 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:18:13.458023 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:18:13.458411 (+ 388us) client_negotiation.cc:769] Sending connection context
0807 04:18:13.458724 (+ 313us) client_negotiation.cc:240] Negotiation successful
0807 04:18:13.459259 (+ 535us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":302,"threads_started":1}
I20260807 04:18:13.461895 20626 heartbeater.cc:347] Connected to a master server at 127.7.200.254:43641
I20260807 04:18:13.462248 20626 heartbeater.cc:464] Registering TS with master...
I20260807 04:18:13.462971 20626 heartbeater.cc:511] Master 127.7.200.254:43641 requested a full tablet report, sending...
I20260807 04:18:13.464345 20106 ts_manager.cc:194] Registered new tserver with Master: 51e5184d2f3746f78be8bf376b8033a0 (127.7.200.195:39059)
I20260807 04:18:13.465387 20106 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.195@KRBTEST.COM'} at 127.7.200.195:46811
I20260807 04:18:13.473351 7971 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 04:18:13.492394 20628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:18:13.478430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53760 (local address 127.7.200.254:43641)
0807 04:18:13.478700 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0807 04:18:13.478710 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:18:13.479152 (+ 442us) server_negotiation.cc:407] Connection header received
0807 04:18:13.479440 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:18:13.479445 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:18:13.479529 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:18:13.479658 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:18:13.481626 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.482355 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.483858 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.484309 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.484463 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:18:13.487083 (+ 2620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:18:13.487088 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:18:13.487091 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:18:13.487124 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:18:13.489800 (+ 2676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:18:13.490496 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:18:13.490500 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:18:13.490502 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:18:13.490625 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:18:13.491021 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:18:13.491025 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:18:13.491027 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:18:13.491314 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:18:13.491514 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0807 04:18:13.491968 (+ 454us) server_negotiation.cc:299] Negotiation successful
0807 04:18:13.492162 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260807 04:18:13.497161 20106 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53760:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:18:13.504518 20106 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:18:13.542407 20641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:18:13.518980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:34235 (local address 127.0.0.1:39752)
0807 04:18:13.531404 (+ 12424us) negotiation.cc:107] Waiting for socket to connect
0807 04:18:13.531431 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 04:18:13.531583 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:18:13.533883 (+ 2300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:18:13.533889 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:18:13.533914 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:18:13.534260 (+ 346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:18:13.534269 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.536601 (+ 2332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.536608 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:18:13.539160 (+ 2552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:18:13.539173 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.541278 (+ 2105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.541285 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:18:13.541498 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:18:13.541571 (+ 73us) client_negotiation.cc:769] Sending connection context
0807 04:18:13.541719 (+ 148us) client_negotiation.cc:240] Negotiation successful
0807 04:18:13.541952 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12238,"mutex_wait_us":131,"thread_start_us":12709,"threads_started":1}
I20260807 04:18:13.542554 20642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:18:13.519258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39752 (local address 127.7.200.194:34235)
0807 04:18:13.533006 (+ 13748us) server_negotiation.cc:206] Beginning negotiation
0807 04:18:13.533018 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 04:18:13.533068 (+ 50us) server_negotiation.cc:407] Connection header received
0807 04:18:13.533203 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:18:13.533215 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:18:13.533604 (+ 389us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:18:13.534481 (+ 877us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:18:13.534737 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.536393 (+ 1656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.539335 (+ 2942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.541049 (+ 1714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.541212 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:18:13.541452 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0807 04:18:13.541970 (+ 518us) server_negotiation.cc:299] Negotiation successful
0807 04:18:13.542163 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13527,"thread_start_us":13364,"threads_started":1}
I20260807 04:18:13.543586 20639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:18:13.518501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:39059 (local address 127.0.0.1:58318)
0807 04:18:13.519798 (+ 1297us) negotiation.cc:107] Waiting for socket to connect
0807 04:18:13.519849 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 04:18:13.520128 (+ 279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:18:13.534593 (+ 14465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:18:13.534598 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:18:13.534634 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:18:13.535703 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:18:13.535716 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.537994 (+ 2278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.538000 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:18:13.539990 (+ 1990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:18:13.540001 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.541761 (+ 1760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.541767 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:18:13.542915 (+ 1148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:18:13.542947 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 04:18:13.543057 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 04:18:13.543183 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1003,"mutex_wait_us":1009,"thread_start_us":1022,"threads_started":1}
I20260807 04:18:13.543661 20644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:18:13.520859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44024 (local address 127.7.200.193:46765)
0807 04:18:13.532417 (+ 11558us) server_negotiation.cc:206] Beginning negotiation
0807 04:18:13.532431 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 04:18:13.533806 (+ 1375us) server_negotiation.cc:407] Connection header received
0807 04:18:13.533944 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:18:13.533954 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:18:13.534225 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:18:13.534459 (+ 234us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:18:13.535160 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.536670 (+ 1510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.539504 (+ 2834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.541049 (+ 1545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.541234 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:18:13.543037 (+ 1803us) server_negotiation.cc:1035] Waiting for connection context
0807 04:18:13.543121 (+ 84us) server_negotiation.cc:299] Negotiation successful
0807 04:18:13.543307 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11355,"thread_start_us":11198,"threads_started":1}
I20260807 04:18:13.543888 20640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:18:13.518630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58318 (local address 127.7.200.195:39059)
0807 04:18:13.533973 (+ 15343us) server_negotiation.cc:206] Beginning negotiation
0807 04:18:13.533981 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:18:13.534011 (+ 30us) server_negotiation.cc:407] Connection header received
0807 04:18:13.534096 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:18:13.534103 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:18:13.534333 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:18:13.534939 (+ 606us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:18:13.535980 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.537788 (+ 1808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.540177 (+ 2389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.541255 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.541389 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:18:13.541601 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0807 04:18:13.543260 (+ 1659us) server_negotiation.cc:299] Negotiation successful
0807 04:18:13.543525 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15143,"thread_start_us":14974,"threads_started":1}
I20260807 04:18:13.542639 20643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:18:13.520486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:46765 (local address 127.0.0.1:44024)
0807 04:18:13.533483 (+ 12997us) negotiation.cc:107] Waiting for socket to connect
0807 04:18:13.533508 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 04:18:13.533656 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:18:13.534446 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:18:13.534450 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:18:13.534473 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:18:13.534962 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:18:13.534976 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.536845 (+ 1869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.536853 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:18:13.539321 (+ 2468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:18:13.539335 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.541643 (+ 2308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.541651 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:18:13.541880 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:18:13.541921 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 04:18:13.542020 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 04:18:13.542161 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12841,"mutex_wait_us":108,"thread_start_us":12675,"threads_started":1}
I20260807 04:18:13.547278 20414 tablet_service.cc:1467] Processing CreateTablet for tablet 4b46d2e485ff4a35bd783fed500e2553 (DEFAULT_TABLE table=test-table [id=58107fc76869424bb1e73f4b4735a0a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:18:13.548061 20262 tablet_service.cc:1467] Processing CreateTablet for tablet 4b46d2e485ff4a35bd783fed500e2553 (DEFAULT_TABLE table=test-table [id=58107fc76869424bb1e73f4b4735a0a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:18:13.549113 20414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b46d2e485ff4a35bd783fed500e2553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:18:13.549835 20262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b46d2e485ff4a35bd783fed500e2553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:18:13.550477 20558 tablet_service.cc:1467] Processing CreateTablet for tablet 4b46d2e485ff4a35bd783fed500e2553 (DEFAULT_TABLE table=test-table [id=58107fc76869424bb1e73f4b4735a0a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:18:13.551635 20558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b46d2e485ff4a35bd783fed500e2553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:18:13.563138 20645 tablet_bootstrap.cc:492] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0: Bootstrap starting.
I20260807 04:18:13.565653 20647 tablet_bootstrap.cc:492] T 4b46d2e485ff4a35bd783fed500e2553 P 81ba25c220e74f4cbd77bbafe0f49704: Bootstrap starting.
I20260807 04:18:13.566478 20646 tablet_bootstrap.cc:492] T 4b46d2e485ff4a35bd783fed500e2553 P aacbe894cad0491490540570ee62fbfa: Bootstrap starting.
I20260807 04:18:13.567173 20645 tablet_bootstrap.cc:654] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0: Neither blocks nor log segments found. Creating new log.
I20260807 04:18:13.568602 20645 log.cc:824] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0: Log is configured to *not* fsync() on all Append() calls
I20260807 04:18:13.570505 20646 tablet_bootstrap.cc:654] T 4b46d2e485ff4a35bd783fed500e2553 P aacbe894cad0491490540570ee62fbfa: Neither blocks nor log segments found. Creating new log.
I20260807 04:18:13.572177 20646 log.cc:824] T 4b46d2e485ff4a35bd783fed500e2553 P aacbe894cad0491490540570ee62fbfa: Log is configured to *not* fsync() on all Append() calls
I20260807 04:18:13.575302 20645 tablet_bootstrap.cc:492] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0: No bootstrap required, opened a new log
I20260807 04:18:13.575600 20645 ts_tablet_manager.cc:1397] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0: Time spent bootstrapping tablet: real 0.013s user 0.010s sys 0.000s
I20260807 04:18:13.575730 20646 tablet_bootstrap.cc:492] T 4b46d2e485ff4a35bd783fed500e2553 P aacbe894cad0491490540570ee62fbfa: No bootstrap required, opened a new log
I20260807 04:18:13.576098 20646 ts_tablet_manager.cc:1397] T 4b46d2e485ff4a35bd783fed500e2553 P aacbe894cad0491490540570ee62fbfa: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260807 04:18:13.576963 20647 tablet_bootstrap.cc:654] T 4b46d2e485ff4a35bd783fed500e2553 P 81ba25c220e74f4cbd77bbafe0f49704: Neither blocks nor log segments found. Creating new log.
I20260807 04:18:13.578509 20647 log.cc:824] T 4b46d2e485ff4a35bd783fed500e2553 P 81ba25c220e74f4cbd77bbafe0f49704: Log is configured to *not* fsync() on all Append() calls
I20260807 04:18:13.582096 20647 tablet_bootstrap.cc:492] T 4b46d2e485ff4a35bd783fed500e2553 P 81ba25c220e74f4cbd77bbafe0f49704: No bootstrap required, opened a new log
I20260807 04:18:13.582453 20647 ts_tablet_manager.cc:1397] T 4b46d2e485ff4a35bd783fed500e2553 P 81ba25c220e74f4cbd77bbafe0f49704: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.007s
I20260807 04:18:13.584252 20645 raft_consensus.cc:348] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51e5184d2f3746f78be8bf376b8033a0" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39059 } } peers { permanent_uuid: "81ba25c220e74f4cbd77bbafe0f49704" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 46765 } } peers { permanent_uuid: "aacbe894cad0491490540570ee62fbfa" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34235 } }
I20260807 04:18:13.584640 20645 raft_consensus.cc:374] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:18:13.584781 20645 raft_consensus.cc:729] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51e5184d2f3746f78be8bf376b8033a0, State: Initialized, Role: FOLLOWER
I20260807 04:18:13.585420 20645 consensus_queue.cc:260] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51e5184d2f3746f78be8bf376b8033a0" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39059 } } peers { permanent_uuid: "81ba25c220e74f4cbd77bbafe0f49704" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 46765 } } peers { permanent_uuid: "aacbe894cad0491490540570ee62fbfa" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34235 } }
I20260807 04:18:13.586526 20626 heartbeater.cc:503] Master 127.7.200.254:43641 was elected leader, sending a full tablet report...
I20260807 04:18:13.587221 20645 ts_tablet_manager.cc:1428] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260807 04:18:13.588016 20646 raft_consensus.cc:348] T 4b46d2e485ff4a35bd783fed500e2553 P aacbe894cad0491490540570ee62fbfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51e5184d2f3746f78be8bf376b8033a0" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39059 } } peers { permanent_uuid: "81ba25c220e74f4cbd77bbafe0f49704" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 46765 } } peers { permanent_uuid: "aacbe894cad0491490540570ee62fbfa" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34235 } }
I20260807 04:18:13.588482 20646 raft_consensus.cc:374] T 4b46d2e485ff4a35bd783fed500e2553 P aacbe894cad0491490540570ee62fbfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:18:13.588603 20646 raft_consensus.cc:729] T 4b46d2e485ff4a35bd783fed500e2553 P aacbe894cad0491490540570ee62fbfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aacbe894cad0491490540570ee62fbfa, State: Initialized, Role: FOLLOWER
I20260807 04:18:13.589303 20646 consensus_queue.cc:260] T 4b46d2e485ff4a35bd783fed500e2553 P aacbe894cad0491490540570ee62fbfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51e5184d2f3746f78be8bf376b8033a0" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39059 } } peers { permanent_uuid: "81ba25c220e74f4cbd77bbafe0f49704" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 46765 } } peers { permanent_uuid: "aacbe894cad0491490540570ee62fbfa" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34235 } }
I20260807 04:18:13.590503 20484 heartbeater.cc:503] Master 127.7.200.254:43641 was elected leader, sending a full tablet report...
I20260807 04:18:13.591200 20646 ts_tablet_manager.cc:1428] T 4b46d2e485ff4a35bd783fed500e2553 P aacbe894cad0491490540570ee62fbfa: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
I20260807 04:18:13.594059 20647 raft_consensus.cc:348] T 4b46d2e485ff4a35bd783fed500e2553 P 81ba25c220e74f4cbd77bbafe0f49704 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51e5184d2f3746f78be8bf376b8033a0" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39059 } } peers { permanent_uuid: "81ba25c220e74f4cbd77bbafe0f49704" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 46765 } } peers { permanent_uuid: "aacbe894cad0491490540570ee62fbfa" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34235 } }
I20260807 04:18:13.594538 20647 raft_consensus.cc:374] T 4b46d2e485ff4a35bd783fed500e2553 P 81ba25c220e74f4cbd77bbafe0f49704 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:18:13.594650 20647 raft_consensus.cc:729] T 4b46d2e485ff4a35bd783fed500e2553 P 81ba25c220e74f4cbd77bbafe0f49704 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81ba25c220e74f4cbd77bbafe0f49704, State: Initialized, Role: FOLLOWER
I20260807 04:18:13.595278 20647 consensus_queue.cc:260] T 4b46d2e485ff4a35bd783fed500e2553 P 81ba25c220e74f4cbd77bbafe0f49704 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51e5184d2f3746f78be8bf376b8033a0" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39059 } } peers { permanent_uuid: "81ba25c220e74f4cbd77bbafe0f49704" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 46765 } } peers { permanent_uuid: "aacbe894cad0491490540570ee62fbfa" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34235 } }
I20260807 04:18:13.597268 20647 ts_tablet_manager.cc:1428] T 4b46d2e485ff4a35bd783fed500e2553 P 81ba25c220e74f4cbd77bbafe0f49704: Time spent starting tablet: real 0.015s user 0.013s sys 0.001s
I20260807 04:18:13.672230 20651 raft_consensus.cc:482] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:18:13.672639 20651 raft_consensus.cc:504] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51e5184d2f3746f78be8bf376b8033a0" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39059 } } peers { permanent_uuid: "81ba25c220e74f4cbd77bbafe0f49704" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 46765 } } peers { permanent_uuid: "aacbe894cad0491490540570ee62fbfa" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34235 } }
I20260807 04:18:13.674625 20651 leader_election.cc:288] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81ba25c220e74f4cbd77bbafe0f49704 (127.7.200.193:46765), aacbe894cad0491490540570ee62fbfa (127.7.200.194:34235)
I20260807 04:18:13.681524 20644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:18:13.675005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:51845 (local address 127.7.200.193:46765)
0807 04:18:13.675257 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0807 04:18:13.675263 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:18:13.675557 (+ 294us) server_negotiation.cc:407] Connection header received
0807 04:18:13.675822 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:18:13.675826 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:18:13.675887 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:18:13.675984 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:18:13.676453 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.677621 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.679550 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.680680 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.680884 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:18:13.680939 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 04:18:13.681244 (+ 305us) server_negotiation.cc:299] Negotiation successful
0807 04:18:13.681336 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 04:18:13.681630 20629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:18:13.675138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:46765 (local address 127.7.200.195:51845)
0807 04:18:13.675441 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0807 04:18:13.675468 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 04:18:13.675651 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:18:13.676017 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:18:13.676021 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:18:13.676050 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:18:13.676282 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:18:13.676295 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.677817 (+ 1522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.677822 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:18:13.679403 (+ 1581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:18:13.679414 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.680874 (+ 1460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.680880 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:18:13.681068 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:18:13.681106 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 04:18:13.681213 (+ 107us) client_negotiation.cc:240] Negotiation successful
0807 04:18:13.681347 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166}
I20260807 04:18:13.682608 20642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:18:13.675189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:54843 (local address 127.7.200.194:34235)
0807 04:18:13.675541 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0807 04:18:13.675550 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:18:13.676250 (+ 700us) server_negotiation.cc:407] Connection header received
0807 04:18:13.676457 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:18:13.676462 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:18:13.676560 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:18:13.676627 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:18:13.677439 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.678411 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.680430 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.681570 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.681722 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:18:13.681792 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 04:18:13.682237 (+ 445us) server_negotiation.cc:299] Negotiation successful
0807 04:18:13.682362 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164}
I20260807 04:18:13.682709 20654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:18:13.675190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:34235 (local address 127.7.200.195:54843)
0807 04:18:13.676118 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0807 04:18:13.676137 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 04:18:13.676288 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:18:13.676836 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:18:13.676841 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:18:13.676865 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:18:13.677226 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:18:13.677237 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.678611 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.678614 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:18:13.680261 (+ 1647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:18:13.680279 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.681939 (+ 1660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.681945 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:18:13.682082 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:18:13.682105 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 04:18:13.682211 (+ 106us) client_negotiation.cc:240] Negotiation successful
0807 04:18:13.682332 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":760,"thread_start_us":545,"threads_started":1}
W20260807 04:18:13.682766 20333 tablet.cc:2369] T 4b46d2e485ff4a35bd783fed500e2553 P 81ba25c220e74f4cbd77bbafe0f49704: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:18:13.682704 20284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b46d2e485ff4a35bd783fed500e2553" candidate_uuid: "51e5184d2f3746f78be8bf376b8033a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81ba25c220e74f4cbd77bbafe0f49704" is_pre_election: true
I20260807 04:18:13.683398 20284 raft_consensus.cc:2454] T 4b46d2e485ff4a35bd783fed500e2553 P 81ba25c220e74f4cbd77bbafe0f49704 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e5184d2f3746f78be8bf376b8033a0 in term 0.
I20260807 04:18:13.684234 20509 leader_election.cc:302] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e5184d2f3746f78be8bf376b8033a0, 81ba25c220e74f4cbd77bbafe0f49704; no voters:
I20260807 04:18:13.684669 20651 raft_consensus.cc:2781] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:18:13.684875 20651 raft_consensus.cc:482] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:18:13.685026 20651 raft_consensus.cc:3037] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:18:13.684808 20437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b46d2e485ff4a35bd783fed500e2553" candidate_uuid: "51e5184d2f3746f78be8bf376b8033a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aacbe894cad0491490540570ee62fbfa" is_pre_election: true
I20260807 04:18:13.685359 20437 raft_consensus.cc:2454] T 4b46d2e485ff4a35bd783fed500e2553 P aacbe894cad0491490540570ee62fbfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51e5184d2f3746f78be8bf376b8033a0 in term 0.
I20260807 04:18:13.687486 20651 raft_consensus.cc:504] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51e5184d2f3746f78be8bf376b8033a0" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39059 } } peers { permanent_uuid: "81ba25c220e74f4cbd77bbafe0f49704" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 46765 } } peers { permanent_uuid: "aacbe894cad0491490540570ee62fbfa" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34235 } }
I20260807 04:18:13.688144 20651 leader_election.cc:288] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0 [CANDIDATE]: Term 1 election: Requested vote from peers 81ba25c220e74f4cbd77bbafe0f49704 (127.7.200.193:46765), aacbe894cad0491490540570ee62fbfa (127.7.200.194:34235)
I20260807 04:18:13.688602 20284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b46d2e485ff4a35bd783fed500e2553" candidate_uuid: "51e5184d2f3746f78be8bf376b8033a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81ba25c220e74f4cbd77bbafe0f49704"
I20260807 04:18:13.688685 20437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b46d2e485ff4a35bd783fed500e2553" candidate_uuid: "51e5184d2f3746f78be8bf376b8033a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aacbe894cad0491490540570ee62fbfa"
I20260807 04:18:13.688838 20284 raft_consensus.cc:3037] T 4b46d2e485ff4a35bd783fed500e2553 P 81ba25c220e74f4cbd77bbafe0f49704 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:18:13.688967 20437 raft_consensus.cc:3037] T 4b46d2e485ff4a35bd783fed500e2553 P aacbe894cad0491490540570ee62fbfa [term 0 FOLLOWER]: Advancing to term 1
W20260807 04:18:13.689244 20627 tablet.cc:2369] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:18:13.691342 20437 raft_consensus.cc:2454] T 4b46d2e485ff4a35bd783fed500e2553 P aacbe894cad0491490540570ee62fbfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e5184d2f3746f78be8bf376b8033a0 in term 1.
I20260807 04:18:13.691464 20284 raft_consensus.cc:2454] T 4b46d2e485ff4a35bd783fed500e2553 P 81ba25c220e74f4cbd77bbafe0f49704 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51e5184d2f3746f78be8bf376b8033a0 in term 1.
I20260807 04:18:13.691799 20511 leader_election.cc:302] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51e5184d2f3746f78be8bf376b8033a0, aacbe894cad0491490540570ee62fbfa; no voters:
I20260807 04:18:13.692142 20651 raft_consensus.cc:2781] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:18:13.692549 20651 raft_consensus.cc:686] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0 [term 1 LEADER]: Becoming Leader. State: Replica: 51e5184d2f3746f78be8bf376b8033a0, State: Running, Role: LEADER
I20260807 04:18:13.693079 20651 consensus_queue.cc:237] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51e5184d2f3746f78be8bf376b8033a0" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39059 } } peers { permanent_uuid: "81ba25c220e74f4cbd77bbafe0f49704" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 46765 } } peers { permanent_uuid: "aacbe894cad0491490540570ee62fbfa" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34235 } }
I20260807 04:18:13.697566 20105 catalog_manager.cc:5495] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51e5184d2f3746f78be8bf376b8033a0 (127.7.200.195). New cstate: current_term: 1 leader_uuid: "51e5184d2f3746f78be8bf376b8033a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51e5184d2f3746f78be8bf376b8033a0" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81ba25c220e74f4cbd77bbafe0f49704" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 46765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aacbe894cad0491490540570ee62fbfa" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34235 } health_report { overall_health: UNKNOWN } } }
I20260807 04:18:13.724231 20640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:18:13.718644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58330 (local address 127.7.200.195:39059)
0807 04:18:13.718835 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0807 04:18:13.718840 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:18:13.718858 (+ 18us) server_negotiation.cc:407] Connection header received
0807 04:18:13.718948 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:18:13.718951 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:18:13.719034 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:18:13.719161 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:18:13.719599 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.720333 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.722046 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.722430 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.722586 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:18:13.723137 (+ 551us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:18:13.723654 (+ 517us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:18:13.723815 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0807 04:18:13.723890 (+ 75us) server_negotiation.cc:299] Negotiation successful
0807 04:18:13.723973 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 04:18:13.732390 20437 raft_consensus.cc:1261] T 4b46d2e485ff4a35bd783fed500e2553 P aacbe894cad0491490540570ee62fbfa [term 1 FOLLOWER]: Refusing update from remote peer 51e5184d2f3746f78be8bf376b8033a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:18:13.732486 20284 raft_consensus.cc:1261] T 4b46d2e485ff4a35bd783fed500e2553 P 81ba25c220e74f4cbd77bbafe0f49704 [term 1 FOLLOWER]: Refusing update from remote peer 51e5184d2f3746f78be8bf376b8033a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:18:13.733412 20655 consensus_queue.cc:1035] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81ba25c220e74f4cbd77bbafe0f49704" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 46765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:18:13.733829 20651 consensus_queue.cc:1035] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aacbe894cad0491490540570ee62fbfa" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 34235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 04:18:13.736167 20485 tablet.cc:2369] T 4b46d2e485ff4a35bd783fed500e2553 P aacbe894cad0491490540570ee62fbfa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:18:13.746959 20659 mvcc.cc:205] Tried to move back new op lower bound from 7315768499117694976 to 7315768498970480640. Current Snapshot: MvccSnapshot[applied={T|T < 7315768499117694976}]
I20260807 04:18:13.748005 20660 mvcc.cc:205] Tried to move back new op lower bound from 7315768499117694976 to 7315768498970480640. Current Snapshot: MvccSnapshot[applied={T|T < 7315768499117694976}]
I20260807 04:18:13.763767 20105 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53760:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:18:13.764072 20105 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53760:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:18:13.767995 20105 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3fc45151b94c4c7db2a167615d8a3436: Sending DeleteTablet for 3 replicas of tablet 4b46d2e485ff4a35bd783fed500e2553
I20260807 04:18:13.769569 20558 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b46d2e485ff4a35bd783fed500e2553 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:18:13 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:58318
I20260807 04:18:13.769568 20414 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b46d2e485ff4a35bd783fed500e2553 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:18:13 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:39752
I20260807 04:18:13.770321 20262 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b46d2e485ff4a35bd783fed500e2553 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:18:13 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:44024
I20260807 04:18:13.770671 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 20191
Aug 07 04:18:13 dist-test-slave-qg60 krb5kdc[19608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076289, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.193@KRBTEST.COM
I20260807 04:18:13.794545 20671 tablet_replica.cc:330] T 4b46d2e485ff4a35bd783fed500e2553 P 81ba25c220e74f4cbd77bbafe0f49704: stopping tablet replica
I20260807 04:18:13.795279 20671 raft_consensus.cc:2229] T 4b46d2e485ff4a35bd783fed500e2553 P 81ba25c220e74f4cbd77bbafe0f49704 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:18:13.795984 20671 raft_consensus.cc:2258] T 4b46d2e485ff4a35bd783fed500e2553 P 81ba25c220e74f4cbd77bbafe0f49704 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:18:13.804522 20644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:18:13.772445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44030 (local address 127.7.200.193:46765)
0807 04:18:13.772675 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0807 04:18:13.772682 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:18:13.777410 (+ 4728us) server_negotiation.cc:407] Connection header received
0807 04:18:13.777755 (+ 345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:18:13.777765 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:18:13.777883 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:18:13.778013 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:18:13.780721 (+ 2708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.782330 (+ 1609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.785002 (+ 2672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.785947 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.786042 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:18:13.793622 (+ 7580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:18:13.793651 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:18:13.793678 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:18:13.793751 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:18:13.799345 (+ 5594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:18:13.800594 (+ 1249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:18:13.800609 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:18:13.800615 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:18:13.800875 (+ 260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:18:13.801786 (+ 911us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:18:13.801794 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:18:13.801800 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:18:13.802440 (+ 640us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:18:13.802796 (+ 356us) server_negotiation.cc:1035] Waiting for connection context
0807 04:18:13.803627 (+ 831us) server_negotiation.cc:299] Negotiation successful
0807 04:18:13.803969 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260807 04:18:13.809937 20327 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:18:13.815694 20669 tablet_replica.cc:330] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0: stopping tablet replica
I20260807 04:18:13.815806 20670 tablet_replica.cc:330] T 4b46d2e485ff4a35bd783fed500e2553 P aacbe894cad0491490540570ee62fbfa: stopping tablet replica
I20260807 04:18:13.816255 20669 raft_consensus.cc:2229] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0 [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:18:13.816989 20669 raft_consensus.cc:2258] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:18:13.817524 20670 raft_consensus.cc:2229] T 4b46d2e485ff4a35bd783fed500e2553 P aacbe894cad0491490540570ee62fbfa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:18:13.819449 20669 ts_tablet_manager.cc:1905] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:18:13.825536 20670 raft_consensus.cc:2258] T 4b46d2e485ff4a35bd783fed500e2553 P aacbe894cad0491490540570ee62fbfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:18:13.827075 20669 ts_tablet_manager.cc:1918] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:18:13.827265 20669 log.cc:1196] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-2/wal/wals/4b46d2e485ff4a35bd783fed500e2553
I20260807 04:18:13.827785 20669 ts_tablet_manager.cc:1939] T 4b46d2e485ff4a35bd783fed500e2553 P 51e5184d2f3746f78be8bf376b8033a0: Deleting consensus metadata
I20260807 04:18:13.828541 20670 ts_tablet_manager.cc:1905] T 4b46d2e485ff4a35bd783fed500e2553 P aacbe894cad0491490540570ee62fbfa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:18:13.829855 20091 catalog_manager.cc:4841] TS 51e5184d2f3746f78be8bf376b8033a0 (127.7.200.195:39059): tablet 4b46d2e485ff4a35bd783fed500e2553 (table test-table [id=58107fc76869424bb1e73f4b4735a0a2]) successfully deleted
I20260807 04:18:13.836297 20670 ts_tablet_manager.cc:1918] T 4b46d2e485ff4a35bd783fed500e2553 P aacbe894cad0491490540570ee62fbfa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:18:13.836489 20670 log.cc:1196] T 4b46d2e485ff4a35bd783fed500e2553 P aacbe894cad0491490540570ee62fbfa: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786076137270840-7971-0/minicluster-data/ts-1/wal/wals/4b46d2e485ff4a35bd783fed500e2553
I20260807 04:18:13.837091 20670 ts_tablet_manager.cc:1939] T 4b46d2e485ff4a35bd783fed500e2553 P aacbe894cad0491490540570ee62fbfa: Deleting consensus metadata
I20260807 04:18:13.839288 20093 catalog_manager.cc:4841] TS aacbe894cad0491490540570ee62fbfa (127.7.200.194:34235): tablet 4b46d2e485ff4a35bd783fed500e2553 (table test-table [id=58107fc76869424bb1e73f4b4735a0a2]) successfully deleted
I20260807 04:18:13.925040 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 20191
I20260807 04:18:13.925282 20671 ts_tablet_manager.cc:1905] T 4b46d2e485ff4a35bd783fed500e2553 P 81ba25c220e74f4cbd77bbafe0f49704: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260807 04:18:13.946316 20091 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.200.193:46765 (error 108)
I20260807 04:18:13.946646 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 20338
I20260807 04:18:13.948721 20639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:18:13.948198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:46765 (local address 127.0.0.1:44046)
0807 04:18:13.948404 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0807 04:18:13.948559 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:46765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260807 04:18:13.949066 20091 catalog_manager.cc:4584] TS 81ba25c220e74f4cbd77bbafe0f49704 (127.7.200.193:46765): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4b46d2e485ff4a35bd783fed500e2553: Network error: Client connection negotiation failed: client connection to 127.7.200.193:46765: connect: Connection refused (error 111)
Aug 07 04:18:13 dist-test-slave-qg60 krb5kdc[19608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076289, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.194@KRBTEST.COM
I20260807 04:18:13.965529 20642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:18:13.947523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39762 (local address 127.7.200.194:34235)
0807 04:18:13.947730 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0807 04:18:13.947737 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:18:13.947946 (+ 209us) server_negotiation.cc:407] Connection header received
0807 04:18:13.948162 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:18:13.948170 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:18:13.948281 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:18:13.948384 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:18:13.950254 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.951006 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.953151 (+ 2145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:18:13.953653 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:18:13.953808 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:18:13.959378 (+ 5570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:18:13.959392 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:18:13.959406 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:18:13.959457 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:18:13.962511 (+ 3054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:18:13.963250 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:18:13.963257 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:18:13.963259 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:18:13.963394 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:18:13.963814 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:18:13.963817 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:18:13.963819 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:18:13.964187 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:18:13.964487 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0807 04:18:13.964975 (+ 488us) server_negotiation.cc:299] Negotiation successful
0807 04:18:13.965208 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 04:18:13.966266 20479 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:18:14.003188 20639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:18:14.002572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:46765 (local address 127.0.0.1:44054)
0807 04:18:14.002836 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0807 04:18:14.002968 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:46765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260807 04:18:14.004462 20639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:18:14.004012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:46765 (local address 127.0.0.1:44064)
0807 04:18:14.004203 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0807 04:18:14.004313 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:46765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260807 04:18:14.060285 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 20338
I20260807 04:18:14.065260 20639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:18:14.064826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:46765 (local address 127.0.0.1:44076)
0807 04:18:14.065026 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 04:18:14.065110 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:46765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260807 04:18:14.066382 20639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:18:14.066007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:46765 (local address 127.0.0.1:44080)
0807 04:18:14.066177 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0807 04:18:14.066267 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:46765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260807 04:18:14.088060 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 20490
Aug 07 04:18:14 dist-test-slave-qg60 krb5kdc[19608](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076289, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.195@KRBTEST.COM
I20260807 04:18:14.107386 20640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:18:14.089308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58332 (local address 127.7.200.195:39059)
0807 04:18:14.089472 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 04:18:14.089477 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:18:14.089498 (+ 21us) server_negotiation.cc:407] Connection header received
0807 04:18:14.089555 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:18:14.089559 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:18:14.089639 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:18:14.089734 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:18:14.091668 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:18:14.092533 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:18:14.094491 (+ 1958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:18:14.094913 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:18:14.095027 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:18:14.100841 (+ 5814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:18:14.100856 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:18:14.100872 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:18:14.100914 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:18:14.104233 (+ 3319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:18:14.105117 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:18:14.105124 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:18:14.105127 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:18:14.105282 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:18:14.105723 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:18:14.105735 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:18:14.105737 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:18:14.106118 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:18:14.106421 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0807 04:18:14.106786 (+ 365us) server_negotiation.cc:299] Negotiation successful
0807 04:18:14.107025 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 04:18:14.108112 20621 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:18:14.147037 20639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:18:14.146478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:46765 (local address 127.0.0.1:44082)
0807 04:18:14.146710 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0807 04:18:14.146802 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:46765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260807 04:18:14.148150 20639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:18:14.147756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:46765 (local address 127.0.0.1:44090)
0807 04:18:14.147959 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0807 04:18:14.148042 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:46765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260807 04:18:14.237591 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 20490
I20260807 04:18:14.260777 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 20073
I20260807 04:18:14.262040 20138 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:18:14.383102 20639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:18:14.382168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:46765 (local address 127.0.0.1:44094)
0807 04:18:14.382406 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0807 04:18:14.382554 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:46765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260807 04:18:14.383451 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 20073
I20260807 04:18:14.412560 7971 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 04:18:14.758536 7971 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 04:18:14.758817 7971 mini_ranger.cc:66] Stopping Ranger...
I20260807 04:18:15.104550 7971 mini_ranger.cc:68] Stopped Ranger
2026-08-07 04:18:15.104 UTC [19640] LOG: received smart shutdown request
2026-08-07 04:18:15.109 UTC [19640] LOG: background worker "logical replication launcher" (PID 19649) exited with exit code 1
2026-08-07 04:18:15.109 UTC [19644] LOG: shutting down
2026-08-07 04:18:15.284 UTC [19640] LOG: database system is shut down
2026-08-07T04:18:15Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (53562 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:18:15 dist-test-slave-qg60 krb5kdc[20688](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:18:15 dist-test-slave-qg60 krb5kdc[20688](info): set up 2 sockets
Aug 07 04:18:15 dist-test-slave-qg60 krb5kdc[20688](info): commencing operation
krb5kdc: starting...
W20260807 04:18:16.609833 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.144s user 0.002s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:18:16 dist-test-slave-qg60 krb5kdc[20688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:18:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:18:16Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.7.200.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.7.200.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.7.200.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/rangeradmin_127.7.200.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.7.200.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/rangeradmin_127.7.200.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.7.200.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.7.200.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.7.200.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/rangerlookup_127.7.200.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.7.200.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/rangerlookup_127.7.200.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.7.200.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.7.200.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.7.200.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/HTTP_127.7.200.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.7.200.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/HTTP_127.7.200.212@KRBTEST.COM.keytab.
I20260807 04:18:17.036003 7971 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskMk3R5R/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/postgres -l logfile start
2026-08-07 04:18:19.696 UTC [20719] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 04:18:19.697 UTC [20719] LOG: listening on IPv4 address "127.7.200.212", port 41709
2026-08-07 04:18:19.700 UTC [20719] LOG: listening on Unix socket "/tmp/.s.PGSQL.41709"
2026-08-07 04:18:19.726 UTC [20721] LOG: database system was shut down at 2026-08-07 04:18:18 UTC
2026-08-07 04:18:19.730 UTC [20719] LOG: database system is ready to accept connections
I20260807 04:18:20.769356 7971 mini_postgres.cc:96] Postgres bound to 41709
2026-08-07 04:18:20.793 UTC [20730] FATAL: database "slave" does not exist
127.7.200.212:41709 - accepting connections
I20260807 04:18:20.794171 7971 mini_ranger.cc:161] Starting Ranger...
I20260807 04:18:20.826826 7971 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 04:18:21.365272 7971 mini_ranger.cc:87] Created ranger Postgres database
I20260807 04:18:21.365413 7971 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ranger-admin
2026-08-07 04:18:21,654 [I] DB FLAVOR :POSTGRES
2026-08-07 04:18:21,654 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 04:18:21,654 [I] Checking connection..
2026-08-07 04:18:21,655 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:41709/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 04:18:21,943 [I] Checking connection passed.
2026-08-07 04:18:21,943 [I] --------- Verifying version history table ---------
2026-08-07 04:18:21,943 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:41709/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 04:18:22,217 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 04:18:22,217 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:41709/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 04:18:22,493 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 04:18:22,494 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 04:18:22,494 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:41709/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 04:18:22.769 UTC [20795] WARNING: there is no transaction in progress
2026-08-07 04:18:22,777 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 04:18:22,777 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:41709/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 04:18:23,038 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 04:18:23,039 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 04:18:23,039 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:41709/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 04:18:23,312 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:41709/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 04:18:23,569 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:41709/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-qg60.c.gcp-upstream.internal','N') ;"
2026-08-07 04:18:23,830 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:41709/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 04:18:24,084 [I] Table x_portal_user does not exist in database ranger
2026-08-07 04:18:24,084 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:41709/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 04:18:24,332 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 04:18:24,332 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:41709/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 04:18:24,605 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:41709/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 04:18:24,865 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 04:18:24,865 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:41709/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 04:18:25.861 UTC [20909] WARNING: there is no transaction in progress
2026-08-07 04:18:25.879 UTC [20909] WARNING: there is no transaction in progress
2026-08-07 04:18:25.896 UTC [20909] WARNING: there is no transaction in progress
2026-08-07 04:18:25.912 UTC [20909] WARNING: there is no transaction in progress
2026-08-07 04:18:25.931 UTC [20909] WARNING: there is no transaction in progress
2026-08-07 04:18:25.950 UTC [20909] WARNING: there is no transaction in progress
2026-08-07 04:18:26.014 UTC [20909] WARNING: there is no transaction in progress
2026-08-07 04:18:26.022 UTC [20909] WARNING: there is no transaction in progress
2026-08-07 04:18:26.036 UTC [20909] WARNING: there is no transaction in progress
2026-08-07 04:18:26.047 UTC [20909] WARNING: there is no transaction in progress
2026-08-07 04:18:26.057 UTC [20909] WARNING: there is no transaction in progress
2026-08-07 04:18:26.071 UTC [20909] WARNING: there is no transaction in progress
2026-08-07 04:18:26.081 UTC [20909] WARNING: there is no transaction in progress
2026-08-07 04:18:26.088 UTC [20909] WARNING: there is no transaction in progress
2026-08-07 04:18:26.095 UTC [20909] WARNING: there is no transaction in progress
2026-08-07 04:18:26.102 UTC [20909] WARNING: there is no transaction in progress
2026-08-07 04:18:26,755 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 04:18:26,755 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:41709/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 04:18:26,985 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 04:18:26,985 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:41709/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 04:18:27,241 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 04:18:27,242 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:41709/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 04:18:27,532 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 04:18:27,532 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:41709/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 04:18:27,799 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:41709/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 04:18:28,054 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:41709/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-qg60.c.gcp-upstream.internal';"
2026-08-07 04:18:28,323 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 04:18:28,323 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:41709/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 04:18:28,606 [I] DB_PATCHES have already been applied
I20260807 04:18:28.612829 7971 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ranger-admin:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskMk3R5R/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 04:18:28.612970 7971 mini_ranger.cc:193] Using host: 127.7.200.212
I20260807 04:18:28.634435 7971 mini_ranger.cc:227] Ranger admin URL: http://127.7.200.212:34639
Aug 07, 2026 4:18:28 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 4:18:28 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 4:18:29 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 4:18:29 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 4:18:29 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 4:18:29 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 4:18:29 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 04:18:29.843905 7971 mini_ranger.cc:160] Time spent starting Ranger: real 9.050s user 0.006s sys 0.058s
Aug 07, 2026 4:18:51 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 4:18:51 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 07, 2026 4:18:51 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 4:18:51 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 4:18:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 4:18:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 4:18:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 4:18:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 4:18:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 4:18:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 4:18:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 4:18:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 4:18:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 4:18:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 4:18:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 4:18:51 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 4:18:51 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 4:18:52 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 04:18:52.692619 7971 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.7.200.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.7.200.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.7.200.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/rangerkms_127.7.200.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.7.200.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/rangerkms_127.7.200.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.7.200.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.7.200.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.7.200.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/HTTP_127.7.200.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.7.200.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/HTTP_127.7.200.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 04:18:52 dist-test-slave-qg60 krb5kdc[20688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076332, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 04:18:52.912657 7971 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 04:18:52.940863 7971 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 04:18:53.876554 7971 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 04:18:53.876667 7971 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ranger-kms
I20260807 04:18:53.876698 7971 mini_ranger_kms.cc:227] Using postgres at 127.7.200.212:41709
2026-08-07 04:18:54,252 [I] DB FLAVOR :POSTGRES
2026-08-07 04:18:54,252 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 04:18:54,253 [I] Checking connection
2026-08-07 04:18:54,253 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:41709/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 04:18:54,501 [I] connection success
2026-08-07 04:18:54,502 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 04:18:54,502 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 04:18:54,502 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:41709/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 04:18:54,767 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 04:18:54,767 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 04:18:54,767 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 04:18:54,768 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.7.200.212:41709/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 04:18:55,025 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 04:18:55.521567 7971 mini_ranger_kms.cc:310] Created kms service
I20260807 04:18:55.704502 7971 mini_ranger_kms.cc:326] Created kudu user
I20260807 04:18:55.750090 7971 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 04:18:55 dist-test-slave-qg60 krb5kdc[20688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076332, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.7.200.212@KRBTEST.COM
I20260807 04:18:56.161259 7971 mini_ranger_kms.cc:384] Added ranger policy
I20260807 04:18:56.161645 7971 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ranger-kms:/tmp/dist-test-taskMk3R5R/build/asan/bin/postgresql.jar:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskMk3R5R/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 04:18:56.161707 7971 mini_ranger_kms.cc:240] Using host: 127.7.200.212
I20260807 04:18:56.190551 7971 mini_ranger_kms.cc:276] Ranger KMS PID: 21098
I20260807 04:18:56.190725 7971 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.7.200.212:53957
Aug 07, 2026 4:18:57 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 4:18:57 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 4:18:57 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 4:18:57 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 4:18:57 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 4:18:57 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260807 04:18:58.560002 7971 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.647s user 0.077s sys 0.337s
I20260807 04:18:58.560286 7971 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 04:18:58.560482 7971 mini_ranger_kms.cc:401] 127.7.200.212:53957/kms/v1/keys
Aug 07 04:18:58 dist-test-slave-qg60 krb5kdc[20688](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786076338, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.7.200.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 07 04:18:59 dist-test-slave-qg60 krb5kdc[20688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076338, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.7.200.212@KRBTEST.COM for HTTP/127.7.200.212@KRBTEST.COM
Aug 07 04:18:59 dist-test-slave-qg60 krb5kdc[20688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076338, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.7.200.212@KRBTEST.COM for HTTP/127.7.200.212@KRBTEST.COM
Aug 07 04:19:01 dist-test-slave-qg60 krb5kdc[20688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
I20260807 04:19:01.988584 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:44325
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:39957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:44325
--ranger_config_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.200.212:53957/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:19:02.346532 21149 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:19:02.346843 21149 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:19:02.347002 21149 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:19:02.354565 21149 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:19:02.354691 21149 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:19:02.354763 21149 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:19:02.354861 21149 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:19:02.354914 21149 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:19:02.365407 21149 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:39957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/wal
--ranger_kms_url=127.7.200.212:53957/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:44325
--ranger_config_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:44325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:19:02.366779 21149 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:19:02.368157 21149 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:19:02.382086 21155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:02.382086 21154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:02.382856 21157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:02.382967 21149 server_base.cc:1034] running on GCE node
I20260807 04:19:02.384011 21149 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:19:02.386225 21149 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:19:02.387496 21149 hybrid_clock.cc:648] HybridClock initialized: now 1786076342387428 us; error 53 us; skew 500 ppm
I20260807 04:19:02.387917 21149 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:19:02 dist-test-slave-qg60 krb5kdc[20688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076342, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:19:02.392248 21149 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:19:02.394112 21149 webserver.cc:460] Webserver started at http://127.7.200.254:33217/ using document root <none> and password file <none>
I20260807 04:19:02.394867 21149 fs_manager.cc:359] Metadata directory not provided
I20260807 04:19:02.395004 21149 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:19:02.395323 21149 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 04:19:02 dist-test-slave-qg60 krb5kdc[20688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076342, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for HTTP/127.7.200.212@KRBTEST.COM
I20260807 04:19:02.459625 21149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "814bce1e0fca4a90b8968a4377ed015e"
format_stamp: "Formatted at 2026-08-07 04:19:02 on dist-test-slave-qg60"
server_key: "7bf7f76dfc715fc8dd2b080a29b63ff6"
server_key_iv: "f140078dc1ad337d412dc8878040c9a7"
server_key_version: "kuduclusterkey@0"
I20260807 04:19:02.460551 21149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "814bce1e0fca4a90b8968a4377ed015e"
format_stamp: "Formatted at 2026-08-07 04:19:02 on dist-test-slave-qg60"
server_key: "7bf7f76dfc715fc8dd2b080a29b63ff6"
server_key_iv: "f140078dc1ad337d412dc8878040c9a7"
server_key_version: "kuduclusterkey@0"
I20260807 04:19:02.466261 21149 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260807 04:19:02.486943 21164 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:02.488561 21149 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 04:19:02.488780 21149 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "814bce1e0fca4a90b8968a4377ed015e"
format_stamp: "Formatted at 2026-08-07 04:19:02 on dist-test-slave-qg60"
server_key: "7bf7f76dfc715fc8dd2b080a29b63ff6"
server_key_iv: "f140078dc1ad337d412dc8878040c9a7"
server_key_version: "kuduclusterkey@0"
I20260807 04:19:02.489048 21149 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:19:02.502815 21149 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:19:02.506919 21149 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:19:02.507243 21149 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:19:02.532441 21149 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:44325
I20260807 04:19:02.532466 21218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:44325 every 8 connection(s)
I20260807 04:19:02.534090 21149 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:19:02.535566 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 21149
I20260807 04:19:02.535799 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:19:02.536674 7971 external_mini_cluster.cc:1428] Setting key 51dddd47d65b75e2f7012220039c15dc
I20260807 04:19:02.539937 21219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:19:02.559747 21219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e: Bootstrap starting.
I20260807 04:19:02.563990 21219 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e: Neither blocks nor log segments found. Creating new log.
I20260807 04:19:02.565368 21219 log.cc:824] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e: Log is configured to *not* fsync() on all Append() calls
Aug 07 04:19:02 dist-test-slave-qg60 krb5kdc[20688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:19:02.569646 21219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e: No bootstrap required, opened a new log
I20260807 04:19:02.577862 21222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:02.538910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44236 (local address 127.7.200.254:44325)
0807 04:19:02.550418 (+ 11508us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:02.550446 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:02.550510 (+ 64us) server_negotiation.cc:407] Connection header received
0807 04:19:02.553239 (+ 2729us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:02.553273 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:02.553870 (+ 597us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:02.554369 (+ 499us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:02.556099 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:02.558480 (+ 2381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:02.560400 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:02.561560 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:02.561806 (+ 246us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:02.567052 (+ 5246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:02.567067 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:02.567095 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:02.567148 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:02.571713 (+ 4565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:02.572665 (+ 952us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:02.572681 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:02.572691 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:02.572971 (+ 280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:02.573410 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:02.573416 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:02.573420 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:02.574263 (+ 843us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:02.574636 (+ 373us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:02.575714 (+ 1078us) server_negotiation.cc:299] Negotiation successful
0807 04:19:02.576244 (+ 530us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11207,"thread_start_us":10943,"threads_started":1}
I20260807 04:19:02.581287 21219 raft_consensus.cc:348] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "814bce1e0fca4a90b8968a4377ed015e" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44325 } }
I20260807 04:19:02.581737 21219 raft_consensus.cc:374] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:19:02.581873 21219 raft_consensus.cc:729] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 814bce1e0fca4a90b8968a4377ed015e, State: Initialized, Role: FOLLOWER
I20260807 04:19:02.582538 21219 consensus_queue.cc:260] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "814bce1e0fca4a90b8968a4377ed015e" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44325 } }
I20260807 04:19:02.582800 21219 raft_consensus.cc:388] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:19:02.582939 21219 raft_consensus.cc:482] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:19:02.583308 21219 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:19:02.585853 21219 raft_consensus.cc:504] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "814bce1e0fca4a90b8968a4377ed015e" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44325 } }
I20260807 04:19:02.586364 21219 leader_election.cc:302] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 814bce1e0fca4a90b8968a4377ed015e; no voters:
I20260807 04:19:02.586970 21219 leader_election.cc:288] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:19:02.587123 21224 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:19:02.589211 21219 sys_catalog.cc:564] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:19:02.594671 21224 raft_consensus.cc:686] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [term 1 LEADER]: Becoming Leader. State: Replica: 814bce1e0fca4a90b8968a4377ed015e, State: Running, Role: LEADER
I20260807 04:19:02.595211 21224 consensus_queue.cc:237] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "814bce1e0fca4a90b8968a4377ed015e" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44325 } }
I20260807 04:19:02.598374 21225 sys_catalog.cc:455] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "814bce1e0fca4a90b8968a4377ed015e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "814bce1e0fca4a90b8968a4377ed015e" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44325 } } }
I20260807 04:19:02.598407 21226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 814bce1e0fca4a90b8968a4377ed015e. Latest consensus state: current_term: 1 leader_uuid: "814bce1e0fca4a90b8968a4377ed015e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "814bce1e0fca4a90b8968a4377ed015e" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44325 } } }
I20260807 04:19:02.598850 21225 sys_catalog.cc:458] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [sys.catalog]: This master's current role is: LEADER
I20260807 04:19:02.598927 21226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [sys.catalog]: This master's current role is: LEADER
I20260807 04:19:02.605630 21231 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:19:02.612672 21231 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:19:02.630185 21219 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 04:19:02.631938 21231 catalog_manager.cc:1347] Generated new cluster ID: 941c9d08053649c7867e84854d3eec34
I20260807 04:19:02.632143 21231 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:19:02.664021 21231 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:19:02.666868 21231 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:19:02.677385 21231 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e: Generated new TSK 0
I20260807 04:19:02.678751 21231 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.200.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
I20260807 04:19:03.557209 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.200.212:53957/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:0
--local_ip_for_outbound_sockets=127.7.200.193
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:44325
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:39957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 04:19:03 dist-test-slave-qg60 krb5kdc[20688](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786076343, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260807 04:19:04.044376 21267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:19:04.044700 21267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:19:04.044889 21267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:19:04.053191 21267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:19:04.053404 21267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:19:04.053607 21267 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:19:04.069422 21267 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:39957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.7.200.212:53957/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:44325
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:19:04.071198 21267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:19:04.072957 21267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:19:04.103657 21278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:04.109344 21277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:04.112455 21281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:04.113173 21267 server_base.cc:1034] running on GCE node
I20260807 04:19:04.114094 21267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:19:04.115531 21267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:19:04.116837 21267 hybrid_clock.cc:648] HybridClock initialized: now 1786076344116722 us; error 100 us; skew 500 ppm
I20260807 04:19:04.117296 21267 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:19:04 dist-test-slave-qg60 krb5kdc[20688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076344, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:19:04.121840 21267 init.cc:377] Logged in from keytab as kudu/127.7.200.193@KRBTEST.COM (short username kudu)
I20260807 04:19:04.123951 21267 webserver.cc:460] Webserver started at http://127.7.200.193:46447/ using document root <none> and password file <none>
I20260807 04:19:04.124934 21267 fs_manager.cc:359] Metadata directory not provided
I20260807 04:19:04.125088 21267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:19:04.125495 21267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 04:19:04 dist-test-slave-qg60 krb5kdc[20688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076344, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for HTTP/127.7.200.212@KRBTEST.COM
I20260807 04:19:04.145741 21267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/data/instance:
uuid: "1828ce4a28d049b4bc02db858d7e3918"
format_stamp: "Formatted at 2026-08-07 04:19:04 on dist-test-slave-qg60"
server_key: "5b0c4f785d4f39dfca8b35da6f87a27b"
server_key_iv: "ea62fdade626e46e8aa189d288b44346"
server_key_version: "kuduclusterkey@0"
I20260807 04:19:04.149188 21267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance:
uuid: "1828ce4a28d049b4bc02db858d7e3918"
format_stamp: "Formatted at 2026-08-07 04:19:04 on dist-test-slave-qg60"
server_key: "5b0c4f785d4f39dfca8b35da6f87a27b"
server_key_iv: "ea62fdade626e46e8aa189d288b44346"
server_key_version: "kuduclusterkey@0"
I20260807 04:19:04.157227 21267 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.001s
I20260807 04:19:04.189296 21288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:04.191237 21267 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.004s sys 0.004s
I20260807 04:19:04.191473 21267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "1828ce4a28d049b4bc02db858d7e3918"
format_stamp: "Formatted at 2026-08-07 04:19:04 on dist-test-slave-qg60"
server_key: "5b0c4f785d4f39dfca8b35da6f87a27b"
server_key_iv: "ea62fdade626e46e8aa189d288b44346"
server_key_version: "kuduclusterkey@0"
I20260807 04:19:04.191738 21267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 07 04:19:04 dist-test-slave-qg60 krb5kdc[20688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076343, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for HTTP/127.7.200.212@KRBTEST.COM
I20260807 04:19:04.239985 21267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:19:04.245858 21267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:19:04.246275 21267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:19:04.253742 21267 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:19:04.255782 21267 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:19:04.255896 21267 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:04.256033 21267 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:19:04.256094 21267 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:04.442643 21267 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:40425
I20260807 04:19:04.442710 21403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:40425 every 8 connection(s)
I20260807 04:19:04.444388 21267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:19:04.448781 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 21267
I20260807 04:19:04.449062 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance
I20260807 04:19:04.450186 7971 external_mini_cluster.cc:1428] Setting key 71266552776513f5e0a11ff045ad8851
Aug 07 04:19:04 dist-test-slave-qg60 krb5kdc[20688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076344, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:19:04.480427 21406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:04.447789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:33447 (local address 127.7.200.254:44325)
0807 04:19:04.451371 (+ 3582us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:04.451378 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:04.452236 (+ 858us) server_negotiation.cc:407] Connection header received
0807 04:19:04.459153 (+ 6917us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:04.459160 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:04.459264 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:04.459342 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:04.461701 (+ 2359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:04.462839 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:04.465178 (+ 2339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:04.465828 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:04.465925 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:04.472329 (+ 6404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:04.472336 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:04.472341 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:04.472393 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:04.476232 (+ 3839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:04.477328 (+ 1096us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:04.477336 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:04.477342 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:04.477533 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:04.478183 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:04.478189 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:04.478192 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:04.478583 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:04.478741 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:04.479801 (+ 1060us) server_negotiation.cc:299] Negotiation successful
0807 04:19:04.480036 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3452,"thread_start_us":3311,"threads_started":1}
I20260807 04:19:04.483207 21407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:04.448308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:44325 (local address 127.7.200.193:33447)
0807 04:19:04.452073 (+ 3765us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:04.452123 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:04.458768 (+ 6645us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:04.459981 (+ 1213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:04.459993 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:04.460620 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:19:04.461496 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:04.461520 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:04.463062 (+ 1542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:04.463067 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:04.465022 (+ 1955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:04.465039 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:04.466292 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:04.466299 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:04.466586 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:04.468987 (+ 2401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:19:04.469020 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:19:04.472035 (+ 3015us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:19:04.476439 (+ 4404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:04.476448 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:04.476467 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:04.477167 (+ 700us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:04.477741 (+ 574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:04.477746 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:04.477750 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:04.478028 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:04.478854 (+ 826us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:19:04.478863 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:19:04.479337 (+ 474us) client_negotiation.cc:769] Sending connection context
0807 04:19:04.480984 (+ 1647us) client_negotiation.cc:240] Negotiation successful
0807 04:19:04.481564 (+ 580us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3475,"thread_start_us":3261,"threads_started":1}
I20260807 04:19:04.485671 21404 heartbeater.cc:347] Connected to a master server at 127.7.200.254:44325
I20260807 04:19:04.486014 21404 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.7.200.194@KRBTEST.COM; defaulting to no policy
I20260807 04:19:04.486924 21404 heartbeater.cc:511] Master 127.7.200.254:44325 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.194@KRBTEST.COM" created.
I20260807 04:19:04.489740 21181 ts_manager.cc:194] Registered new tserver with Master: 1828ce4a28d049b4bc02db858d7e3918 (127.7.200.193:40425)
I20260807 04:19:04.491833 21181 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.193@KRBTEST.COM'} at 127.7.200.193:33447
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
I20260807 04:19:04.539206 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.200.212:53957/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:0
--local_ip_for_outbound_sockets=127.7.200.194
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:44325
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:39957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 04:19:04 dist-test-slave-qg60 krb5kdc[20688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076343, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for HTTP/127.7.200.212@KRBTEST.COM
W20260807 04:19:04.996913 21410 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:19:04.997262 21410 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:19:04.997442 21410 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:19:05.005142 21410 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:19:05.005283 21410 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:19:05.005462 21410 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:19:05.015697 21410 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:39957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.7.200.212:53957/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:44325
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:19:05.017169 21410 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:19:05.018486 21410 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:19:05.032341 21426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:05.032387 21429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:05.032302 21427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:05.033331 21410 server_base.cc:1034] running on GCE node
I20260807 04:19:05.034026 21410 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:19:05.035106 21410 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:19:05.036347 21410 hybrid_clock.cc:648] HybridClock initialized: now 1786076345036279 us; error 60 us; skew 500 ppm
I20260807 04:19:05.036713 21410 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:19:05 dist-test-slave-qg60 krb5kdc[20688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076345, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:19:05.043922 21410 init.cc:377] Logged in from keytab as kudu/127.7.200.194@KRBTEST.COM (short username kudu)
I20260807 04:19:05.045568 21410 webserver.cc:460] Webserver started at http://127.7.200.194:38321/ using document root <none> and password file <none>
I20260807 04:19:05.046279 21410 fs_manager.cc:359] Metadata directory not provided
I20260807 04:19:05.046427 21410 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:19:05.046752 21410 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 04:19:05 dist-test-slave-qg60 krb5kdc[20688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076345, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for HTTP/127.7.200.212@KRBTEST.COM
I20260807 04:19:05.060705 21410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/data/instance:
uuid: "6abc7979e8974cee9f57c816679a12d7"
format_stamp: "Formatted at 2026-08-07 04:19:05 on dist-test-slave-qg60"
server_key: "afd3a9af5f10774206e05bc284013c60"
server_key_iv: "55ac599091c549fab592f294f3f17cd9"
server_key_version: "kuduclusterkey@0"
I20260807 04:19:05.061725 21410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance:
uuid: "6abc7979e8974cee9f57c816679a12d7"
format_stamp: "Formatted at 2026-08-07 04:19:05 on dist-test-slave-qg60"
server_key: "afd3a9af5f10774206e05bc284013c60"
server_key_iv: "55ac599091c549fab592f294f3f17cd9"
server_key_version: "kuduclusterkey@0"
I20260807 04:19:05.067468 21410 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260807 04:19:05.084676 21436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:05.086715 21410 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 04:19:05.086935 21410 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "6abc7979e8974cee9f57c816679a12d7"
format_stamp: "Formatted at 2026-08-07 04:19:05 on dist-test-slave-qg60"
server_key: "afd3a9af5f10774206e05bc284013c60"
server_key_iv: "55ac599091c549fab592f294f3f17cd9"
server_key_version: "kuduclusterkey@0"
I20260807 04:19:05.087191 21410 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:19:05.113602 21410 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:19:05.117969 21410 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:19:05.118324 21410 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:19:05.119406 21410 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:19:05.121174 21410 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:19:05.121304 21410 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:05.121469 21410 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:19:05.121557 21410 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:05.160336 21410 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:45197
I20260807 04:19:05.160385 21552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:45197 every 8 connection(s)
I20260807 04:19:05.161834 21410 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:19:05.163286 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 21410
I20260807 04:19:05.163488 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance
I20260807 04:19:05.164134 7971 external_mini_cluster.cc:1428] Setting key 85f98385753a5d682cca71e8ae2b164a
Aug 07 04:19:05 dist-test-slave-qg60 krb5kdc[20688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076345, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:19:05.184986 21556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:05.165068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:52357 (local address 127.7.200.254:44325)
0807 04:19:05.165660 (+ 592us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:05.165667 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:05.166821 (+ 1154us) server_negotiation.cc:407] Connection header received
0807 04:19:05.168891 (+ 2070us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:05.168897 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:05.169017 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:05.169148 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:05.170710 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:05.171576 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:05.173452 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:05.173916 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:05.174079 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:05.178004 (+ 3925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:05.178012 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:05.178016 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:05.178064 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:05.181140 (+ 3076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:05.182255 (+ 1115us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:05.182260 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:05.182263 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:05.182391 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:05.182985 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:05.182988 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:05.182990 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:05.183274 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:05.183389 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:05.184421 (+ 1032us) server_negotiation.cc:299] Negotiation successful
0807 04:19:05.184630 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":279,"threads_started":1}
I20260807 04:19:05.186939 21557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:05.165705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:44325 (local address 127.7.200.194:52357)
0807 04:19:05.166651 (+ 946us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:05.166705 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:05.168546 (+ 1841us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:05.169409 (+ 863us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:05.169417 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:05.169880 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:19:05.170516 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:05.170535 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:05.171765 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:05.171770 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:05.173269 (+ 1499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:05.173304 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:05.174195 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:05.174204 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:05.174478 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:05.175282 (+ 804us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:19:05.175312 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:19:05.177731 (+ 2419us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:19:05.181315 (+ 3584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:05.181329 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:05.181352 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:05.182110 (+ 758us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:05.182524 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:05.182533 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:05.182540 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:05.182864 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:05.183407 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:19:05.183420 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:19:05.183958 (+ 538us) client_negotiation.cc:769] Sending connection context
0807 04:19:05.184326 (+ 368us) client_negotiation.cc:240] Negotiation successful
0807 04:19:05.185030 (+ 704us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":664,"thread_start_us":423,"threads_started":1}
I20260807 04:19:05.188598 21554 heartbeater.cc:347] Connected to a master server at 127.7.200.254:44325
I20260807 04:19:05.188963 21554 heartbeater.cc:464] Registering TS with master...
I20260807 04:19:05.189785 21554 heartbeater.cc:511] Master 127.7.200.254:44325 requested a full tablet report, sending...
I20260807 04:19:05.191462 21181 ts_manager.cc:194] Registered new tserver with Master: 6abc7979e8974cee9f57c816679a12d7 (127.7.200.194:45197)
I20260807 04:19:05.192546 21181 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.194@KRBTEST.COM'} at 127.7.200.194:52357
WARNING: no policy specified for kudu/127.7.200.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
I20260807 04:19:05.237587 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.200.212:53957/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:0
--local_ip_for_outbound_sockets=127.7.200.195
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:44325
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:39957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 04:19:05.495851 21404 heartbeater.cc:503] Master 127.7.200.254:44325 was elected leader, sending a full tablet report...
W20260807 04:19:05.586309 21560 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:19:05.586577 21560 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:19:05.586671 21560 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:19:05.594972 21560 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:19:05.595103 21560 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:19:05.595237 21560 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:19:05.606559 21560 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:39957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.7.200.212:53957/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:44325
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:19:05.607929 21560 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:19:05.609355 21560 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:19:05.623536 21569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:05.623646 21567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:05.623637 21566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:05.624413 21560 server_base.cc:1034] running on GCE node
I20260807 04:19:05.625144 21560 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:19:05.626157 21560 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:19:05.627388 21560 hybrid_clock.cc:648] HybridClock initialized: now 1786076345627353 us; error 59 us; skew 500 ppm
I20260807 04:19:05.627709 21560 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:19:05 dist-test-slave-qg60 krb5kdc[20688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076345, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:19:05.630962 21560 init.cc:377] Logged in from keytab as kudu/127.7.200.195@KRBTEST.COM (short username kudu)
I20260807 04:19:05.632439 21560 webserver.cc:460] Webserver started at http://127.7.200.195:40247/ using document root <none> and password file <none>
I20260807 04:19:05.633224 21560 fs_manager.cc:359] Metadata directory not provided
I20260807 04:19:05.633360 21560 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:19:05.633692 21560 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 04:19:05 dist-test-slave-qg60 krb5kdc[20688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076345, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for HTTP/127.7.200.212@KRBTEST.COM
I20260807 04:19:05.648941 21560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/data/instance:
uuid: "d611193d473449c4a91011b3b4e2f8a8"
format_stamp: "Formatted at 2026-08-07 04:19:05 on dist-test-slave-qg60"
server_key: "bc94d319c5add5eaa9a4aeed6c66d8ea"
server_key_iv: "79ede81cbe08c70056bf74603d613069"
server_key_version: "kuduclusterkey@0"
I20260807 04:19:05.649955 21560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance:
uuid: "d611193d473449c4a91011b3b4e2f8a8"
format_stamp: "Formatted at 2026-08-07 04:19:05 on dist-test-slave-qg60"
server_key: "bc94d319c5add5eaa9a4aeed6c66d8ea"
server_key_iv: "79ede81cbe08c70056bf74603d613069"
server_key_version: "kuduclusterkey@0"
I20260807 04:19:05.655968 21560 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260807 04:19:05.671515 21578 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:05.673218 21560 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 04:19:05.673422 21560 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "d611193d473449c4a91011b3b4e2f8a8"
format_stamp: "Formatted at 2026-08-07 04:19:05 on dist-test-slave-qg60"
server_key: "bc94d319c5add5eaa9a4aeed6c66d8ea"
server_key_iv: "79ede81cbe08c70056bf74603d613069"
server_key_version: "kuduclusterkey@0"
I20260807 04:19:05.673695 21560 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:19:05.692116 21560 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:19:05.696113 21560 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:19:05.696429 21560 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:19:05.697517 21560 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:19:05.698997 21560 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:19:05.699105 21560 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:05.699255 21560 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:19:05.699332 21560 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:05.734230 21560 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:40517
I20260807 04:19:05.734266 21691 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:40517 every 8 connection(s)
I20260807 04:19:05.735617 21560 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:19:05.742887 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 21560
I20260807 04:19:05.743104 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance
I20260807 04:19:05.743726 7971 external_mini_cluster.cc:1428] Setting key 96bef933ef87ffc0838e84c7464cf2c0
Aug 07 04:19:05 dist-test-slave-qg60 krb5kdc[20688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076345, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:19:05.756899 21694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:05.738376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:48773 (local address 127.7.200.254:44325)
0807 04:19:05.738879 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:05.738887 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:05.739832 (+ 945us) server_negotiation.cc:407] Connection header received
0807 04:19:05.741673 (+ 1841us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:05.741677 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:05.741761 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:05.741858 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:05.743565 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:05.744578 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:05.746576 (+ 1998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:05.747201 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:05.747355 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:05.751128 (+ 3773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:05.751133 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:05.751136 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:05.751173 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:05.753970 (+ 2797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:05.754724 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:05.754728 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:05.754730 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:05.754860 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:05.755278 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:05.755281 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:05.755283 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:05.755575 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:05.755696 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:05.756371 (+ 675us) server_negotiation.cc:299] Negotiation successful
0807 04:19:05.756578 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":222,"threads_started":1}
I20260807 04:19:05.758085 21695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:05.738954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:44325 (local address 127.7.200.195:48773)
0807 04:19:05.739666 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:05.739713 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:05.741414 (+ 1701us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:05.742103 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:05.742111 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:05.742676 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:19:05.743370 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:05.743389 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:05.744794 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:05.744799 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:05.746414 (+ 1615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:05.746426 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:05.747443 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:05.747450 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:05.747709 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:05.748403 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:19:05.748426 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:19:05.750867 (+ 2441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:19:05.754116 (+ 3249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:05.754123 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:05.754138 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:05.754605 (+ 467us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:05.754956 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:05.754959 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:05.754961 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:05.755171 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:05.755702 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:19:05.755709 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:19:05.756033 (+ 324us) client_negotiation.cc:769] Sending connection context
0807 04:19:05.756272 (+ 239us) client_negotiation.cc:240] Negotiation successful
0807 04:19:05.756678 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":295,"threads_started":1}
I20260807 04:19:05.759598 21692 heartbeater.cc:347] Connected to a master server at 127.7.200.254:44325
I20260807 04:19:05.759980 21692 heartbeater.cc:464] Registering TS with master...
I20260807 04:19:05.760776 21692 heartbeater.cc:511] Master 127.7.200.254:44325 requested a full tablet report, sending...
I20260807 04:19:05.762342 21181 ts_manager.cc:194] Registered new tserver with Master: d611193d473449c4a91011b3b4e2f8a8 (127.7.200.195:40517)
I20260807 04:19:05.763250 21181 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.195@KRBTEST.COM'} at 127.7.200.195:48773
I20260807 04:19:05.772265 7971 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 04:19:05.774219 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 21267
Aug 07 04:19:05 dist-test-slave-qg60 krb5kdc[20688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.193@KRBTEST.COM
I20260807 04:19:05.792431 21697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:05.775290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50404 (local address 127.7.200.193:40425)
0807 04:19:05.775940 (+ 650us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:05.775947 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:05.775972 (+ 25us) server_negotiation.cc:407] Connection header received
0807 04:19:05.776028 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:05.776035 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:05.776253 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:05.776381 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:05.778318 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:05.779443 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:05.781069 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:05.781653 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:05.781757 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:05.786259 (+ 4502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:05.786272 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:05.786286 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:05.786329 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:05.789298 (+ 2969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:05.790114 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:05.790122 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:05.790125 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:05.790355 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:05.790802 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:05.790805 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:05.790808 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:05.791220 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:05.791461 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:05.791850 (+ 389us) server_negotiation.cc:299] Negotiation successful
0807 04:19:05.792149 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":348,"threads_started":1}
I20260807 04:19:05.793915 21399 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:19:05.879441 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 21267
I20260807 04:19:05.899648 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 21410
Aug 07 04:19:05 dist-test-slave-qg60 krb5kdc[20688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.194@KRBTEST.COM
I20260807 04:19:05.917382 21699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:05.900652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38572 (local address 127.7.200.194:45197)
0807 04:19:05.901238 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:05.901245 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:05.901271 (+ 26us) server_negotiation.cc:407] Connection header received
0807 04:19:05.901346 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:05.901353 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:05.901571 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:05.901758 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:05.903100 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:05.904208 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:05.905848 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:05.906415 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:05.906569 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:05.911275 (+ 4706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:05.911293 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:05.911307 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:05.911342 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:05.914264 (+ 2922us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:05.915014 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:05.915023 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:05.915027 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:05.915173 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:05.915573 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:05.915585 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:05.915587 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:05.915939 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:05.916266 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:05.916618 (+ 352us) server_negotiation.cc:299] Negotiation successful
0807 04:19:05.917073 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":340,"threads_started":1}
I20260807 04:19:05.918694 21548 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:19:06.002910 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 21410
I20260807 04:19:06.026360 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 21560
Aug 07 04:19:06 dist-test-slave-qg60 krb5kdc[20688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076341, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.195@KRBTEST.COM
I20260807 04:19:06.044225 21701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:06.027472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38998 (local address 127.7.200.195:40517)
0807 04:19:06.028162 (+ 690us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:06.028169 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:06.028200 (+ 31us) server_negotiation.cc:407] Connection header received
0807 04:19:06.028262 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:06.028268 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:06.028492 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:06.028621 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:06.029969 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:06.030955 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:06.032300 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:06.032954 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:06.033096 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:06.037705 (+ 4609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:06.037719 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:06.037734 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:06.037779 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:06.041159 (+ 3380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:06.041943 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:06.041951 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:06.041953 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:06.042104 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:06.042542 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:06.042546 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:06.042549 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:06.043026 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:06.043310 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:06.043693 (+ 383us) server_negotiation.cc:299] Negotiation successful
0807 04:19:06.043914 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":339,"threads_started":1}
I20260807 04:19:06.045670 21687 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:19:06.129380 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 21560
I20260807 04:19:06.147926 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 21149
I20260807 04:19:06.149375 21213 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:19:06.259351 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 21149
I20260807 04:19:06.284616 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:44325
--webserver_interface=127.7.200.254
--webserver_port=33217
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:39957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:44325
--ranger_config_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.200.212:53957/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.7.200.212:53957/kms with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:19:06.636013 21704 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:19:06.636318 21704 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:19:06.636499 21704 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:19:06.644097 21704 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:19:06.644245 21704 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:19:06.644336 21704 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:19:06.644433 21704 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:19:06.644506 21704 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:19:06.655128 21704 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:39957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.7.200.212:53957/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:44325
--ranger_config_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:44325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=33217
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:19:06.656555 21704 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:19:06.657979 21704 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:19:06.670276 21712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:06.670320 21714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:06.670361 21710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:06.671311 21704 server_base.cc:1034] running on GCE node
I20260807 04:19:06.672194 21704 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:19:06.673851 21704 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:19:06.675155 21704 hybrid_clock.cc:648] HybridClock initialized: now 1786076346675057 us; error 57 us; skew 500 ppm
I20260807 04:19:06.675554 21704 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:19:06 dist-test-slave-qg60 krb5kdc[20688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076346, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:19:06.679071 21704 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:19:06.680823 21704 webserver.cc:460] Webserver started at http://127.7.200.254:33217/ using document root <none> and password file <none>
I20260807 04:19:06.681565 21704 fs_manager.cc:359] Metadata directory not provided
I20260807 04:19:06.681725 21704 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 04:19:06 dist-test-slave-qg60 krb5kdc[20688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076346, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for HTTP/127.7.200.212@KRBTEST.COM
I20260807 04:19:06.770645 21704 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 04:19:06.773802 21723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:06.775266 21704 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 04:19:06.775430 21704 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "814bce1e0fca4a90b8968a4377ed015e"
format_stamp: "Formatted at 2026-08-07 04:19:02 on dist-test-slave-qg60"
server_key: "7bf7f76dfc715fc8dd2b080a29b63ff6"
server_key_iv: "f140078dc1ad337d412dc8878040c9a7"
server_key_version: "kuduclusterkey@0"
I20260807 04:19:06.776376 21704 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:19:06.807514 21704 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:19:06.811889 21704 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:19:06.812139 21704 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:19:06.832023 21704 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:44325
I20260807 04:19:06.832031 21776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:44325 every 8 connection(s)
I20260807 04:19:06.833693 21704 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:19:06.837251 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 21704
I20260807 04:19:06.838349 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.200.212:53957/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:40425
--local_ip_for_outbound_sockets=127.7.200.193
--tserver_master_addrs=127.7.200.254:44325
--webserver_port=46447
--webserver_interface=127.7.200.193
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:39957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.7.200.212:53957/kms with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 04:19:06.842403 21777 sys_catalog.cc:263] Verifying existing consensus state
I20260807 04:19:06.847880 21777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e: Bootstrap starting.
I20260807 04:19:06.868330 21777 log.cc:824] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e: Log is configured to *not* fsync() on all Append() calls
I20260807 04:19:06.877458 21777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 04:19:06.878028 21777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e: Bootstrap complete.
I20260807 04:19:06.887847 21777 raft_consensus.cc:348] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "814bce1e0fca4a90b8968a4377ed015e" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44325 } }
I20260807 04:19:06.888773 21777 raft_consensus.cc:729] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 814bce1e0fca4a90b8968a4377ed015e, State: Initialized, Role: FOLLOWER
I20260807 04:19:06.889493 21777 consensus_queue.cc:260] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "814bce1e0fca4a90b8968a4377ed015e" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44325 } }
I20260807 04:19:06.889748 21777 raft_consensus.cc:388] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:19:06.889891 21777 raft_consensus.cc:482] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:19:06.890081 21777 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [term 1 FOLLOWER]: Advancing to term 2
I20260807 04:19:06.894012 21777 raft_consensus.cc:504] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "814bce1e0fca4a90b8968a4377ed015e" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44325 } }
I20260807 04:19:06.894517 21777 leader_election.cc:302] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 814bce1e0fca4a90b8968a4377ed015e; no voters:
I20260807 04:19:06.895217 21777 leader_election.cc:288] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 04:19:06.895363 21781 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [term 2 FOLLOWER]: Leader election won for term 2
I20260807 04:19:06.896837 21781 raft_consensus.cc:686] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [term 2 LEADER]: Becoming Leader. State: Replica: 814bce1e0fca4a90b8968a4377ed015e, State: Running, Role: LEADER
I20260807 04:19:06.897487 21781 consensus_queue.cc:237] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "814bce1e0fca4a90b8968a4377ed015e" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44325 } }
I20260807 04:19:06.897672 21777 sys_catalog.cc:564] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:19:06.900161 21783 sys_catalog.cc:455] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 814bce1e0fca4a90b8968a4377ed015e. Latest consensus state: current_term: 2 leader_uuid: "814bce1e0fca4a90b8968a4377ed015e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "814bce1e0fca4a90b8968a4377ed015e" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44325 } } }
I20260807 04:19:06.900645 21783 sys_catalog.cc:458] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [sys.catalog]: This master's current role is: LEADER
I20260807 04:19:06.901089 21782 sys_catalog.cc:455] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "814bce1e0fca4a90b8968a4377ed015e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "814bce1e0fca4a90b8968a4377ed015e" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44325 } } }
I20260807 04:19:06.901467 21782 sys_catalog.cc:458] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e [sys.catalog]: This master's current role is: LEADER
I20260807 04:19:06.906597 21788 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:19:06.914376 21788 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:19:06.916170 21788 catalog_manager.cc:1259] Loaded cluster ID: 941c9d08053649c7867e84854d3eec34
I20260807 04:19:06.916368 21788 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:19:06.919673 21777 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 04:19:06.920948 21788 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:19:06.922715 21788 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e: Loaded TSK: 0
I20260807 04:19:06.924780 21788 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 04:19:07.284811 21779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:19:07.285326 21779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:19:07.285548 21779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:19:07.297188 21779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:19:07.297358 21779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:19:07.297587 21779 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:19:07.312157 21779 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:39957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.7.200.212:53957/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:40425
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=46447
--tserver_master_addrs=127.7.200.254:44325
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:19:07.314046 21779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:19:07.315878 21779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:19:07.355388 21815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:07.356058 21814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:07.356865 21779 server_base.cc:1034] running on GCE node
W20260807 04:19:07.357573 21817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:07.358456 21779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:19:07.359577 21779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:19:07.360854 21779 hybrid_clock.cc:648] HybridClock initialized: now 1786076347360783 us; error 59 us; skew 500 ppm
I20260807 04:19:07.361235 21779 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:19:07 dist-test-slave-qg60 krb5kdc[20688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076347, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:19:07.364850 21779 init.cc:377] Logged in from keytab as kudu/127.7.200.193@KRBTEST.COM (short username kudu)
I20260807 04:19:07.371039 21779 webserver.cc:460] Webserver started at http://127.7.200.193:46447/ using document root <none> and password file <none>
I20260807 04:19:07.371803 21779 fs_manager.cc:359] Metadata directory not provided
I20260807 04:19:07.371984 21779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 04:19:07 dist-test-slave-qg60 krb5kdc[20688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076347, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for HTTP/127.7.200.212@KRBTEST.COM
I20260807 04:19:07.456204 21779 fs_manager.cc:709] Time spent opening directory manager: real 0.019s user 0.002s sys 0.009s
I20260807 04:19:07.471617 21825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:07.481495 21779 fs_manager.cc:725] Time spent opening block manager: real 0.023s user 0.000s sys 0.008s
I20260807 04:19:07.481817 21779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "1828ce4a28d049b4bc02db858d7e3918"
format_stamp: "Formatted at 2026-08-07 04:19:04 on dist-test-slave-qg60"
server_key: "5b0c4f785d4f39dfca8b35da6f87a27b"
server_key_iv: "ea62fdade626e46e8aa189d288b44346"
server_key_version: "kuduclusterkey@0"
I20260807 04:19:07.483489 21779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:19:07.536826 21779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:19:07.542570 21779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:19:07.542974 21779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:19:07.550570 21779 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:19:07.559063 21779 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:19:07.559289 21779 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260807 04:19:07.559525 21779 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:19:07.559702 21779 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:07.783891 21779 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:40425
I20260807 04:19:07.783938 21945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:40425 every 8 connection(s)
I20260807 04:19:07.786002 21779 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:19:07.790994 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 21779
I20260807 04:19:07.791810 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.200.212:53957/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:45197
--local_ip_for_outbound_sockets=127.7.200.194
--tserver_master_addrs=127.7.200.254:44325
--webserver_port=38321
--webserver_interface=127.7.200.194
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:39957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.7.200.212:53957/kms with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 04:19:07 dist-test-slave-qg60 krb5kdc[20688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076347, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:19:07.844040 21947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:07.795914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:44325 (local address 127.7.200.193:45311)
0807 04:19:07.809347 (+ 13433us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:07.809440 (+ 93us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:07.811346 (+ 1906us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:07.813936 (+ 2590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:07.813947 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:07.814652 (+ 705us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:19:07.815467 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:07.815494 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:07.817857 (+ 2363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:07.817863 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:07.819984 (+ 2121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:07.820016 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:07.821790 (+ 1774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:07.821797 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:07.822052 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:07.822912 (+ 860us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:19:07.822942 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:19:07.825752 (+ 2810us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:19:07.831877 (+ 6125us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:07.831890 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:07.831911 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:07.834556 (+ 2645us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:07.836241 (+ 1685us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:07.836248 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:07.836255 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:07.836579 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:07.841255 (+ 4676us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:19:07.841264 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:19:07.841726 (+ 462us) client_negotiation.cc:769] Sending connection context
0807 04:19:07.842038 (+ 312us) client_negotiation.cc:240] Negotiation successful
0807 04:19:07.842661 (+ 623us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12923,"thread_start_us":15732,"threads_started":1}
I20260807 04:19:07.847182 21948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:07.797176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:45311 (local address 127.7.200.254:44325)
0807 04:19:07.811491 (+ 14315us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:07.811514 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:07.811575 (+ 61us) server_negotiation.cc:407] Connection header received
0807 04:19:07.812280 (+ 705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:07.812293 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:07.812748 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:07.813181 (+ 433us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:07.815702 (+ 2521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:07.817659 (+ 1957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:07.820183 (+ 2524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:07.821227 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:07.821397 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:07.826047 (+ 4650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:07.826059 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:07.826082 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:07.826148 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:07.830744 (+ 4596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:07.835345 (+ 4601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:07.835359 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:07.835370 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:07.836064 (+ 694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:07.837220 (+ 1156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:07.837228 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:07.837233 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:07.840909 (+ 3676us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:07.841142 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:07.845561 (+ 4419us) server_negotiation.cc:299] Negotiation successful
0807 04:19:07.846009 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12514,"thread_start_us":12282,"threads_started":1}
I20260807 04:19:07.852698 21946 heartbeater.cc:347] Connected to a master server at 127.7.200.254:44325
I20260807 04:19:07.853104 21946 heartbeater.cc:464] Registering TS with master...
I20260807 04:19:07.853951 21946 heartbeater.cc:511] Master 127.7.200.254:44325 requested a full tablet report, sending...
W20260807 04:19:07.857337 21946 heartbeater.cc:644] Failed to heartbeat to 127.7.200.254:44325 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 04:19:07.857563 21946 heartbeater.cc:464] Registering TS with master...
I20260807 04:19:07.857859 21946 heartbeater.cc:511] Master 127.7.200.254:44325 requested a full tablet report, sending...
I20260807 04:19:07.859256 21946 heartbeater.cc:464] Registering TS with master...
I20260807 04:19:07.859596 21946 heartbeater.cc:511] Master 127.7.200.254:44325 requested a full tablet report, sending...
W20260807 04:19:07.860658 21946 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 07 04:19:08 dist-test-slave-qg60 krb5kdc[20688](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786076348, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260807 04:19:08.279137 21950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:19:08.279618 21950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:19:08.279814 21950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:19:08.292186 21950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:19:08.292436 21950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:19:08.292668 21950 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:19:08.309886 21950 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:39957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.7.200.212:53957/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:45197
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=38321
--tserver_master_addrs=127.7.200.254:44325
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:19:08.311726 21950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:19:08.313519 21950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:19:08.334041 21967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:08.340344 21966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:08.340955 21969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:08.342506 21950 server_base.cc:1034] running on GCE node
I20260807 04:19:08.343626 21950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:19:08.345150 21950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:19:08.346467 21950 hybrid_clock.cc:648] HybridClock initialized: now 1786076348346399 us; error 47 us; skew 500 ppm
I20260807 04:19:08.346880 21950 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:19:08 dist-test-slave-qg60 krb5kdc[20688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076348, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:19:08.351440 21950 init.cc:377] Logged in from keytab as kudu/127.7.200.194@KRBTEST.COM (short username kudu)
I20260807 04:19:08.353633 21950 webserver.cc:460] Webserver started at http://127.7.200.194:38321/ using document root <none> and password file <none>
I20260807 04:19:08.354583 21950 fs_manager.cc:359] Metadata directory not provided
I20260807 04:19:08.354755 21950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 04:19:08 dist-test-slave-qg60 krb5kdc[20688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076348, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for HTTP/127.7.200.212@KRBTEST.COM
I20260807 04:19:08.377754 21950 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.002s sys 0.001s
I20260807 04:19:08.381837 21979 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:08.383584 21950 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 04:19:08.383790 21950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "6abc7979e8974cee9f57c816679a12d7"
format_stamp: "Formatted at 2026-08-07 04:19:05 on dist-test-slave-qg60"
server_key: "afd3a9af5f10774206e05bc284013c60"
server_key_iv: "55ac599091c549fab592f294f3f17cd9"
server_key_version: "kuduclusterkey@0"
I20260807 04:19:08.385010 21950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:19:08.420518 21950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:19:08.426826 21950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:19:08.427268 21950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:19:08.428803 21950 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:19:08.430758 21950 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:19:08.430912 21950 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260807 04:19:08.431066 21950 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:19:08.431183 21950 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:08.528455 21950 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:45197
I20260807 04:19:08.528546 22100 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:45197 every 8 connection(s)
I20260807 04:19:08.530572 21950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:19:08.539767 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 21950
I20260807 04:19:08.540578 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.7.200.212:53957/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:40517
--local_ip_for_outbound_sockets=127.7.200.195
--tserver_master_addrs=127.7.200.254:44325
--webserver_port=40247
--webserver_interface=127.7.200.195
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:39957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.7.200.212:53957/kms with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 04:19:08 dist-test-slave-qg60 krb5kdc[20688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076348, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:19:08.554207 22105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:08.535095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:57215 (local address 127.7.200.254:44325)
0807 04:19:08.539308 (+ 4213us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:08.539312 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:08.539329 (+ 17us) server_negotiation.cc:407] Connection header received
0807 04:19:08.539384 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:08.539387 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:08.539457 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:08.539589 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:08.541337 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:08.542074 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:08.543708 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:08.544157 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:08.544306 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:08.547903 (+ 3597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:08.547909 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:08.547919 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:08.547954 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:08.550770 (+ 2816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:08.551535 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:08.551540 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:08.551544 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:08.551668 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:08.552149 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:08.552153 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:08.552157 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:08.552526 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:08.552697 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:08.553681 (+ 984us) server_negotiation.cc:299] Negotiation successful
0807 04:19:08.553933 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4100,"thread_start_us":4015,"threads_started":1}
I20260807 04:19:08.555754 22104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:08.534450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:44325 (local address 127.7.200.194:57215)
0807 04:19:08.535664 (+ 1214us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:08.535759 (+ 95us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:08.538742 (+ 2983us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:08.539872 (+ 1130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:08.539887 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:08.540386 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:19:08.541148 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:08.541168 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:08.542250 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:08.542256 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:08.543539 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:08.543551 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:08.544415 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:08.544423 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:08.544659 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:08.545524 (+ 865us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:19:08.545551 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:19:08.547668 (+ 2117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:19:08.550941 (+ 3273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:08.550950 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:08.550968 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:08.551397 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:08.551786 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:08.551791 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:08.551795 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:08.552019 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:08.552693 (+ 674us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:19:08.552701 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:19:08.553198 (+ 497us) client_negotiation.cc:769] Sending connection context
0807 04:19:08.553528 (+ 330us) client_negotiation.cc:240] Negotiation successful
0807 04:19:08.554170 (+ 642us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":676,"thread_start_us":690,"threads_started":1}
I20260807 04:19:08.557415 22101 heartbeater.cc:347] Connected to a master server at 127.7.200.254:44325
I20260807 04:19:08.557749 22101 heartbeater.cc:464] Registering TS with master...
I20260807 04:19:08.558706 22101 heartbeater.cc:511] Master 127.7.200.254:44325 requested a full tablet report, sending...
I20260807 04:19:08.560804 21742 ts_manager.cc:194] Registered new tserver with Master: 6abc7979e8974cee9f57c816679a12d7 (127.7.200.194:45197)
I20260807 04:19:08.562434 21742 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.194@KRBTEST.COM'} at 127.7.200.194:57215
Aug 07 04:19:08 dist-test-slave-qg60 krb5kdc[20688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076348, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for HTTP/127.7.200.212@KRBTEST.COM
I20260807 04:19:08.860894 21946 heartbeater.cc:464] Registering TS with master...
I20260807 04:19:08.861445 21946 heartbeater.cc:511] Master 127.7.200.254:44325 requested a full tablet report, sending...
I20260807 04:19:08.862994 21742 ts_manager.cc:194] Registered new tserver with Master: 1828ce4a28d049b4bc02db858d7e3918 (127.7.200.193:40425)
I20260807 04:19:08.864369 21742 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.193@KRBTEST.COM'} at 127.7.200.193:45311
W20260807 04:19:08.975857 22106 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:19:08.976227 22106 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:19:08.976405 22106 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:19:08.984197 22106 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:19:08.984364 22106 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:19:08.984548 22106 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:19:08.997033 22106 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:39957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.7.200.212:53957/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:40517
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=40247
--tserver_master_addrs=127.7.200.254:44325
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:19:08.998984 22106 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:19:09.000893 22106 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:19:09.029031 22115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:09.029055 22111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:09.029567 22112 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:09.031402 22106 server_base.cc:1034] running on GCE node
I20260807 04:19:09.032202 22106 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:19:09.038401 22106 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:19:09.039754 22106 hybrid_clock.cc:648] HybridClock initialized: now 1786076349039628 us; error 115 us; skew 500 ppm
I20260807 04:19:09.040274 22106 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:19:09 dist-test-slave-qg60 krb5kdc[20688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076349, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:19:09.045938 22106 init.cc:377] Logged in from keytab as kudu/127.7.200.195@KRBTEST.COM (short username kudu)
Aug 07 04:19:09 dist-test-slave-qg60 krb5kdc[20688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076348, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for HTTP/127.7.200.212@KRBTEST.COM
I20260807 04:19:09.063889 22106 webserver.cc:460] Webserver started at http://127.7.200.195:40247/ using document root <none> and password file <none>
I20260807 04:19:09.065012 22106 fs_manager.cc:359] Metadata directory not provided
I20260807 04:19:09.065207 22106 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 04:19:09 dist-test-slave-qg60 krb5kdc[20688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076349, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for HTTP/127.7.200.212@KRBTEST.COM
I20260807 04:19:09.130244 22106 fs_manager.cc:709] Time spent opening directory manager: real 0.015s user 0.003s sys 0.009s
I20260807 04:19:09.142179 22126 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:09.144405 22106 fs_manager.cc:725] Time spent opening block manager: real 0.012s user 0.000s sys 0.003s
I20260807 04:19:09.144749 22106 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "d611193d473449c4a91011b3b4e2f8a8"
format_stamp: "Formatted at 2026-08-07 04:19:05 on dist-test-slave-qg60"
server_key: "bc94d319c5add5eaa9a4aeed6c66d8ea"
server_key_iv: "79ede81cbe08c70056bf74603d613069"
server_key_version: "kuduclusterkey@0"
I20260807 04:19:09.146507 22106 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:19:09.192953 22106 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:19:09.202880 22106 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:19:09.203325 22106 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:19:09.206254 22106 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:19:09.208308 22106 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:19:09.208505 22106 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:09.208665 22106 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:19:09.208819 22106 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:09.314802 22106 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:40517
I20260807 04:19:09.314919 22243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:40517 every 8 connection(s)
I20260807 04:19:09.316359 22106 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:19:09.325407 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 22106
Aug 07 04:19:09 dist-test-slave-qg60 krb5kdc[20688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076349, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:19:09.383517 22246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:09.327379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55176 (local address 127.7.200.254:44325)
0807 04:19:09.362494 (+ 35115us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:09.362503 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:09.362529 (+ 26us) server_negotiation.cc:407] Connection header received
0807 04:19:09.362613 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:09.362622 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:09.362745 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:09.362899 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:09.365218 (+ 2319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.366605 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.369104 (+ 2499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.369883 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.374054 (+ 4171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:09.374283 (+ 229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:09.374288 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:09.374292 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:09.374320 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:09.378306 (+ 3986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:09.379313 (+ 1007us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:09.379318 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:09.379321 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:09.379519 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:09.380357 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:09.380362 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:09.380365 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:09.380859 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:09.382885 (+ 2026us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:09.383049 (+ 164us) server_negotiation.cc:299] Negotiation successful
0807 04:19:09.383244 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34944,"thread_start_us":28923,"threads_started":1}
I20260807 04:19:09.386737 22249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:09.319738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:36689 (local address 127.7.200.254:44325)
0807 04:19:09.356258 (+ 36520us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:09.356269 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:09.360796 (+ 4527us) server_negotiation.cc:407] Connection header received
0807 04:19:09.365668 (+ 4872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:09.365673 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:09.365777 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:09.365859 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:09.368382 (+ 2523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.369693 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.372311 (+ 2618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.373579 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.373727 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:09.378603 (+ 4876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:09.378611 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:09.378615 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:09.378656 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:09.382867 (+ 4211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:09.383947 (+ 1080us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:09.383962 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:09.383965 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:09.384129 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:09.384816 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:09.384821 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:09.384825 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:09.385171 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:09.385318 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:09.386115 (+ 797us) server_negotiation.cc:299] Negotiation successful
0807 04:19:09.386361 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36297,"thread_start_us":44990,"threads_started":1}
I20260807 04:19:09.387967 22247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:09.321206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:44325 (local address 127.7.200.195:36689)
0807 04:19:09.358730 (+ 37524us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:09.358820 (+ 90us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:09.364524 (+ 5704us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:09.366563 (+ 2039us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:09.366580 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:09.367275 (+ 695us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:19:09.368109 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:09.368134 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.369922 (+ 1788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.369928 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:09.372099 (+ 2171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:09.372116 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.374082 (+ 1966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.374089 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:09.374406 (+ 317us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:09.375255 (+ 849us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:19:09.375287 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:19:09.378285 (+ 2998us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:19:09.383064 (+ 4779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:09.383076 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:09.383097 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:09.383794 (+ 697us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:09.384282 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:09.384287 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:09.384292 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:09.384643 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:09.385329 (+ 686us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:19:09.385338 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:19:09.385735 (+ 397us) client_negotiation.cc:769] Sending connection context
0807 04:19:09.386021 (+ 286us) client_negotiation.cc:240] Negotiation successful
0807 04:19:09.386909 (+ 888us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37047,"thread_start_us":39488,"threads_started":1}
I20260807 04:19:09.389472 22244 heartbeater.cc:347] Connected to a master server at 127.7.200.254:44325
I20260807 04:19:09.389799 22244 heartbeater.cc:464] Registering TS with master...
I20260807 04:19:09.390571 22244 heartbeater.cc:511] Master 127.7.200.254:44325 requested a full tablet report, sending...
I20260807 04:19:09.392007 21742 ts_manager.cc:194] Registered new tserver with Master: d611193d473449c4a91011b3b4e2f8a8 (127.7.200.195:40517)
I20260807 04:19:09.392897 21742 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.195@KRBTEST.COM'} at 127.7.200.195:36689
I20260807 04:19:09.399477 7971 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 04:19:09.418853 22249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:09.403293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55182 (local address 127.7.200.254:44325)
0807 04:19:09.403551 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:09.403560 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:09.404017 (+ 457us) server_negotiation.cc:407] Connection header received
0807 04:19:09.404203 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:09.404207 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:09.404273 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:09.404355 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:09.406830 (+ 2475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.407579 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.409679 (+ 2100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.410119 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.410219 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:09.413201 (+ 2982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:09.413207 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:09.413210 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:09.413246 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:09.415976 (+ 2730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:09.416804 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:09.416808 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:09.416810 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:09.416946 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:09.417363 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:09.417368 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:09.417370 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:09.417652 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:09.417918 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:09.418283 (+ 365us) server_negotiation.cc:299] Negotiation successful
0807 04:19:09.418520 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 04:19:09.424355 21742 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55182:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:19:09.433542 21742 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:19:09.487869 22272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:09.449745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:40517 (local address 127.0.0.1:39000)
0807 04:19:09.467135 (+ 17390us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:09.467159 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:09.467268 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:09.474409 (+ 7141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:09.474417 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:09.474453 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:19:09.474975 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:09.474991 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.482084 (+ 7093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.482091 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:09.484711 (+ 2620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:09.484747 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.486825 (+ 2078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.486831 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:09.487036 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:09.487093 (+ 57us) client_negotiation.cc:769] Sending connection context
0807 04:19:09.487225 (+ 132us) client_negotiation.cc:240] Negotiation successful
0807 04:19:09.487434 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17248,"mutex_wait_us":27,"thread_start_us":360,"threads_started":1}
I20260807 04:19:09.489337 22269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:09.449376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:45197 (local address 127.0.0.1:38588)
0807 04:19:09.450502 (+ 1126us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:09.450541 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:09.450720 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:09.476353 (+ 25633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:09.476360 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:09.476398 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:19:09.476952 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:09.476967 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.484005 (+ 7038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.484010 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:09.486395 (+ 2385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:09.486410 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.488394 (+ 1984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.488401 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:09.488599 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:09.488634 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 04:19:09.488705 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 04:19:09.488875 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":859,"mutex_wait_us":81,"thread_start_us":31127,"threads_started":1}
I20260807 04:19:09.489899 22271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:09.450335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39000 (local address 127.7.200.195:40517)
0807 04:19:09.473476 (+ 23141us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:09.473490 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:09.473540 (+ 50us) server_negotiation.cc:407] Connection header received
0807 04:19:09.473687 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:09.473701 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:09.474071 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:09.474389 (+ 318us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:19:09.479598 (+ 5209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.481911 (+ 2313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.484964 (+ 3053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.486578 (+ 1614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.488692 (+ 2114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:09.489021 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:09.489108 (+ 87us) server_negotiation.cc:299] Negotiation successful
0807 04:19:09.489310 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22869,"thread_start_us":22672,"threads_started":1}
I20260807 04:19:09.490764 22270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:09.449862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38588 (local address 127.7.200.194:45197)
0807 04:19:09.475581 (+ 25719us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:09.475594 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:09.475632 (+ 38us) server_negotiation.cc:407] Connection header received
0807 04:19:09.475760 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:09.475772 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:09.476071 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:09.477220 (+ 1149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:19:09.477513 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.483825 (+ 6312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.486622 (+ 2797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.488122 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.489899 (+ 1777us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:09.490106 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:09.490178 (+ 72us) server_negotiation.cc:299] Negotiation successful
0807 04:19:09.490348 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25470,"thread_start_us":25778,"threads_started":1}
I20260807 04:19:09.491875 22273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:09.451752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50414 (local address 127.7.200.193:40425)
0807 04:19:09.481801 (+ 30049us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:09.481810 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:09.481840 (+ 30us) server_negotiation.cc:407] Connection header received
0807 04:19:09.481935 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:09.481943 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:09.482195 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:09.482416 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:19:09.483408 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.485010 (+ 1602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.487437 (+ 2427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.489104 (+ 1667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.489229 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:09.489455 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:09.491337 (+ 1882us) server_negotiation.cc:299] Negotiation successful
0807 04:19:09.491527 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29826,"thread_start_us":29638,"threads_started":1}
I20260807 04:19:09.492349 22268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:09.451604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:40425 (local address 127.0.0.1:50414)
0807 04:19:09.480959 (+ 29355us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:09.480979 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:09.481099 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:09.482684 (+ 1585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:09.482689 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:09.482717 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:19:09.483196 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:09.483210 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.485176 (+ 1966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.485183 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:09.487276 (+ 2093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:09.487288 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.489606 (+ 2318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.489612 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:09.489996 (+ 384us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:09.490035 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 04:19:09.490121 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 04:19:09.490263 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29230,"mutex_wait_us":2,"thread_start_us":15231,"threads_started":1}
I20260807 04:19:09.494355 22032 tablet_service.cc:1467] Processing CreateTablet for tablet 6035fb877230470cbb7f1c504a030ee8 (DEFAULT_TABLE table=test-table [id=046748c876244eea94764318ac558dd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:19:09.494355 22178 tablet_service.cc:1467] Processing CreateTablet for tablet 6035fb877230470cbb7f1c504a030ee8 (DEFAULT_TABLE table=test-table [id=046748c876244eea94764318ac558dd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:19:09.495853 22178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6035fb877230470cbb7f1c504a030ee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:19:09.495847 22032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6035fb877230470cbb7f1c504a030ee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:19:09.495792 21879 tablet_service.cc:1467] Processing CreateTablet for tablet 6035fb877230470cbb7f1c504a030ee8 (DEFAULT_TABLE table=test-table [id=046748c876244eea94764318ac558dd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:19:09.497174 21879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6035fb877230470cbb7f1c504a030ee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:19:09.515282 22275 tablet_bootstrap.cc:492] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8: Bootstrap starting.
I20260807 04:19:09.520538 22276 tablet_bootstrap.cc:492] T 6035fb877230470cbb7f1c504a030ee8 P 1828ce4a28d049b4bc02db858d7e3918: Bootstrap starting.
I20260807 04:19:09.522264 22275 tablet_bootstrap.cc:654] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8: Neither blocks nor log segments found. Creating new log.
I20260807 04:19:09.523639 22275 log.cc:824] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8: Log is configured to *not* fsync() on all Append() calls
I20260807 04:19:09.524761 22276 tablet_bootstrap.cc:654] T 6035fb877230470cbb7f1c504a030ee8 P 1828ce4a28d049b4bc02db858d7e3918: Neither blocks nor log segments found. Creating new log.
I20260807 04:19:09.524986 22274 tablet_bootstrap.cc:492] T 6035fb877230470cbb7f1c504a030ee8 P 6abc7979e8974cee9f57c816679a12d7: Bootstrap starting.
I20260807 04:19:09.527099 22276 log.cc:824] T 6035fb877230470cbb7f1c504a030ee8 P 1828ce4a28d049b4bc02db858d7e3918: Log is configured to *not* fsync() on all Append() calls
I20260807 04:19:09.529565 22275 tablet_bootstrap.cc:492] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8: No bootstrap required, opened a new log
I20260807 04:19:09.529883 22275 ts_tablet_manager.cc:1397] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.000s
I20260807 04:19:09.541551 22275 raft_consensus.cc:348] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6abc7979e8974cee9f57c816679a12d7" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45197 } } peers { permanent_uuid: "d611193d473449c4a91011b3b4e2f8a8" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 40517 } } peers { permanent_uuid: "1828ce4a28d049b4bc02db858d7e3918" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40425 } }
I20260807 04:19:09.542079 22275 raft_consensus.cc:374] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:19:09.542210 22275 raft_consensus.cc:729] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d611193d473449c4a91011b3b4e2f8a8, State: Initialized, Role: FOLLOWER
I20260807 04:19:09.542936 22275 consensus_queue.cc:260] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6abc7979e8974cee9f57c816679a12d7" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45197 } } peers { permanent_uuid: "d611193d473449c4a91011b3b4e2f8a8" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 40517 } } peers { permanent_uuid: "1828ce4a28d049b4bc02db858d7e3918" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40425 } }
I20260807 04:19:09.549480 22274 tablet_bootstrap.cc:654] T 6035fb877230470cbb7f1c504a030ee8 P 6abc7979e8974cee9f57c816679a12d7: Neither blocks nor log segments found. Creating new log.
I20260807 04:19:09.550747 22244 heartbeater.cc:503] Master 127.7.200.254:44325 was elected leader, sending a full tablet report...
I20260807 04:19:09.551162 22274 log.cc:824] T 6035fb877230470cbb7f1c504a030ee8 P 6abc7979e8974cee9f57c816679a12d7: Log is configured to *not* fsync() on all Append() calls
I20260807 04:19:09.552459 22275 ts_tablet_manager.cc:1428] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8: Time spent starting tablet: real 0.022s user 0.015s sys 0.004s
I20260807 04:19:09.555857 22274 tablet_bootstrap.cc:492] T 6035fb877230470cbb7f1c504a030ee8 P 6abc7979e8974cee9f57c816679a12d7: No bootstrap required, opened a new log
I20260807 04:19:09.556201 22274 ts_tablet_manager.cc:1397] T 6035fb877230470cbb7f1c504a030ee8 P 6abc7979e8974cee9f57c816679a12d7: Time spent bootstrapping tablet: real 0.032s user 0.011s sys 0.000s
I20260807 04:19:09.557729 22276 tablet_bootstrap.cc:492] T 6035fb877230470cbb7f1c504a030ee8 P 1828ce4a28d049b4bc02db858d7e3918: No bootstrap required, opened a new log
I20260807 04:19:09.558045 22276 ts_tablet_manager.cc:1397] T 6035fb877230470cbb7f1c504a030ee8 P 1828ce4a28d049b4bc02db858d7e3918: Time spent bootstrapping tablet: real 0.038s user 0.012s sys 0.018s
I20260807 04:19:09.564205 22274 raft_consensus.cc:348] T 6035fb877230470cbb7f1c504a030ee8 P 6abc7979e8974cee9f57c816679a12d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6abc7979e8974cee9f57c816679a12d7" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45197 } } peers { permanent_uuid: "d611193d473449c4a91011b3b4e2f8a8" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 40517 } } peers { permanent_uuid: "1828ce4a28d049b4bc02db858d7e3918" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40425 } }
I20260807 04:19:09.564612 22274 raft_consensus.cc:374] T 6035fb877230470cbb7f1c504a030ee8 P 6abc7979e8974cee9f57c816679a12d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:19:09.564761 22274 raft_consensus.cc:729] T 6035fb877230470cbb7f1c504a030ee8 P 6abc7979e8974cee9f57c816679a12d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6abc7979e8974cee9f57c816679a12d7, State: Initialized, Role: FOLLOWER
I20260807 04:19:09.565416 22274 consensus_queue.cc:260] T 6035fb877230470cbb7f1c504a030ee8 P 6abc7979e8974cee9f57c816679a12d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6abc7979e8974cee9f57c816679a12d7" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45197 } } peers { permanent_uuid: "d611193d473449c4a91011b3b4e2f8a8" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 40517 } } peers { permanent_uuid: "1828ce4a28d049b4bc02db858d7e3918" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40425 } }
I20260807 04:19:09.566591 22101 heartbeater.cc:503] Master 127.7.200.254:44325 was elected leader, sending a full tablet report...
I20260807 04:19:09.567341 22274 ts_tablet_manager.cc:1428] T 6035fb877230470cbb7f1c504a030ee8 P 6abc7979e8974cee9f57c816679a12d7: Time spent starting tablet: real 0.011s user 0.004s sys 0.005s
I20260807 04:19:09.568836 22276 raft_consensus.cc:348] T 6035fb877230470cbb7f1c504a030ee8 P 1828ce4a28d049b4bc02db858d7e3918 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6abc7979e8974cee9f57c816679a12d7" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45197 } } peers { permanent_uuid: "d611193d473449c4a91011b3b4e2f8a8" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 40517 } } peers { permanent_uuid: "1828ce4a28d049b4bc02db858d7e3918" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40425 } }
I20260807 04:19:09.569470 22276 raft_consensus.cc:374] T 6035fb877230470cbb7f1c504a030ee8 P 1828ce4a28d049b4bc02db858d7e3918 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:19:09.569597 22276 raft_consensus.cc:729] T 6035fb877230470cbb7f1c504a030ee8 P 1828ce4a28d049b4bc02db858d7e3918 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1828ce4a28d049b4bc02db858d7e3918, State: Initialized, Role: FOLLOWER
I20260807 04:19:09.570232 22276 consensus_queue.cc:260] T 6035fb877230470cbb7f1c504a030ee8 P 1828ce4a28d049b4bc02db858d7e3918 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6abc7979e8974cee9f57c816679a12d7" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45197 } } peers { permanent_uuid: "d611193d473449c4a91011b3b4e2f8a8" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 40517 } } peers { permanent_uuid: "1828ce4a28d049b4bc02db858d7e3918" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40425 } }
I20260807 04:19:09.572141 21946 heartbeater.cc:503] Master 127.7.200.254:44325 was elected leader, sending a full tablet report...
I20260807 04:19:09.572824 22276 ts_tablet_manager.cc:1428] T 6035fb877230470cbb7f1c504a030ee8 P 1828ce4a28d049b4bc02db858d7e3918: Time spent starting tablet: real 0.015s user 0.013s sys 0.002s
W20260807 04:19:09.615942 22245 tablet.cc:2369] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:19:09.691679 22279 raft_consensus.cc:482] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:19:09.692010 22279 raft_consensus.cc:504] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6abc7979e8974cee9f57c816679a12d7" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45197 } } peers { permanent_uuid: "d611193d473449c4a91011b3b4e2f8a8" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 40517 } } peers { permanent_uuid: "1828ce4a28d049b4bc02db858d7e3918" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40425 } }
I20260807 04:19:09.694067 22279 leader_election.cc:288] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6abc7979e8974cee9f57c816679a12d7 (127.7.200.194:45197), 1828ce4a28d049b4bc02db858d7e3918 (127.7.200.193:40425)
I20260807 04:19:09.701131 22247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:09.694388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:40425 (local address 127.7.200.195:57109)
0807 04:19:09.694688 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:09.694709 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:09.694830 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:09.695755 (+ 925us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:09.695760 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:09.695791 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:19:09.696043 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:09.696055 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.697499 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.697505 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:09.699173 (+ 1668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:09.699191 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.700405 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.700411 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:09.700593 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:09.700626 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 04:19:09.700715 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 04:19:09.700867 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159}
I20260807 04:19:09.701206 22273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:09.694951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:57109 (local address 127.7.200.193:40425)
0807 04:19:09.695291 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:09.695300 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:09.695324 (+ 24us) server_negotiation.cc:407] Connection header received
0807 04:19:09.695418 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:09.695427 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:09.695518 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:09.695613 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:19:09.696209 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.697333 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.699359 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.700248 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.700435 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:09.700515 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:09.700792 (+ 277us) server_negotiation.cc:299] Negotiation successful
0807 04:19:09.700940 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149}
I20260807 04:19:09.702587 22270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:09.695197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:53383 (local address 127.7.200.194:45197)
0807 04:19:09.695387 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:09.695393 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:09.695881 (+ 488us) server_negotiation.cc:407] Connection header received
0807 04:19:09.696111 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:09.696118 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:09.696210 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:09.696316 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:19:09.696891 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.697694 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.700362 (+ 2668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.701646 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.701801 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:09.701878 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:09.702193 (+ 315us) server_negotiation.cc:299] Negotiation successful
0807 04:19:09.702327 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 04:19:09.702656 22283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:09.694446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:45197 (local address 127.7.200.195:53383)
0807 04:19:09.695765 (+ 1319us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:09.695782 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:09.695943 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:09.696330 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:09.696335 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:09.696357 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:19:09.696685 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:09.696693 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.697869 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.697875 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:09.700200 (+ 2325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:09.700214 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.701845 (+ 1631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.701851 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:09.702014 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:09.702044 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 04:19:09.702138 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 04:19:09.702262 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1209,"mutex_wait_us":67,"spinlock_wait_cycles":23424,"thread_start_us":1016,"threads_started":1}
I20260807 04:19:09.702450 21900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6035fb877230470cbb7f1c504a030ee8" candidate_uuid: "d611193d473449c4a91011b3b4e2f8a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1828ce4a28d049b4bc02db858d7e3918" is_pre_election: true
I20260807 04:19:09.703105 21900 raft_consensus.cc:2454] T 6035fb877230470cbb7f1c504a030ee8 P 1828ce4a28d049b4bc02db858d7e3918 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d611193d473449c4a91011b3b4e2f8a8 in term 0.
I20260807 04:19:09.703851 22127 leader_election.cc:302] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1828ce4a28d049b4bc02db858d7e3918, d611193d473449c4a91011b3b4e2f8a8; no voters:
I20260807 04:19:09.704257 22279 raft_consensus.cc:2781] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:19:09.704417 22279 raft_consensus.cc:482] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:19:09.704514 22279 raft_consensus.cc:3037] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:19:09.704417 22053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6035fb877230470cbb7f1c504a030ee8" candidate_uuid: "d611193d473449c4a91011b3b4e2f8a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6abc7979e8974cee9f57c816679a12d7" is_pre_election: true
I20260807 04:19:09.704996 22053 raft_consensus.cc:2454] T 6035fb877230470cbb7f1c504a030ee8 P 6abc7979e8974cee9f57c816679a12d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d611193d473449c4a91011b3b4e2f8a8 in term 0.
I20260807 04:19:09.707134 22279 raft_consensus.cc:504] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6abc7979e8974cee9f57c816679a12d7" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45197 } } peers { permanent_uuid: "d611193d473449c4a91011b3b4e2f8a8" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 40517 } } peers { permanent_uuid: "1828ce4a28d049b4bc02db858d7e3918" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40425 } }
I20260807 04:19:09.707837 22279 leader_election.cc:288] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8 [CANDIDATE]: Term 1 election: Requested vote from peers 6abc7979e8974cee9f57c816679a12d7 (127.7.200.194:45197), 1828ce4a28d049b4bc02db858d7e3918 (127.7.200.193:40425)
I20260807 04:19:09.708240 22053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6035fb877230470cbb7f1c504a030ee8" candidate_uuid: "d611193d473449c4a91011b3b4e2f8a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6abc7979e8974cee9f57c816679a12d7"
I20260807 04:19:09.708359 21900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6035fb877230470cbb7f1c504a030ee8" candidate_uuid: "d611193d473449c4a91011b3b4e2f8a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1828ce4a28d049b4bc02db858d7e3918"
I20260807 04:19:09.708443 22053 raft_consensus.cc:3037] T 6035fb877230470cbb7f1c504a030ee8 P 6abc7979e8974cee9f57c816679a12d7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:19:09.708596 21900 raft_consensus.cc:3037] T 6035fb877230470cbb7f1c504a030ee8 P 1828ce4a28d049b4bc02db858d7e3918 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:19:09.711859 21900 raft_consensus.cc:2454] T 6035fb877230470cbb7f1c504a030ee8 P 1828ce4a28d049b4bc02db858d7e3918 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d611193d473449c4a91011b3b4e2f8a8 in term 1.
I20260807 04:19:09.711860 22053 raft_consensus.cc:2454] T 6035fb877230470cbb7f1c504a030ee8 P 6abc7979e8974cee9f57c816679a12d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d611193d473449c4a91011b3b4e2f8a8 in term 1.
I20260807 04:19:09.712316 22128 leader_election.cc:302] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6abc7979e8974cee9f57c816679a12d7, d611193d473449c4a91011b3b4e2f8a8; no voters:
I20260807 04:19:09.712628 22279 raft_consensus.cc:2781] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:19:09.713255 22279 raft_consensus.cc:686] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8 [term 1 LEADER]: Becoming Leader. State: Replica: d611193d473449c4a91011b3b4e2f8a8, State: Running, Role: LEADER
I20260807 04:19:09.714100 22279 consensus_queue.cc:237] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6abc7979e8974cee9f57c816679a12d7" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45197 } } peers { permanent_uuid: "d611193d473449c4a91011b3b4e2f8a8" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 40517 } } peers { permanent_uuid: "1828ce4a28d049b4bc02db858d7e3918" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40425 } }
I20260807 04:19:09.720019 21741 catalog_manager.cc:5495] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to d611193d473449c4a91011b3b4e2f8a8 (127.7.200.195). New cstate: current_term: 1 leader_uuid: "d611193d473449c4a91011b3b4e2f8a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6abc7979e8974cee9f57c816679a12d7" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d611193d473449c4a91011b3b4e2f8a8" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 40517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1828ce4a28d049b4bc02db858d7e3918" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40425 } health_report { overall_health: UNKNOWN } } }
I20260807 04:19:09.761195 22271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:09.755491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39010 (local address 127.7.200.195:40517)
0807 04:19:09.755684 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:09.755688 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:09.755706 (+ 18us) server_negotiation.cc:407] Connection header received
0807 04:19:09.755818 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:09.755822 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:09.755911 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:09.756039 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:19:09.756479 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.757349 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.758992 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.759383 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.759491 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:09.760037 (+ 546us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:19:09.760582 (+ 545us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:19:09.760693 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:09.760918 (+ 225us) server_negotiation.cc:299] Negotiation successful
0807 04:19:09.760995 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 04:19:09.770169 22053 raft_consensus.cc:1261] T 6035fb877230470cbb7f1c504a030ee8 P 6abc7979e8974cee9f57c816679a12d7 [term 1 FOLLOWER]: Refusing update from remote peer d611193d473449c4a91011b3b4e2f8a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:19:09.770337 21900 raft_consensus.cc:1261] T 6035fb877230470cbb7f1c504a030ee8 P 1828ce4a28d049b4bc02db858d7e3918 [term 1 FOLLOWER]: Refusing update from remote peer d611193d473449c4a91011b3b4e2f8a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:19:09.771457 22284 consensus_queue.cc:1035] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6abc7979e8974cee9f57c816679a12d7" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:19:09.771901 22279 consensus_queue.cc:1035] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1828ce4a28d049b4bc02db858d7e3918" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 40425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:19:09.811867 21742 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55182:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:19:09.812187 21742 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55182:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:19:09.816352 21742 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 814bce1e0fca4a90b8968a4377ed015e: Sending DeleteTablet for 3 replicas of tablet 6035fb877230470cbb7f1c504a030ee8
I20260807 04:19:09.817658 22178 tablet_service.cc:1514] Processing DeleteTablet for tablet 6035fb877230470cbb7f1c504a030ee8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:19:09 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:39000
I20260807 04:19:09.817978 22032 tablet_service.cc:1514] Processing DeleteTablet for tablet 6035fb877230470cbb7f1c504a030ee8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:19:09 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:38588
I20260807 04:19:09.820822 21879 tablet_service.cc:1514] Processing DeleteTablet for tablet 6035fb877230470cbb7f1c504a030ee8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:19:09 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:50414
I20260807 04:19:09.822170 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 21779
I20260807 04:19:09.834483 22299 tablet_replica.cc:330] T 6035fb877230470cbb7f1c504a030ee8 P 6abc7979e8974cee9f57c816679a12d7: stopping tablet replica
I20260807 04:19:09.840997 22299 raft_consensus.cc:2229] T 6035fb877230470cbb7f1c504a030ee8 P 6abc7979e8974cee9f57c816679a12d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:19:09.844522 22273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:09.823786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50418 (local address 127.7.200.193:40425)
0807 04:19:09.824028 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:09.824037 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:09.824099 (+ 62us) server_negotiation.cc:407] Connection header received
0807 04:19:09.824336 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:09.824345 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:09.824468 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:09.824602 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:09.826700 (+ 2098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.828286 (+ 1586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.830442 (+ 2156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.831406 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.831584 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:09.834872 (+ 3288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:09.834894 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:09.834922 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:09.834978 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:09.840329 (+ 5351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:09.841464 (+ 1135us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:09.841477 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:09.841484 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:09.841735 (+ 251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:09.842214 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:09.842223 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:09.842228 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:09.842860 (+ 632us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:09.843306 (+ 446us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:09.843563 (+ 257us) server_negotiation.cc:299] Negotiation successful
0807 04:19:09.843924 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 04:19:09.845871 21940 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:19:09.849647 22298 tablet_replica.cc:330] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8: stopping tablet replica
I20260807 04:19:09.850349 22298 raft_consensus.cc:2229] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8 [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:19:09.851243 22298 raft_consensus.cc:2258] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:19:09.852097 22299 raft_consensus.cc:2258] T 6035fb877230470cbb7f1c504a030ee8 P 6abc7979e8974cee9f57c816679a12d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:19:09.853714 22298 ts_tablet_manager.cc:1905] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:19:09.855747 22299 ts_tablet_manager.cc:1905] T 6035fb877230470cbb7f1c504a030ee8 P 6abc7979e8974cee9f57c816679a12d7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:19:09.861805 22298 ts_tablet_manager.cc:1918] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:19:09.862083 22298 log.cc:1196] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-2/wal/wals/6035fb877230470cbb7f1c504a030ee8
I20260807 04:19:09.862736 22298 ts_tablet_manager.cc:1939] T 6035fb877230470cbb7f1c504a030ee8 P d611193d473449c4a91011b3b4e2f8a8: Deleting consensus metadata
I20260807 04:19:09.865023 21727 catalog_manager.cc:4841] TS d611193d473449c4a91011b3b4e2f8a8 (127.7.200.195:40517): tablet 6035fb877230470cbb7f1c504a030ee8 (table test-table [id=046748c876244eea94764318ac558dd6]) successfully deleted
I20260807 04:19:09.870194 22299 ts_tablet_manager.cc:1918] T 6035fb877230470cbb7f1c504a030ee8 P 6abc7979e8974cee9f57c816679a12d7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:19:09.870440 22299 log.cc:1196] T 6035fb877230470cbb7f1c504a030ee8 P 6abc7979e8974cee9f57c816679a12d7: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786076137270840-7971-0/minicluster-data/ts-1/wal/wals/6035fb877230470cbb7f1c504a030ee8
I20260807 04:19:09.871078 22299 ts_tablet_manager.cc:1939] T 6035fb877230470cbb7f1c504a030ee8 P 6abc7979e8974cee9f57c816679a12d7: Deleting consensus metadata
I20260807 04:19:09.873755 21725 catalog_manager.cc:4841] TS 6abc7979e8974cee9f57c816679a12d7 (127.7.200.194:45197): tablet 6035fb877230470cbb7f1c504a030ee8 (table test-table [id=046748c876244eea94764318ac558dd6]) successfully deleted
I20260807 04:19:09.957805 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 21779
I20260807 04:19:09.957876 22300 tablet_replica.cc:330] T 6035fb877230470cbb7f1c504a030ee8 P 1828ce4a28d049b4bc02db858d7e3918: stopping tablet replica
W20260807 04:19:09.982959 21724 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.200.193:40425 (error 108)
I20260807 04:19:09.983520 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 21950
I20260807 04:19:09.984990 22268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:09.984346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:40425 (local address 127.0.0.1:50428)
0807 04:19:09.984623 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:09.984793 (+ 170us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:40425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147}
W20260807 04:19:09.985266 21724 catalog_manager.cc:4584] TS 1828ce4a28d049b4bc02db858d7e3918 (127.7.200.193:40425): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6035fb877230470cbb7f1c504a030ee8: Network error: Client connection negotiation failed: client connection to 127.7.200.193:40425: connect: Connection refused (error 111)
I20260807 04:19:10.000078 22270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:09.984428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38598 (local address 127.7.200.194:45197)
0807 04:19:09.984621 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:09.984627 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:09.984781 (+ 154us) server_negotiation.cc:407] Connection header received
0807 04:19:09.984979 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:09.984986 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:09.985117 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:09.985251 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:09.986811 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.987935 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.989481 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:09.990169 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:09.990320 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:09.993000 (+ 2680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:09.993020 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:09.993043 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:09.993100 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:09.997044 (+ 3944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:09.997823 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:09.997832 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:09.997837 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:09.997994 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:09.998363 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:09.998368 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:09.998371 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:09.998829 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:09.999124 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:09.999418 (+ 294us) server_negotiation.cc:299] Negotiation successful
0807 04:19:09.999650 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 04:19:10.000993 22096 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:19:10.039016 22268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:10.038444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:40425 (local address 127.0.0.1:50430)
0807 04:19:10.038721 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:10.038828 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:40425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153}
I20260807 04:19:10.040270 22268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:10.039843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:40425 (local address 127.0.0.1:50444)
0807 04:19:10.040040 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:10.040128 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:40425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260807 04:19:10.101248 22268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:10.100649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:40425 (local address 127.0.0.1:50456)
0807 04:19:10.100926 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:10.101038 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:40425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260807 04:19:10.102536 22268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:10.102100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:40425 (local address 127.0.0.1:50464)
0807 04:19:10.102288 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:10.102386 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:40425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260807 04:19:10.112397 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 21950
I20260807 04:19:10.133831 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 22106
I20260807 04:19:10.154513 22271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:10.134920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39020 (local address 127.7.200.195:40517)
0807 04:19:10.135153 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:10.135161 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:10.135180 (+ 19us) server_negotiation.cc:407] Connection header received
0807 04:19:10.135251 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:10.135256 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:10.135344 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:10.135487 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:10.136907 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:10.137746 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:10.139183 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:10.139690 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:10.139865 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:10.147481 (+ 7616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:10.147492 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:10.147508 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:10.147571 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:10.151204 (+ 3633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:10.152111 (+ 907us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:10.152119 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:10.152122 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:10.152273 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:10.152691 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:10.152697 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:10.152702 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:10.153147 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:10.153537 (+ 390us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:10.153846 (+ 309us) server_negotiation.cc:299] Negotiation successful
0807 04:19:10.154092 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260807 04:19:10.155366 22239 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:19:10.183316 22268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:10.182784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:40425 (local address 127.0.0.1:50472)
0807 04:19:10.182995 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:10.183122 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:40425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260807 04:19:10.184470 22268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:10.184103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:40425 (local address 127.0.0.1:50476)
0807 04:19:10.184295 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:10.184367 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:40425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260807 04:19:10.281555 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 22106
I20260807 04:19:10.301355 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 21704
I20260807 04:19:10.302652 21772 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:19:10.421481 22268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:10.420574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:40425 (local address 127.0.0.1:50486)
0807 04:19:10.420852 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:10.420979 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:40425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260807 04:19:10.421571 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 21704
I20260807 04:19:10.447353 7971 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 04:19:10.793519 7971 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 04:19:10.793769 7971 mini_ranger.cc:66] Stopping Ranger...
I20260807 04:19:11.139835 7971 mini_ranger.cc:68] Stopped Ranger
2026-08-07 04:19:11.140 UTC [20719] LOG: received smart shutdown request
2026-08-07 04:19:11.144 UTC [20719] LOG: background worker "logical replication launcher" (PID 20728) exited with exit code 1
2026-08-07 04:19:11.144 UTC [20723] LOG: shutting down
2026-08-07 04:19:11.323 UTC [20719] LOG: database system is shut down
2026-08-07T04:19:11Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (56062 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:19:11 dist-test-slave-qg60 krb5kdc[22315](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:19:11 dist-test-slave-qg60 krb5kdc[22315](info): set up 2 sockets
Aug 07 04:19:11 dist-test-slave-qg60 krb5kdc[22315](info): commencing operation
krb5kdc: starting...
W20260807 04:19:12.714726 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.192s user 0.000s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:19:12 dist-test-slave-qg60 krb5kdc[22315](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076352, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:19:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:19:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
I20260807 04:19:13.020861 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:40555
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:34263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:40555,127.7.200.253:44053,127.7.200.252:43775
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:19:13.375607 22329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:19:13.375916 22329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:19:13.376009 22329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:19:13.383405 22329 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:19:13.383523 22329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:19:13.383579 22329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:19:13.383635 22329 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:19:13.383682 22329 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:19:13.393868 22329 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:34263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:40555,127.7.200.253:44053,127.7.200.252:43775
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:40555
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:19:13.395220 22329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:19:13.396492 22329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:19:13.409154 22334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:13.409169 22337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:13.409401 22335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:13.410240 22329 server_base.cc:1034] running on GCE node
I20260807 04:19:13.411063 22329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:19:13.412532 22329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:19:13.413791 22329 hybrid_clock.cc:648] HybridClock initialized: now 1786076353413748 us; error 58 us; skew 500 ppm
I20260807 04:19:13.414170 22329 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:19:13 dist-test-slave-qg60 krb5kdc[22315](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076353, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:19:13.417474 22329 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:19:13.419025 22329 webserver.cc:460] Webserver started at http://127.7.200.254:43827/ using document root <none> and password file <none>
I20260807 04:19:13.419705 22329 fs_manager.cc:359] Metadata directory not provided
I20260807 04:19:13.419811 22329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:19:13.420056 22329 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:19:13.423324 22329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "d0f2cad84db340239f24e024de759156"
format_stamp: "Formatted at 2026-08-07 04:19:13 on dist-test-slave-qg60"
server_key: "1030f540d3a16d905f5004565adaa195"
server_key_iv: "155bd318456097e0a921183195fa4f78"
server_key_version: "encryptionkey@0"
I20260807 04:19:13.424484 22329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "d0f2cad84db340239f24e024de759156"
format_stamp: "Formatted at 2026-08-07 04:19:13 on dist-test-slave-qg60"
server_key: "1030f540d3a16d905f5004565adaa195"
server_key_iv: "155bd318456097e0a921183195fa4f78"
server_key_version: "encryptionkey@0"
I20260807 04:19:13.430090 22329 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260807 04:19:13.433823 22344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:13.435266 22329 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 04:19:13.435458 22329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "d0f2cad84db340239f24e024de759156"
format_stamp: "Formatted at 2026-08-07 04:19:13 on dist-test-slave-qg60"
server_key: "1030f540d3a16d905f5004565adaa195"
server_key_iv: "155bd318456097e0a921183195fa4f78"
server_key_version: "encryptionkey@0"
I20260807 04:19:13.435695 22329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:19:13.459050 22329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:19:13.463469 22329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:19:13.463797 22329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:19:13.484161 22329 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:40555
I20260807 04:19:13.484165 22396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:40555 every 8 connection(s)
I20260807 04:19:13.485826 22329 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:19:13.489821 22397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:19:13.492233 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 22329
I20260807 04:19:13.492535 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:19:13.493319 7971 external_mini_cluster.cc:1428] Setting key 3a1adf6af98b47ba757a2e7c70f08bbf
I20260807 04:19:13.496654 22397 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40555 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 04:19:13 dist-test-slave-qg60 krb5kdc[22315](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076353, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:19:13.520457 22399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:13.499982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48842 (local address 127.7.200.254:40555)
0807 04:19:13.500942 (+ 960us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:13.500958 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:13.501384 (+ 426us) server_negotiation.cc:407] Connection header received
0807 04:19:13.503460 (+ 2076us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:13.503466 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:13.503695 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:13.503917 (+ 222us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:13.505314 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:13.506542 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:13.507943 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:13.508512 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:13.508743 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:13.512814 (+ 4071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:13.512824 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:13.512837 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:13.512874 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:13.515767 (+ 2893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:13.516880 (+ 1113us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:13.516887 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:13.516890 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:13.517054 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:13.517586 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:13.517590 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:13.517592 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:13.518115 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:13.518279 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:13.519043 (+ 764us) server_negotiation.cc:299] Negotiation successful
0807 04:19:13.519348 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":676,"thread_start_us":458,"threads_started":1}
I20260807 04:19:13.520514 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:13.499983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40555 (local address 127.0.0.1:48842)
0807 04:19:13.501216 (+ 1233us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:13.501250 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:13.503053 (+ 1803us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:13.503931 (+ 878us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:13.503938 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:13.504686 (+ 748us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:19:13.505108 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:13.505127 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:13.506715 (+ 1588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:13.506721 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:13.507792 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:13.507805 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:13.508813 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:13.508820 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:13.509022 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:13.509750 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:19:13.509773 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:19:13.512496 (+ 2723us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:19:13.515942 (+ 3446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:13.515959 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:13.515975 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:13.516653 (+ 678us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:13.517192 (+ 539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:13.517199 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:13.517204 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:13.517456 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:13.518279 (+ 823us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:19:13.518291 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:19:13.518602 (+ 311us) client_negotiation.cc:769] Sending connection context
0807 04:19:13.518912 (+ 310us) client_negotiation.cc:240] Negotiation successful
0807 04:19:13.519555 (+ 643us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1014,"mutex_wait_us":70,"spinlock_wait_cycles":48896,"thread_start_us":814,"threads_started":1}
WARNING: no policy specified for kudu/127.7.200.253@KRBTEST.COM; defaulting to no policy
I20260807 04:19:13.523730 22397 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.253" port: 44053 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.253@KRBTEST.COM" created.
I20260807 04:19:13.525071 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:13.524523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:44053 (local address 127.0.0.1:52342)
0807 04:19:13.524799 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:13.524923 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.253:44053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260807 04:19:13.525437 22347 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.200.253:44053: connect: Connection refused (error 111)
I20260807 04:19:13.527343 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:13.526915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:44053 (local address 127.0.0.1:52358)
0807 04:19:13.527098 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:13.527193 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.253:44053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260807 04:19:13.527575 22397 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.253:44053: Network error: Client connection negotiation failed: client connection to 127.7.200.253:44053: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.253.keytab.
Entry for principal kudu/127.7.200.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.253.keytab.
I20260807 04:19:13.561113 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.253:44053
--webserver_interface=127.7.200.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.253.keytab
--principal=kudu/127.7.200.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:34263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:40555,127.7.200.253:44053,127.7.200.252:43775
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 04:19:13.576990 22397 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.253" port: 44053 } attempt: 1
I20260807 04:19:13.578471 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:13.577828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:44053 (local address 127.0.0.1:52366)
0807 04:19:13.578087 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:13.578263 (+ 176us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.253:44053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260807 04:19:13.579663 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:13.579194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:44053 (local address 127.0.0.1:52382)
0807 04:19:13.579370 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:13.579464 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.253:44053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260807 04:19:13.579886 22397 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.253:44053: Network error: Client connection negotiation failed: client connection to 127.7.200.253:44053: connect: Connection refused (error 111)
I20260807 04:19:13.648188 22397 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.253" port: 44053 } attempt: 2
I20260807 04:19:13.649614 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:13.649018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:44053 (local address 127.0.0.1:52394)
0807 04:19:13.649301 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:13.649427 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.253:44053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260807 04:19:13.650851 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:13.650399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:44053 (local address 127.0.0.1:52398)
0807 04:19:13.650590 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:13.650682 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.253:44053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260807 04:19:13.651162 22397 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.253:44053: Network error: Client connection negotiation failed: client connection to 127.7.200.253:44053: connect: Connection refused (error 111)
I20260807 04:19:13.742491 22397 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.253" port: 44053 } attempt: 3
I20260807 04:19:13.743992 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:13.743324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:44053 (local address 127.0.0.1:52406)
0807 04:19:13.743628 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:13.743772 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.253:44053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260807 04:19:13.745455 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:13.744949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:44053 (local address 127.0.0.1:52414)
0807 04:19:13.745150 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:13.745277 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.253:44053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260807 04:19:13.745774 22397 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.253:44053: Network error: Client connection negotiation failed: client connection to 127.7.200.253:44053: connect: Connection refused (error 111)
I20260807 04:19:13.889110 22397 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.253" port: 44053 } attempt: 4
I20260807 04:19:13.890465 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:13.889785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:44053 (local address 127.0.0.1:52424)
0807 04:19:13.890155 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:13.890282 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.253:44053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189}
I20260807 04:19:13.891541 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:13.891194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:44053 (local address 127.0.0.1:52440)
0807 04:19:13.891336 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:13.891422 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.253:44053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260807 04:19:13.891834 22397 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.253:44053: Network error: Client connection negotiation failed: client connection to 127.7.200.253:44053: connect: Connection refused (error 111)
W20260807 04:19:13.907375 22405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:19:13.907673 22405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:19:13.907836 22405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:19:13.915417 22405 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:19:13.915540 22405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:19:13.915633 22405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:19:13.915724 22405 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:19:13.915832 22405 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:19:13.926219 22405 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:34263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:40555,127.7.200.253:44053,127.7.200.252:43775
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.253.keytab
--principal=kudu/127.7.200.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.253:44053
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.200.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:19:13.927660 22405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:19:13.929086 22405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:19:13.941762 22410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:13.941960 22411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:13.942355 22414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:13.943207 22405 server_base.cc:1034] running on GCE node
I20260807 04:19:13.944002 22405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:19:13.945547 22405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:19:13.946761 22405 hybrid_clock.cc:648] HybridClock initialized: now 1786076353946718 us; error 36 us; skew 500 ppm
I20260807 04:19:13.947156 22405 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:19:13 dist-test-slave-qg60 krb5kdc[22315](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076353, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:19:13.950479 22405 init.cc:377] Logged in from keytab as kudu/127.7.200.253@KRBTEST.COM (short username kudu)
I20260807 04:19:13.952131 22405 webserver.cc:460] Webserver started at http://127.7.200.253:40613/ using document root <none> and password file <none>
I20260807 04:19:13.952946 22405 fs_manager.cc:359] Metadata directory not provided
I20260807 04:19:13.953105 22405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:19:13.953430 22405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:19:13.956542 22405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-1/data/instance:
uuid: "a063552cb9714d6599caa44b2cf2a892"
format_stamp: "Formatted at 2026-08-07 04:19:13 on dist-test-slave-qg60"
server_key: "0375ab9f3f196556d915cb34b745b17f"
server_key_iv: "901bd6e79a7990a87bb5bc29314d624b"
server_key_version: "encryptionkey@0"
I20260807 04:19:13.957500 22405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-1/wal/instance:
uuid: "a063552cb9714d6599caa44b2cf2a892"
format_stamp: "Formatted at 2026-08-07 04:19:13 on dist-test-slave-qg60"
server_key: "0375ab9f3f196556d915cb34b745b17f"
server_key_iv: "901bd6e79a7990a87bb5bc29314d624b"
server_key_version: "encryptionkey@0"
I20260807 04:19:13.963071 22405 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 04:19:13.966743 22421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:13.968192 22405 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 04:19:13.968398 22405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-1/wal
uuid: "a063552cb9714d6599caa44b2cf2a892"
format_stamp: "Formatted at 2026-08-07 04:19:13 on dist-test-slave-qg60"
server_key: "0375ab9f3f196556d915cb34b745b17f"
server_key_iv: "901bd6e79a7990a87bb5bc29314d624b"
server_key_version: "encryptionkey@0"
I20260807 04:19:13.968609 22405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:19:13.990024 22405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:19:13.994674 22405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:19:13.994998 22405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:19:14.014820 22405 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.253:44053
I20260807 04:19:14.014854 22475 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.253:44053 every 8 connection(s)
I20260807 04:19:14.016263 22405 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-1/data/info.pb
I20260807 04:19:14.020008 22476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:19:14.021903 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 22405
I20260807 04:19:14.022111 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-1/wal/instance
I20260807 04:19:14.022600 7971 external_mini_cluster.cc:1428] Setting key 295f81b515334f7cf33fe11e9d6f9b55
I20260807 04:19:14.026998 22476 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40555 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 04:19:14 dist-test-slave-qg60 krb5kdc[22315](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076353, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.253@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:19:14.048238 22478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.029744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48852 (local address 127.7.200.254:40555)
0807 04:19:14.030237 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:14.030242 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:14.031401 (+ 1159us) server_negotiation.cc:407] Connection header received
0807 04:19:14.033382 (+ 1981us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:14.033388 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:14.033480 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:14.033615 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:14.035145 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.035916 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.037611 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.038020 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.038167 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:14.042108 (+ 3941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:14.042113 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:14.042116 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:14.042161 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:14.045002 (+ 2841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:14.045778 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:14.045788 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:14.045791 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:14.045912 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:14.046369 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:14.046378 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:14.046381 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:14.046684 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:14.046879 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:14.047618 (+ 739us) server_negotiation.cc:299] Negotiation successful
0807 04:19:14.047849 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":292,"threads_started":1}
WARNING: no policy specified for kudu/127.7.200.252@KRBTEST.COM; defaulting to no policy
I20260807 04:19:14.049309 22479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.030356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40555 (local address 127.0.0.1:48852)
0807 04:19:14.031230 (+ 874us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:14.031275 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:14.033106 (+ 1831us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:14.033865 (+ 759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:14.033874 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:14.034402 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:19:14.034953 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:14.034970 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.036138 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.036143 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:14.037435 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:14.037447 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.038256 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.038263 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:14.038487 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:14.039287 (+ 800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:19:14.039310 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:19:14.041863 (+ 2553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:19:14.045165 (+ 3302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:14.045175 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:14.045193 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:14.045641 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:14.046032 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:14.046037 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:14.046041 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:14.046241 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:14.046850 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:19:14.046857 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:19:14.047232 (+ 375us) client_negotiation.cc:769] Sending connection context
0807 04:19:14.047506 (+ 274us) client_negotiation.cc:240] Negotiation successful
0807 04:19:14.048037 (+ 531us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":630,"thread_start_us":379,"threads_started":1}
I20260807 04:19:14.051122 22476 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.253" port: 44053 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.252@KRBTEST.COM" created.
Aug 07 04:19:14 dist-test-slave-qg60 krb5kdc[22315](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076353, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.253@KRBTEST.COM for kudu/127.7.200.253@KRBTEST.COM
I20260807 04:19:14.068609 22481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.052455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52446 (local address 127.7.200.253:44053)
0807 04:19:14.053279 (+ 824us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:14.053285 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:14.053310 (+ 25us) server_negotiation.cc:407] Connection header received
0807 04:19:14.053351 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:14.053357 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:14.053536 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:14.053684 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:14.054733 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.055808 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.057661 (+ 1853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.058224 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.058324 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:14.062139 (+ 3815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:14.062157 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:14.062177 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:14.062225 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:14.065487 (+ 3262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:14.066349 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:14.066356 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:14.066358 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:14.066520 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:14.066962 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:14.066965 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:14.066967 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:14.067320 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:14.067499 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:14.067948 (+ 449us) server_negotiation.cc:299] Negotiation successful
0807 04:19:14.068280 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":118,"server-negotiator.queue_time_us":676,"thread_start_us":519,"threads_started":1}
I20260807 04:19:14.068645 22479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.052213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:44053 (local address 127.0.0.1:52446)
0807 04:19:14.052455 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:14.052475 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:14.052599 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:14.053750 (+ 1151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:14.053758 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:14.054293 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:19:14.054541 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:14.054557 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.055965 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.055973 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:14.057508 (+ 1535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:14.057528 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.058401 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.058412 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:14.058665 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:14.059327 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:19:14.059354 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:19:14.061912 (+ 2558us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:19:14.065620 (+ 3708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:14.065628 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:14.065635 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:14.066208 (+ 573us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:14.066639 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:14.066646 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:14.066652 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:14.066851 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:14.067464 (+ 613us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:19:14.067471 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:19:14.067639 (+ 168us) client_negotiation.cc:769] Sending connection context
0807 04:19:14.067800 (+ 161us) client_negotiation.cc:240] Negotiation successful
0807 04:19:14.068151 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260807 04:19:14.071544 22476 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } has no permanent_uuid. Determining permanent_uuid...
I20260807 04:19:14.072825 22479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.072262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:43775 (local address 127.0.0.1:44228)
0807 04:19:14.072485 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:14.072620 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:43775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260807 04:19:14.073071 22422 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.200.252:43775: connect: Connection refused (error 111)
I20260807 04:19:14.074738 22479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.074395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:43775 (local address 127.0.0.1:44244)
0807 04:19:14.074554 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:14.074634 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:43775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260807 04:19:14.074975 22476 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.252:43775: Network error: Client connection negotiation failed: client connection to 127.7.200.252:43775: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.252.keytab.
Entry for principal kudu/127.7.200.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.252.keytab.
I20260807 04:19:14.090116 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.252:43775
--webserver_interface=127.7.200.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.252.keytab
--principal=kudu/127.7.200.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:34263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:40555,127.7.200.253:44053,127.7.200.252:43775
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 04:19:14.124302 22476 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } attempt: 1
I20260807 04:19:14.125605 22479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.125117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:43775 (local address 127.0.0.1:44258)
0807 04:19:14.125319 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:14.125429 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:43775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260807 04:19:14.126668 22479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.126306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:43775 (local address 127.0.0.1:44272)
0807 04:19:14.126480 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:14.126549 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:43775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260807 04:19:14.126873 22476 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.252:43775: Network error: Client connection negotiation failed: client connection to 127.7.200.252:43775: connect: Connection refused (error 111)
I20260807 04:19:14.191123 22397 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.253" port: 44053 } attempt: 5
I20260807 04:19:14.195119 22476 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } attempt: 2
I20260807 04:19:14.196308 22479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.195753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:43775 (local address 127.0.0.1:44286)
0807 04:19:14.195980 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:14.196096 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:43775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260807 04:19:14.197558 22479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.197090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:43775 (local address 127.0.0.1:44294)
0807 04:19:14.197255 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:14.197342 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:43775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260807 04:19:14.197903 22476 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.252:43775: Network error: Client connection negotiation failed: client connection to 127.7.200.252:43775: connect: Connection refused (error 111)
Aug 07 04:19:14 dist-test-slave-qg60 krb5kdc[22315](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076353, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for kudu/127.7.200.253@KRBTEST.COM
I20260807 04:19:14.207114 22481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.192152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52458 (local address 127.7.200.253:44053)
0807 04:19:14.192357 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:14.192363 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:14.192388 (+ 25us) server_negotiation.cc:407] Connection header received
0807 04:19:14.192549 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:14.192555 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:14.192647 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:14.192785 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:14.193542 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.194639 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.196620 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.197455 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.197627 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:14.201430 (+ 3803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:14.201436 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:14.201439 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:14.201475 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:14.204305 (+ 2830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:14.205109 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:14.205115 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:14.205118 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:14.205251 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:14.205666 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:14.205672 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:14.205675 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:14.205973 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:14.206147 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:14.206537 (+ 390us) server_negotiation.cc:299] Negotiation successful
0807 04:19:14.206765 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 04:19:14.207111 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.191992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:44053 (local address 127.0.0.1:52458)
0807 04:19:14.192246 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:14.192273 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:14.192381 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:14.192829 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:14.192832 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:14.193207 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:19:14.193383 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:14.193392 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.194834 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.194839 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:14.196377 (+ 1538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:14.196397 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.197638 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.197645 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:14.197868 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:14.198598 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:19:14.198621 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:19:14.201206 (+ 2585us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:19:14.204478 (+ 3272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:14.204484 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:14.204488 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:14.204978 (+ 490us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:14.205375 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:14.205380 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:14.205383 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:14.205539 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:14.206107 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:19:14.206112 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:19:14.206264 (+ 152us) client_negotiation.cc:769] Sending connection context
0807 04:19:14.206417 (+ 153us) client_negotiation.cc:240] Negotiation successful
0807 04:19:14.206759 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97}
I20260807 04:19:14.208518 22397 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } has no permanent_uuid. Determining permanent_uuid...
I20260807 04:19:14.209625 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.209234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:43775 (local address 127.0.0.1:44302)
0807 04:19:14.209401 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:14.209478 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:43775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260807 04:19:14.210530 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.210216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:43775 (local address 127.0.0.1:44316)
0807 04:19:14.210377 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:14.210441 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:43775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 04:19:14.210768 22397 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.252:43775: Network error: Client connection negotiation failed: client connection to 127.7.200.252:43775: connect: Connection refused (error 111)
I20260807 04:19:14.262036 22397 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } attempt: 1
I20260807 04:19:14.263424 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.262814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:43775 (local address 127.0.0.1:44318)
0807 04:19:14.263080 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:14.263200 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:43775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260807 04:19:14.264608 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.264181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:43775 (local address 127.0.0.1:44320)
0807 04:19:14.264358 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:14.264461 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:43775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260807 04:19:14.264899 22397 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.252:43775: Network error: Client connection negotiation failed: client connection to 127.7.200.252:43775: connect: Connection refused (error 111)
I20260807 04:19:14.289186 22476 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } attempt: 3
I20260807 04:19:14.290588 22479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.290017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:43775 (local address 127.0.0.1:44328)
0807 04:19:14.290316 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:14.290419 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:43775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
I20260807 04:19:14.291764 22479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.291341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:43775 (local address 127.0.0.1:44336)
0807 04:19:14.291588 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:14.291657 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:43775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156}
W20260807 04:19:14.292024 22476 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.252:43775: Network error: Client connection negotiation failed: client connection to 127.7.200.252:43775: connect: Connection refused (error 111)
I20260807 04:19:14.333209 22397 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } attempt: 2
I20260807 04:19:14.334635 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.333928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:43775 (local address 127.0.0.1:44346)
0807 04:19:14.334221 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:14.334358 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:43775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260807 04:19:14.335978 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.335549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:43775 (local address 127.0.0.1:44356)
0807 04:19:14.335730 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:14.335823 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:43775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260807 04:19:14.336243 22397 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.252:43775: Network error: Client connection negotiation failed: client connection to 127.7.200.252:43775: connect: Connection refused (error 111)
I20260807 04:19:14.435278 22476 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } attempt: 4
I20260807 04:19:14.436604 22479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.436086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:43775 (local address 127.0.0.1:44370)
0807 04:19:14.436330 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:14.436421 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:43775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260807 04:19:14.437777 22479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.437443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:43775 (local address 127.0.0.1:44376)
0807 04:19:14.437595 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:14.437668 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:43775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260807 04:19:14.438140 22476 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.252:43775: Network error: Client connection negotiation failed: client connection to 127.7.200.252:43775: connect: Connection refused (error 111)
I20260807 04:19:14.442489 22397 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } attempt: 3
I20260807 04:19:14.443655 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.443085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:43775 (local address 127.0.0.1:44378)
0807 04:19:14.443321 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:14.443434 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:43775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260807 04:19:14.445060 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.444526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:43775 (local address 127.0.0.1:44392)
0807 04:19:14.444805 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:14.444932 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:43775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
W20260807 04:19:14.445590 22397 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.252:43775: Network error: Client connection negotiation failed: client connection to 127.7.200.252:43775: connect: Connection refused (error 111)
W20260807 04:19:14.468547 22484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:19:14.468911 22484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:19:14.469089 22484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:19:14.476492 22484 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:19:14.476609 22484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:19:14.476753 22484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:19:14.476858 22484 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:19:14.476938 22484 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:19:14.487324 22484 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:34263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:40555,127.7.200.253:44053,127.7.200.252:43775
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.252.keytab
--principal=kudu/127.7.200.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.252:43775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.200.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:19:14.488806 22484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:19:14.490195 22484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:19:14.502738 22489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:14.502656 22490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:14.502709 22492 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:14.504124 22484 server_base.cc:1034] running on GCE node
I20260807 04:19:14.505044 22484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:19:14.506541 22484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:19:14.507763 22484 hybrid_clock.cc:648] HybridClock initialized: now 1786076354507686 us; error 70 us; skew 500 ppm
I20260807 04:19:14.508183 22484 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:19:14 dist-test-slave-qg60 krb5kdc[22315](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076354, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:19:14.511644 22484 init.cc:377] Logged in from keytab as kudu/127.7.200.252@KRBTEST.COM (short username kudu)
I20260807 04:19:14.513314 22484 webserver.cc:460] Webserver started at http://127.7.200.252:37183/ using document root <none> and password file <none>
I20260807 04:19:14.514048 22484 fs_manager.cc:359] Metadata directory not provided
I20260807 04:19:14.514153 22484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:19:14.514427 22484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:19:14.517668 22484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-2/data/instance:
uuid: "f95920b960764999bbf15e0d1f2035db"
format_stamp: "Formatted at 2026-08-07 04:19:14 on dist-test-slave-qg60"
server_key: "16cd176707330f306765ca38c3ac4682"
server_key_iv: "d801e5b3c9dddd0be615b31e3f81ee27"
server_key_version: "encryptionkey@0"
I20260807 04:19:14.518493 22484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-2/wal/instance:
uuid: "f95920b960764999bbf15e0d1f2035db"
format_stamp: "Formatted at 2026-08-07 04:19:14 on dist-test-slave-qg60"
server_key: "16cd176707330f306765ca38c3ac4682"
server_key_iv: "d801e5b3c9dddd0be615b31e3f81ee27"
server_key_version: "encryptionkey@0"
I20260807 04:19:14.524122 22484 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 04:19:14.527812 22499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:14.529523 22484 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:19:14.529773 22484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-2/wal
uuid: "f95920b960764999bbf15e0d1f2035db"
format_stamp: "Formatted at 2026-08-07 04:19:14 on dist-test-slave-qg60"
server_key: "16cd176707330f306765ca38c3ac4682"
server_key_iv: "d801e5b3c9dddd0be615b31e3f81ee27"
server_key_version: "encryptionkey@0"
I20260807 04:19:14.530025 22484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:19:14.554000 22484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:19:14.558866 22484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:19:14.559209 22484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:19:14.579084 22484 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.252:43775
I20260807 04:19:14.579124 22551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.252:43775 every 8 connection(s)
I20260807 04:19:14.580525 22484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-2/data/info.pb
I20260807 04:19:14.584296 22552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:19:14.590533 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 22484
I20260807 04:19:14.590767 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786076137270840-7971-0/minicluster-data/master-2/wal/instance
I20260807 04:19:14.591395 7971 external_mini_cluster.cc:1428] Setting key 3ce73d4d2d19251a4d4fe012e9866ca8
I20260807 04:19:14.591100 22552 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40555 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 04:19:14 dist-test-slave-qg60 krb5kdc[22315](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076354, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.252@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
Aug 07 04:19:14 dist-test-slave-qg60 krb5kdc[22315](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076352, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.252@KRBTEST.COM
I20260807 04:19:14.613173 22556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.594325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48866 (local address 127.7.200.254:40555)
0807 04:19:14.594996 (+ 671us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:14.595003 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:14.595545 (+ 542us) server_negotiation.cc:407] Connection header received
0807 04:19:14.597197 (+ 1652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:14.597202 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:14.597282 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:14.597417 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:14.598814 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.599570 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.601360 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.601989 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.602085 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:14.606240 (+ 4155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:14.606247 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:14.606252 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:14.606310 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:14.609463 (+ 3153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:14.610680 (+ 1217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:14.610684 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:14.610687 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:14.610815 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:14.611308 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:14.611311 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:14.611313 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:14.611580 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:14.611750 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:14.612479 (+ 729us) server_negotiation.cc:299] Negotiation successful
0807 04:19:14.612769 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":513,"thread_start_us":371,"threads_started":1}
I20260807 04:19:14.614441 22557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.594347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:40555 (local address 127.0.0.1:48866)
0807 04:19:14.595349 (+ 1002us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:14.595396 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:14.596923 (+ 1527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:14.597469 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:14.597476 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:14.598240 (+ 764us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:19:14.598630 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:14.598648 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.599743 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.599750 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:14.601220 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:14.601233 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.602249 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.602257 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:14.602470 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:14.603314 (+ 844us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:19:14.603341 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:19:14.606014 (+ 2673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:19:14.609627 (+ 3613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:14.609639 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:14.609651 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:14.610540 (+ 889us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:14.610930 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:14.610936 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:14.610942 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:14.611184 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:14.611727 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:19:14.611735 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:19:14.612108 (+ 373us) client_negotiation.cc:769] Sending connection context
0807 04:19:14.612393 (+ 285us) client_negotiation.cc:240] Negotiation successful
0807 04:19:14.612914 (+ 521us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":758,"thread_start_us":602,"threads_started":1}
I20260807 04:19:14.614744 22555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.593828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44402 (local address 127.7.200.252:43775)
0807 04:19:14.594804 (+ 976us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:14.594821 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:14.594879 (+ 58us) server_negotiation.cc:407] Connection header received
0807 04:19:14.596923 (+ 2044us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:14.596952 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:14.597246 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:14.597459 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:14.598876 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.600308 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.601862 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.602546 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.602704 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:14.607951 (+ 5247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:14.607960 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:14.607972 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:14.608003 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:14.611566 (+ 3563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:14.612319 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:14.612325 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:14.612327 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:14.612456 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:14.612957 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:14.612962 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:14.612964 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:14.613392 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:14.613650 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:14.614087 (+ 437us) server_negotiation.cc:299] Negotiation successful
0807 04:19:14.614273 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":679,"thread_start_us":419,"threads_started":1}
I20260807 04:19:14.616151 22552 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.253" port: 44053 } has no permanent_uuid. Determining permanent_uuid...
I20260807 04:19:14.622861 22397 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } attempt: 4
Aug 07 04:19:14 dist-test-slave-qg60 krb5kdc[22315](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076354, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.252@KRBTEST.COM for kudu/127.7.200.253@KRBTEST.COM
Aug 07 04:19:14 dist-test-slave-qg60 krb5kdc[22315](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076352, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
Aug 07 04:19:14 dist-test-slave-qg60 krb5kdc[22315](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076353, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for kudu/127.7.200.252@KRBTEST.COM
I20260807 04:19:14.633072 22557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.617029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:44053 (local address 127.0.0.1:52462)
0807 04:19:14.617265 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:14.617280 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:14.617357 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:14.618023 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:14.618028 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:14.618477 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:19:14.618628 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:14.618636 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.620094 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.620099 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:14.621335 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:14.621347 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.622316 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.622320 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:14.622473 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:14.623156 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:19:14.623183 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:19:14.626168 (+ 2985us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:19:14.630148 (+ 3980us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:14.630153 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:14.630157 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:14.630692 (+ 535us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:14.631133 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:14.631139 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:14.631145 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:14.631308 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:14.631968 (+ 660us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:19:14.631973 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:19:14.632128 (+ 155us) client_negotiation.cc:769] Sending connection context
0807 04:19:14.632274 (+ 146us) client_negotiation.cc:240] Negotiation successful
0807 04:19:14.632665 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135}
I20260807 04:19:14.633329 22481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.617009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52462 (local address 127.7.200.253:44053)
0807 04:19:14.617539 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:14.617546 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:14.617566 (+ 20us) server_negotiation.cc:407] Connection header received
0807 04:19:14.617628 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:14.617633 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:14.617714 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:14.617819 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:14.618799 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.619949 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.621476 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.622170 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.622313 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:14.626385 (+ 4072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:14.626393 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:14.626399 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:14.626445 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:14.629967 (+ 3522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:14.630847 (+ 880us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:14.630853 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:14.630857 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:14.631017 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:14.631441 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:14.631446 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:14.631449 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:14.631834 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:14.632010 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:14.632612 (+ 602us) server_negotiation.cc:299] Negotiation successful
0807 04:19:14.632881 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377}
I20260807 04:19:14.634827 22552 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } has no permanent_uuid. Determining permanent_uuid...
I20260807 04:19:14.637256 22556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.617723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48874 (local address 127.7.200.254:40555)
0807 04:19:14.617898 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:14.617903 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:14.617920 (+ 17us) server_negotiation.cc:407] Connection header received
0807 04:19:14.618061 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:14.618067 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:14.618156 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:14.618262 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:14.619843 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.620933 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.622678 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.623412 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.623541 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:14.628648 (+ 5107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:14.628655 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:14.628661 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:14.628709 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:14.632933 (+ 4224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:14.633925 (+ 992us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:14.633929 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:14.633932 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:14.634086 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:14.634587 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:14.634595 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:14.634601 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:14.634999 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:14.635282 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:14.636615 (+ 1333us) server_negotiation.cc:299] Negotiation successful
0807 04:19:14.636889 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 04:19:14.640465 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.623598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:43775 (local address 127.0.0.1:44406)
0807 04:19:14.623836 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:14.623852 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:14.623984 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:14.624621 (+ 637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:14.624624 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:14.625186 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:19:14.625382 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:14.625396 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.626802 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.626808 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:14.628363 (+ 1555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:14.628376 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.629665 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.629671 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:14.629845 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:14.630369 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:19:14.630387 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:19:14.633161 (+ 2774us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:19:14.637366 (+ 4205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:14.637372 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:14.637375 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:14.637918 (+ 543us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:14.638385 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:14.638392 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:14.638396 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:14.638592 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:14.639443 (+ 851us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:19:14.639448 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:19:14.639622 (+ 174us) client_negotiation.cc:769] Sending connection context
0807 04:19:14.639798 (+ 176us) client_negotiation.cc:240] Negotiation successful
0807 04:19:14.640101 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137}
I20260807 04:19:14.641310 22555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.623600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44406 (local address 127.7.200.252:43775)
0807 04:19:14.623781 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:14.623786 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:14.623929 (+ 143us) server_negotiation.cc:407] Connection header received
0807 04:19:14.624106 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:14.624111 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:14.624179 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:14.624332 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:14.625578 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.626548 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.628778 (+ 2230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.629454 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.629658 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:14.633371 (+ 3713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:14.633376 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:14.633381 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:14.633415 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:14.637205 (+ 3790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:14.638092 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:14.638096 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:14.638099 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:14.638243 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:14.638742 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:14.638746 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:14.638749 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:14.639184 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:14.639340 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:14.640831 (+ 1491us) server_negotiation.cc:299] Negotiation successful
0807 04:19:14.641095 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 04:19:14.647310 22397 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0f2cad84db340239f24e024de759156: Bootstrap starting.
Aug 07 04:19:14 dist-test-slave-qg60 krb5kdc[22315](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076354, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.252@KRBTEST.COM for kudu/127.7.200.252@KRBTEST.COM
Aug 07 04:19:14 dist-test-slave-qg60 krb5kdc[22315](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076352, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.253@KRBTEST.COM
I20260807 04:19:14.651381 22397 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d0f2cad84db340239f24e024de759156: Neither blocks nor log segments found. Creating new log.
I20260807 04:19:14.652786 22397 log.cc:824] T 00000000000000000000000000000000 P d0f2cad84db340239f24e024de759156: Log is configured to *not* fsync() on all Append() calls
I20260807 04:19:14.655527 22557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.635730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:43775 (local address 127.0.0.1:44420)
0807 04:19:14.636015 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:14.636040 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:14.636197 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:14.639411 (+ 3214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:14.639416 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:14.639887 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:19:14.640064 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:14.640076 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.642369 (+ 2293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.642377 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:14.643610 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:14.643626 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.644560 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.644568 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:14.644816 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:14.646020 (+ 1204us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:19:14.646038 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:19:14.648995 (+ 2957us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:19:14.652529 (+ 3534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:14.652537 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:14.652542 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:14.653409 (+ 867us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:14.653832 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:14.653838 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:14.653841 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:14.653966 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:14.654668 (+ 702us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:19:14.654674 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:19:14.654843 (+ 169us) client_negotiation.cc:769] Sending connection context
0807 04:19:14.655016 (+ 173us) client_negotiation.cc:240] Negotiation successful
0807 04:19:14.655274 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139}
I20260807 04:19:14.656337 22397 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0f2cad84db340239f24e024de759156: No bootstrap required, opened a new log
I20260807 04:19:14.656566 22558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.635765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44420 (local address 127.7.200.252:43775)
0807 04:19:14.638895 (+ 3130us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:14.638900 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:14.638925 (+ 25us) server_negotiation.cc:407] Connection header received
0807 04:19:14.638971 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:14.638976 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:14.639040 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:14.639147 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:14.640264 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.642243 (+ 1979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.643774 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.644386 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.644528 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:14.649229 (+ 4701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:14.649233 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:14.649237 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:14.649264 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:14.652359 (+ 3095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:14.653577 (+ 1218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:14.653581 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:14.653585 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:14.653711 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:14.654084 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:14.654092 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:14.654095 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:14.654514 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:14.654687 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:14.655929 (+ 1242us) server_negotiation.cc:299] Negotiation successful
0807 04:19:14.656141 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2978,"thread_start_us":2788,"threads_started":1}
I20260807 04:19:14.658457 22481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.639451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52472 (local address 127.7.200.253:44053)
0807 04:19:14.639647 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:14.639653 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:14.639669 (+ 16us) server_negotiation.cc:407] Connection header received
0807 04:19:14.639721 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:14.639748 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:14.639821 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:14.639934 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:14.641848 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.643013 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.644672 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.645340 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.645490 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:14.651214 (+ 5724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:14.651220 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:14.651225 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:14.651273 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:14.654855 (+ 3582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:14.655807 (+ 952us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:14.655813 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:14.655816 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:14.655991 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:14.656555 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:14.656560 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:14.656563 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:14.656982 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:14.657263 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:14.657838 (+ 575us) server_negotiation.cc:299] Negotiation successful
0807 04:19:14.658114 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 04:19:14.661365 22552 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db: Bootstrap starting.
I20260807 04:19:14.665498 22552 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db: Neither blocks nor log segments found. Creating new log.
I20260807 04:19:14.666107 22397 raft_consensus.cc:348] T 00000000000000000000000000000000 P d0f2cad84db340239f24e024de759156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2cad84db340239f24e024de759156" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40555 } } peers { permanent_uuid: "a063552cb9714d6599caa44b2cf2a892" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 44053 } } peers { permanent_uuid: "f95920b960764999bbf15e0d1f2035db" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } }
I20260807 04:19:14.666536 22397 raft_consensus.cc:374] T 00000000000000000000000000000000 P d0f2cad84db340239f24e024de759156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:19:14.666661 22397 raft_consensus.cc:729] T 00000000000000000000000000000000 P d0f2cad84db340239f24e024de759156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0f2cad84db340239f24e024de759156, State: Initialized, Role: FOLLOWER
I20260807 04:19:14.666852 22552 log.cc:824] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db: Log is configured to *not* fsync() on all Append() calls
I20260807 04:19:14.666965 7971 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 04:19:14.667336 22397 consensus_queue.cc:260] T 00000000000000000000000000000000 P d0f2cad84db340239f24e024de759156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2cad84db340239f24e024de759156" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40555 } } peers { permanent_uuid: "a063552cb9714d6599caa44b2cf2a892" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 44053 } } peers { permanent_uuid: "f95920b960764999bbf15e0d1f2035db" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } }
I20260807 04:19:14.669868 22552 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db: No bootstrap required, opened a new log
I20260807 04:19:14.671779 22561 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0f2cad84db340239f24e024de759156 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2cad84db340239f24e024de759156" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40555 } } peers { permanent_uuid: "a063552cb9714d6599caa44b2cf2a892" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 44053 } } peers { permanent_uuid: "f95920b960764999bbf15e0d1f2035db" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } } }
I20260807 04:19:14.672338 22561 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0f2cad84db340239f24e024de759156 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 04:19:14.673141 22397 sys_catalog.cc:564] T 00000000000000000000000000000000 P d0f2cad84db340239f24e024de759156 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:19:14.680897 22552 raft_consensus.cc:348] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2cad84db340239f24e024de759156" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40555 } } peers { permanent_uuid: "a063552cb9714d6599caa44b2cf2a892" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 44053 } } peers { permanent_uuid: "f95920b960764999bbf15e0d1f2035db" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } }
I20260807 04:19:14.681407 22552 raft_consensus.cc:374] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:19:14.681583 22552 raft_consensus.cc:729] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f95920b960764999bbf15e0d1f2035db, State: Initialized, Role: FOLLOWER
I20260807 04:19:14.682421 22552 consensus_queue.cc:260] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2cad84db340239f24e024de759156" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40555 } } peers { permanent_uuid: "a063552cb9714d6599caa44b2cf2a892" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 44053 } } peers { permanent_uuid: "f95920b960764999bbf15e0d1f2035db" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } }
I20260807 04:19:14.694689 22556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.673781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48878 (local address 127.7.200.254:40555)
0807 04:19:14.673970 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:14.673976 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:14.674067 (+ 91us) server_negotiation.cc:407] Connection header received
0807 04:19:14.674424 (+ 357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:14.674430 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:14.674511 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:14.674584 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:14.677036 (+ 2452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.678256 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.680447 (+ 2191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.681134 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.681243 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:14.686514 (+ 5271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:14.686524 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:14.686532 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:14.686588 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:14.690449 (+ 3861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:14.691320 (+ 871us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:14.691326 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:14.691330 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:14.691497 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:14.691925 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:14.691930 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:14.691933 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:14.692351 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:14.692643 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:14.694006 (+ 1363us) server_negotiation.cc:299] Negotiation successful
0807 04:19:14.694275 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 04:19:14.696571 22570 sys_catalog.cc:455] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2cad84db340239f24e024de759156" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40555 } } peers { permanent_uuid: "a063552cb9714d6599caa44b2cf2a892" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 44053 } } peers { permanent_uuid: "f95920b960764999bbf15e0d1f2035db" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } } }
I20260807 04:19:14.697077 22570 sys_catalog.cc:458] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db [sys.catalog]: This master's current role is: FOLLOWER
I20260807 04:19:14.699002 22552 sys_catalog.cc:564] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:19:14.706403 22481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.675540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52478 (local address 127.7.200.253:44053)
0807 04:19:14.675772 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:14.675780 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:14.681291 (+ 5511us) server_negotiation.cc:407] Connection header received
0807 04:19:14.682419 (+ 1128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:14.682429 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:14.682539 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:14.682628 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:14.690811 (+ 8183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.691946 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.694137 (+ 2191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.694759 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.694882 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:14.698742 (+ 3860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:14.698749 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:14.698754 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:14.698808 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:14.702656 (+ 3848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:14.703689 (+ 1033us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:14.703696 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:14.703701 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:14.703856 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:14.704344 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:14.704351 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:14.704356 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:14.704834 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:14.705088 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:14.705709 (+ 621us) server_negotiation.cc:299] Negotiation successful
0807 04:19:14.705981 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 04:19:14.711313 22558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.679390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44430 (local address 127.7.200.252:43775)
0807 04:19:14.679588 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:14.679594 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:14.687144 (+ 7550us) server_negotiation.cc:407] Connection header received
0807 04:19:14.687355 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:14.687363 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:14.687469 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:14.687590 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:14.690655 (+ 3065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.692103 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.698837 (+ 6734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.699638 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.699760 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:14.703557 (+ 3797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:14.703564 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:14.703568 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:14.703614 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:14.707480 (+ 3866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:14.708590 (+ 1110us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:14.708595 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:14.708598 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:14.708779 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:14.709293 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:14.709300 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:14.709306 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:14.709739 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:14.709996 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:14.710673 (+ 677us) server_negotiation.cc:299] Negotiation successful
0807 04:19:14.710875 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260807 04:19:14.716856 22350 tablet.cc:2369] T 00000000000000000000000000000000 P d0f2cad84db340239f24e024de759156: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 04:19:14.722936 22584 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d0f2cad84db340239f24e024de759156: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 04:19:14.723065 22584 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 04:19:14.715444 22329 master_runner.cc:186] Error getting master registration for 127.7.200.253:44053: OK, instance_id { permanent_uuid: "a063552cb9714d6599caa44b2cf2a892" instance_seqno: 1786076354009334 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 04:19:14.727633 22329 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 04:19:14.735365 22593 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 04:19:14.735558 22593 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 04:19:14.737403 22476 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } attempt: 5
Aug 07 04:19:14 dist-test-slave-qg60 krb5kdc[22315](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076353, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.253@KRBTEST.COM for kudu/127.7.200.252@KRBTEST.COM
I20260807 04:19:14.759279 22558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.738692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44432 (local address 127.7.200.252:43775)
0807 04:19:14.738869 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:14.738874 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:14.738892 (+ 18us) server_negotiation.cc:407] Connection header received
0807 04:19:14.738968 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:14.738975 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:14.739069 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:14.739170 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:14.740538 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.741893 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.744358 (+ 2465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.745467 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.745660 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:14.751311 (+ 5651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:14.751319 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:14.751324 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:14.751370 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:14.755273 (+ 3903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:14.756201 (+ 928us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:14.756207 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:14.756211 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:14.756375 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:14.756866 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:14.756871 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:14.756875 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:14.757285 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:14.757475 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:14.758590 (+ 1115us) server_negotiation.cc:299] Negotiation successful
0807 04:19:14.758841 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 04:19:14.759917 22479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:14.738008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:43775 (local address 127.0.0.1:44432)
0807 04:19:14.738355 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:14.738374 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:14.738482 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:14.739434 (+ 952us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:14.739440 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:14.740025 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:19:14.740241 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:14.740257 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.742083 (+ 1826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.742089 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:14.744102 (+ 2013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:14.744121 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:14.746014 (+ 1893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:14.746021 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:14.746601 (+ 580us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:14.747576 (+ 975us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:19:14.747630 (+ 54us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:19:14.751024 (+ 3394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:19:14.755468 (+ 4444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:14.755474 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:14.755479 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:14.756048 (+ 569us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:14.756527 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:14.756532 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:14.756536 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:14.756702 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:14.757567 (+ 865us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:19:14.757573 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:19:14.757745 (+ 172us) client_negotiation.cc:769] Sending connection context
0807 04:19:14.757912 (+ 167us) client_negotiation.cc:240] Negotiation successful
0807 04:19:14.758262 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217}
I20260807 04:19:14.731453 22484 master_runner.cc:186] Error getting master registration for 127.7.200.253:44053: OK, instance_id { permanent_uuid: "a063552cb9714d6599caa44b2cf2a892" instance_seqno: 1786076354009334 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 04:19:14.762952 22484 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 04:19:14.766579 22476 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a063552cb9714d6599caa44b2cf2a892: Bootstrap starting.
I20260807 04:19:14.774039 22570 raft_consensus.cc:482] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:19:14.774439 22570 raft_consensus.cc:504] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2cad84db340239f24e024de759156" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40555 } } peers { permanent_uuid: "a063552cb9714d6599caa44b2cf2a892" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 44053 } } peers { permanent_uuid: "f95920b960764999bbf15e0d1f2035db" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } }
I20260807 04:19:14.774847 22476 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a063552cb9714d6599caa44b2cf2a892: Neither blocks nor log segments found. Creating new log.
I20260807 04:19:14.776147 22570 leader_election.cc:288] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0f2cad84db340239f24e024de759156 (127.7.200.254:40555), a063552cb9714d6599caa44b2cf2a892 (127.7.200.253:44053)
I20260807 04:19:14.778083 22371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95920b960764999bbf15e0d1f2035db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0f2cad84db340239f24e024de759156" is_pre_election: true
I20260807 04:19:14.778759 22371 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d0f2cad84db340239f24e024de759156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f95920b960764999bbf15e0d1f2035db in term 0.
I20260807 04:19:14.779757 22500 leader_election.cc:302] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0f2cad84db340239f24e024de759156, f95920b960764999bbf15e0d1f2035db; no voters:
I20260807 04:19:14.780717 22570 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:19:14.780903 22570 raft_consensus.cc:482] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:19:14.781013 22570 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:19:14.781881 22476 log.cc:824] T 00000000000000000000000000000000 P a063552cb9714d6599caa44b2cf2a892: Log is configured to *not* fsync() on all Append() calls
I20260807 04:19:14.784670 22570 raft_consensus.cc:504] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2cad84db340239f24e024de759156" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40555 } } peers { permanent_uuid: "a063552cb9714d6599caa44b2cf2a892" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 44053 } } peers { permanent_uuid: "f95920b960764999bbf15e0d1f2035db" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } }
I20260807 04:19:14.786101 22371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95920b960764999bbf15e0d1f2035db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0f2cad84db340239f24e024de759156"
I20260807 04:19:14.786345 22371 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d0f2cad84db340239f24e024de759156 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:19:14.789803 22371 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d0f2cad84db340239f24e024de759156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f95920b960764999bbf15e0d1f2035db in term 1.
I20260807 04:19:14.790337 22500 leader_election.cc:302] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d0f2cad84db340239f24e024de759156, f95920b960764999bbf15e0d1f2035db; no voters:
I20260807 04:19:14.793371 22476 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a063552cb9714d6599caa44b2cf2a892: No bootstrap required, opened a new log
I20260807 04:19:14.796984 22570 leader_election.cc:288] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db [CANDIDATE]: Term 1 election: Requested vote from peers d0f2cad84db340239f24e024de759156 (127.7.200.254:40555), a063552cb9714d6599caa44b2cf2a892 (127.7.200.253:44053)
I20260807 04:19:14.797921 22570 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:19:14.798612 22570 raft_consensus.cc:686] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db [term 1 LEADER]: Becoming Leader. State: Replica: f95920b960764999bbf15e0d1f2035db, State: Running, Role: LEADER
I20260807 04:19:14.801327 22570 consensus_queue.cc:237] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2cad84db340239f24e024de759156" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40555 } } peers { permanent_uuid: "a063552cb9714d6599caa44b2cf2a892" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 44053 } } peers { permanent_uuid: "f95920b960764999bbf15e0d1f2035db" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } }
W20260807 04:19:14.811751 22505 tablet.cc:2369] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:19:14.814647 22476 raft_consensus.cc:348] T 00000000000000000000000000000000 P a063552cb9714d6599caa44b2cf2a892 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2cad84db340239f24e024de759156" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40555 } } peers { permanent_uuid: "a063552cb9714d6599caa44b2cf2a892" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 44053 } } peers { permanent_uuid: "f95920b960764999bbf15e0d1f2035db" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } }
I20260807 04:19:14.815677 22476 raft_consensus.cc:374] T 00000000000000000000000000000000 P a063552cb9714d6599caa44b2cf2a892 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:19:14.815968 22476 raft_consensus.cc:729] T 00000000000000000000000000000000 P a063552cb9714d6599caa44b2cf2a892 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a063552cb9714d6599caa44b2cf2a892, State: Initialized, Role: FOLLOWER
I20260807 04:19:14.817278 22476 consensus_queue.cc:260] T 00000000000000000000000000000000 P a063552cb9714d6599caa44b2cf2a892 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2cad84db340239f24e024de759156" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40555 } } peers { permanent_uuid: "a063552cb9714d6599caa44b2cf2a892" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 44053 } } peers { permanent_uuid: "f95920b960764999bbf15e0d1f2035db" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } }
I20260807 04:19:14.826723 22450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95920b960764999bbf15e0d1f2035db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a063552cb9714d6599caa44b2cf2a892" is_pre_election: true
I20260807 04:19:14.827126 22449 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f95920b960764999bbf15e0d1f2035db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a063552cb9714d6599caa44b2cf2a892"
I20260807 04:19:14.827363 22450 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a063552cb9714d6599caa44b2cf2a892 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f95920b960764999bbf15e0d1f2035db in term 0.
I20260807 04:19:14.828188 22597 sys_catalog.cc:455] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db [sys.catalog]: SysCatalogTable state changed. Reason: New leader f95920b960764999bbf15e0d1f2035db. Latest consensus state: current_term: 1 leader_uuid: "f95920b960764999bbf15e0d1f2035db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2cad84db340239f24e024de759156" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40555 } } peers { permanent_uuid: "a063552cb9714d6599caa44b2cf2a892" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 44053 } } peers { permanent_uuid: "f95920b960764999bbf15e0d1f2035db" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } } }
I20260807 04:19:14.828663 22597 sys_catalog.cc:458] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db [sys.catalog]: This master's current role is: LEADER
I20260807 04:19:14.828970 22476 sys_catalog.cc:564] T 00000000000000000000000000000000 P a063552cb9714d6599caa44b2cf2a892 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:19:14.832980 22599 sys_catalog.cc:455] T 00000000000000000000000000000000 P a063552cb9714d6599caa44b2cf2a892 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2cad84db340239f24e024de759156" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40555 } } peers { permanent_uuid: "a063552cb9714d6599caa44b2cf2a892" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 44053 } } peers { permanent_uuid: "f95920b960764999bbf15e0d1f2035db" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } } }
I20260807 04:19:14.833381 22599 sys_catalog.cc:458] T 00000000000000000000000000000000 P a063552cb9714d6599caa44b2cf2a892 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 04:19:14.839500 22601 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:19:14.843070 22601 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:19:14.866400 22449 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a063552cb9714d6599caa44b2cf2a892 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:19:14.870522 22449 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a063552cb9714d6599caa44b2cf2a892 [term 1 FOLLOWER]: Refusing update from remote peer f95920b960764999bbf15e0d1f2035db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:19:14.871527 22597 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db [LEADER]: Connected to new peer: Peer: permanent_uuid: "a063552cb9714d6599caa44b2cf2a892" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 44053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:19:14.880681 22371 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d0f2cad84db340239f24e024de759156 [term 1 FOLLOWER]: Refusing update from remote peer f95920b960764999bbf15e0d1f2035db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:19:14.881727 22597 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0f2cad84db340239f24e024de759156" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:19:14.901868 22561 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0f2cad84db340239f24e024de759156 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f95920b960764999bbf15e0d1f2035db. Latest consensus state: current_term: 1 leader_uuid: "f95920b960764999bbf15e0d1f2035db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2cad84db340239f24e024de759156" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40555 } } peers { permanent_uuid: "a063552cb9714d6599caa44b2cf2a892" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 44053 } } peers { permanent_uuid: "f95920b960764999bbf15e0d1f2035db" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } } }
I20260807 04:19:14.902194 22561 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0f2cad84db340239f24e024de759156 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 04:19:14.919937 22605 mvcc.cc:205] Tried to move back new op lower bound from 7315768749520601088 to 7315768749314093056. Current Snapshot: MvccSnapshot[applied={T|T < 7315768749520601088}]
I20260807 04:19:14.934589 22599 sys_catalog.cc:455] T 00000000000000000000000000000000 P a063552cb9714d6599caa44b2cf2a892 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f95920b960764999bbf15e0d1f2035db. Latest consensus state: current_term: 1 leader_uuid: "f95920b960764999bbf15e0d1f2035db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2cad84db340239f24e024de759156" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40555 } } peers { permanent_uuid: "a063552cb9714d6599caa44b2cf2a892" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 44053 } } peers { permanent_uuid: "f95920b960764999bbf15e0d1f2035db" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } } }
I20260807 04:19:14.934978 22599 sys_catalog.cc:458] T 00000000000000000000000000000000 P a063552cb9714d6599caa44b2cf2a892 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 04:19:14.943302 22608 mvcc.cc:205] Tried to move back new op lower bound from 7315768749520601088 to 7315768749314093056. Current Snapshot: MvccSnapshot[applied={T|T < 7315768749520601088}]
I20260807 04:19:14.949395 22561 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0f2cad84db340239f24e024de759156 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f95920b960764999bbf15e0d1f2035db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2cad84db340239f24e024de759156" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40555 } } peers { permanent_uuid: "a063552cb9714d6599caa44b2cf2a892" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 44053 } } peers { permanent_uuid: "f95920b960764999bbf15e0d1f2035db" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } } }
I20260807 04:19:14.949694 22561 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0f2cad84db340239f24e024de759156 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 04:19:14.951310 22599 sys_catalog.cc:455] T 00000000000000000000000000000000 P a063552cb9714d6599caa44b2cf2a892 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f95920b960764999bbf15e0d1f2035db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2cad84db340239f24e024de759156" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40555 } } peers { permanent_uuid: "a063552cb9714d6599caa44b2cf2a892" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 44053 } } peers { permanent_uuid: "f95920b960764999bbf15e0d1f2035db" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } } }
I20260807 04:19:14.951567 22599 sys_catalog.cc:458] T 00000000000000000000000000000000 P a063552cb9714d6599caa44b2cf2a892 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 04:19:14.954452 22570 sys_catalog.cc:455] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f95920b960764999bbf15e0d1f2035db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2cad84db340239f24e024de759156" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40555 } } peers { permanent_uuid: "a063552cb9714d6599caa44b2cf2a892" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 44053 } } peers { permanent_uuid: "f95920b960764999bbf15e0d1f2035db" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } } }
I20260807 04:19:14.954809 22570 sys_catalog.cc:458] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db [sys.catalog]: This master's current role is: LEADER
I20260807 04:19:14.955078 22570 sys_catalog.cc:455] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f95920b960764999bbf15e0d1f2035db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d0f2cad84db340239f24e024de759156" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 40555 } } peers { permanent_uuid: "a063552cb9714d6599caa44b2cf2a892" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 44053 } } peers { permanent_uuid: "f95920b960764999bbf15e0d1f2035db" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 43775 } } }
I20260807 04:19:14.955361 22570 sys_catalog.cc:458] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db [sys.catalog]: This master's current role is: LEADER
I20260807 04:19:14.957494 22601 catalog_manager.cc:1347] Generated new cluster ID: 0d69bad146e54c04b60544fe579c5435
I20260807 04:19:14.957607 22601 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:19:14.992157 22601 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:19:14.994213 22601 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:19:15.001144 22621 catalog_manager.cc:1259] Loaded cluster ID: 0d69bad146e54c04b60544fe579c5435
I20260807 04:19:15.001273 22621 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a063552cb9714d6599caa44b2cf2a892: loading cluster ID for follower catalog manager: success
I20260807 04:19:15.010223 22621 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a063552cb9714d6599caa44b2cf2a892: acquiring CA information for follower catalog manager: success
I20260807 04:19:15.017727 22601 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f95920b960764999bbf15e0d1f2035db: Generated new TSK 0
I20260807 04:19:15.018795 22601 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 04:19:15.019773 22621 catalog_manager.cc:873] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
I20260807 04:19:15.725363 22584 catalog_manager.cc:1259] Loaded cluster ID: 0d69bad146e54c04b60544fe579c5435
I20260807 04:19:15.725533 22584 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d0f2cad84db340239f24e024de759156: loading cluster ID for follower catalog manager: success
I20260807 04:19:15.728322 22584 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d0f2cad84db340239f24e024de759156: acquiring CA information for follower catalog manager: success
I20260807 04:19:15.730541 22584 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d0f2cad84db340239f24e024de759156: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 04:19:16.023309 22621 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a063552cb9714d6599caa44b2cf2a892: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 04:19:16.157573 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 22329
I20260807 04:19:16.158797 22392 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:19:16.273939 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 22329
I20260807 04:19:16.301388 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 22405
I20260807 04:19:16.302587 22471 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:19:16.413904 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 22405
I20260807 04:19:16.436422 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 22484
I20260807 04:19:16.437780 22547 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:19:16.551017 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 22484
2026-08-07T04:19:16Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (5074 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:19:16 dist-test-slave-qg60 krb5kdc[22633](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:19:16 dist-test-slave-qg60 krb5kdc[22633](info): set up 2 sockets
Aug 07 04:19:16 dist-test-slave-qg60 krb5kdc[22633](info): commencing operation
krb5kdc: starting...
W20260807 04:19:17.754385 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.158s user 0.004s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:19:17 dist-test-slave-qg60 krb5kdc[22633](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076357, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:19:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:19:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
I20260807 04:19:18.064122 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:42899
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:33093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:42899
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:19:18.425597 22647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:19:18.425911 22647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:19:18.426013 22647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:19:18.433591 22647 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:19:18.433707 22647 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:19:18.433755 22647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:19:18.433815 22647 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:19:18.433861 22647 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:19:18.444082 22647 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:33093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:42899
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:42899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:19:18.445447 22647 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:19:18.446745 22647 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:19:18.458997 22652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:18.459128 22656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:18.459178 22654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:18.460137 22647 server_base.cc:1034] running on GCE node
I20260807 04:19:18.461391 22647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:19:18.463428 22647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:19:18.464658 22647 hybrid_clock.cc:648] HybridClock initialized: now 1786076358464611 us; error 36 us; skew 500 ppm
I20260807 04:19:18.465087 22647 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:19:18 dist-test-slave-qg60 krb5kdc[22633](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076358, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:19:18.468374 22647 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:19:18.470064 22647 webserver.cc:460] Webserver started at http://127.7.200.254:38515/ using document root <none> and password file <none>
I20260807 04:19:18.470745 22647 fs_manager.cc:359] Metadata directory not provided
I20260807 04:19:18.470850 22647 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:19:18.471135 22647 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:19:18.474268 22647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "560b74ab211c4fecafe2d0b817b65ac8"
format_stamp: "Formatted at 2026-08-07 04:19:18 on dist-test-slave-qg60"
server_key: "98f170257e3cd09405b51ed31294e081"
server_key_iv: "fd60aef3595e607d146f274ac2b8b79e"
server_key_version: "encryptionkey@0"
I20260807 04:19:18.474997 22647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "560b74ab211c4fecafe2d0b817b65ac8"
format_stamp: "Formatted at 2026-08-07 04:19:18 on dist-test-slave-qg60"
server_key: "98f170257e3cd09405b51ed31294e081"
server_key_iv: "fd60aef3595e607d146f274ac2b8b79e"
server_key_version: "encryptionkey@0"
I20260807 04:19:18.480407 22647 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 04:19:18.484021 22663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:18.485641 22647 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 04:19:18.485841 22647 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "560b74ab211c4fecafe2d0b817b65ac8"
format_stamp: "Formatted at 2026-08-07 04:19:18 on dist-test-slave-qg60"
server_key: "98f170257e3cd09405b51ed31294e081"
server_key_iv: "fd60aef3595e607d146f274ac2b8b79e"
server_key_version: "encryptionkey@0"
I20260807 04:19:18.486083 22647 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:19:18.503037 22647 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:19:18.507543 22647 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:19:18.507877 22647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:19:18.527842 22647 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:42899
I20260807 04:19:18.527861 22717 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:42899 every 8 connection(s)
I20260807 04:19:18.529356 22647 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:19:18.533504 22718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:19:18.534937 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 22647
I20260807 04:19:18.535159 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:19:18.535846 7971 external_mini_cluster.cc:1428] Setting key b2db5a0f5416fabe2f9f34f938becaab
I20260807 04:19:18.548239 22718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 560b74ab211c4fecafe2d0b817b65ac8: Bootstrap starting.
Aug 07 04:19:18 dist-test-slave-qg60 krb5kdc[22633](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076357, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:19:18.552317 22718 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 560b74ab211c4fecafe2d0b817b65ac8: Neither blocks nor log segments found. Creating new log.
I20260807 04:19:18.553681 22718 log.cc:824] T 00000000000000000000000000000000 P 560b74ab211c4fecafe2d0b817b65ac8: Log is configured to *not* fsync() on all Append() calls
I20260807 04:19:18.556706 22718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 560b74ab211c4fecafe2d0b817b65ac8: No bootstrap required, opened a new log
I20260807 04:19:18.560488 22721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:18.537707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41706 (local address 127.7.200.254:42899)
0807 04:19:18.538527 (+ 820us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:18.538539 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:18.538583 (+ 44us) server_negotiation.cc:407] Connection header received
0807 04:19:18.540205 (+ 1622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:18.540226 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:18.540621 (+ 395us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:18.541017 (+ 396us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:18.543176 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:18.544479 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:18.546409 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:18.547150 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:18.547288 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:18.552617 (+ 5329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:18.552626 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:18.552641 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:18.552687 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:18.556060 (+ 3373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:18.556902 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:18.556911 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:18.556919 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:18.557116 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:18.557558 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:18.557562 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:18.557564 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:18.558141 (+ 577us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:18.558511 (+ 370us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:18.558968 (+ 457us) server_negotiation.cc:299] Negotiation successful
0807 04:19:18.559422 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":598,"thread_start_us":386,"threads_started":1}
I20260807 04:19:18.564570 7971 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 04:19:18.565306 22718 raft_consensus.cc:348] T 00000000000000000000000000000000 P 560b74ab211c4fecafe2d0b817b65ac8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "560b74ab211c4fecafe2d0b817b65ac8" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } }
I20260807 04:19:18.565683 22718 raft_consensus.cc:374] T 00000000000000000000000000000000 P 560b74ab211c4fecafe2d0b817b65ac8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:19:18.565809 22718 raft_consensus.cc:729] T 00000000000000000000000000000000 P 560b74ab211c4fecafe2d0b817b65ac8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 560b74ab211c4fecafe2d0b817b65ac8, State: Initialized, Role: FOLLOWER
I20260807 04:19:18.566377 22718 consensus_queue.cc:260] T 00000000000000000000000000000000 P 560b74ab211c4fecafe2d0b817b65ac8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "560b74ab211c4fecafe2d0b817b65ac8" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } }
I20260807 04:19:18.566627 22718 raft_consensus.cc:388] T 00000000000000000000000000000000 P 560b74ab211c4fecafe2d0b817b65ac8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:19:18.566783 22718 raft_consensus.cc:482] T 00000000000000000000000000000000 P 560b74ab211c4fecafe2d0b817b65ac8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:19:18.566965 22718 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 560b74ab211c4fecafe2d0b817b65ac8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:19:18.569660 22718 raft_consensus.cc:504] T 00000000000000000000000000000000 P 560b74ab211c4fecafe2d0b817b65ac8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "560b74ab211c4fecafe2d0b817b65ac8" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } }
I20260807 04:19:18.570195 22718 leader_election.cc:302] T 00000000000000000000000000000000 P 560b74ab211c4fecafe2d0b817b65ac8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 560b74ab211c4fecafe2d0b817b65ac8; no voters:
I20260807 04:19:18.570818 22718 leader_election.cc:288] T 00000000000000000000000000000000 P 560b74ab211c4fecafe2d0b817b65ac8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:19:18.570976 22723 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 560b74ab211c4fecafe2d0b817b65ac8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:19:18.571858 22723 raft_consensus.cc:686] T 00000000000000000000000000000000 P 560b74ab211c4fecafe2d0b817b65ac8 [term 1 LEADER]: Becoming Leader. State: Replica: 560b74ab211c4fecafe2d0b817b65ac8, State: Running, Role: LEADER
I20260807 04:19:18.572525 22723 consensus_queue.cc:237] T 00000000000000000000000000000000 P 560b74ab211c4fecafe2d0b817b65ac8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "560b74ab211c4fecafe2d0b817b65ac8" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } }
I20260807 04:19:18.573230 22718 sys_catalog.cc:564] T 00000000000000000000000000000000 P 560b74ab211c4fecafe2d0b817b65ac8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:19:18.575711 22725 sys_catalog.cc:455] T 00000000000000000000000000000000 P 560b74ab211c4fecafe2d0b817b65ac8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 560b74ab211c4fecafe2d0b817b65ac8. Latest consensus state: current_term: 1 leader_uuid: "560b74ab211c4fecafe2d0b817b65ac8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "560b74ab211c4fecafe2d0b817b65ac8" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } }
I20260807 04:19:18.576193 22725 sys_catalog.cc:458] T 00000000000000000000000000000000 P 560b74ab211c4fecafe2d0b817b65ac8 [sys.catalog]: This master's current role is: LEADER
I20260807 04:19:18.575845 22724 sys_catalog.cc:455] T 00000000000000000000000000000000 P 560b74ab211c4fecafe2d0b817b65ac8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "560b74ab211c4fecafe2d0b817b65ac8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "560b74ab211c4fecafe2d0b817b65ac8" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42899 } } }
I20260807 04:19:18.576460 22724 sys_catalog.cc:458] T 00000000000000000000000000000000 P 560b74ab211c4fecafe2d0b817b65ac8 [sys.catalog]: This master's current role is: LEADER
I20260807 04:19:18.577925 22732 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:19:18.582367 22732 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:19:18.591761 22732 catalog_manager.cc:1347] Generated new cluster ID: 7307c2c78680439eb637431444b25933
I20260807 04:19:18.591888 22732 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:19:18.600298 22732 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:19:18.602207 22732 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:19:18.615711 22732 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 560b74ab211c4fecafe2d0b817b65ac8: Generated new TSK 0
I20260807 04:19:18.616937 22732 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:19:18.626433 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 22647
I20260807 04:19:18.627785 22713 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:19:18.718562 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 22647
2026-08-07T04:19:18Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2163 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:19:18 dist-test-slave-qg60 krb5kdc[22747](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:19:18 dist-test-slave-qg60 krb5kdc[22747](info): set up 2 sockets
Aug 07 04:19:18 dist-test-slave-qg60 krb5kdc[22747](info): commencing operation
krb5kdc: starting...
W20260807 04:19:19.917757 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.158s user 0.002s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:19:20 dist-test-slave-qg60 krb5kdc[22747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076360, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:19:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:19:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
I20260807 04:19:20.232954 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:35593
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:44791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:35593
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:19:20.619618 22762 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:19:20.619920 22762 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:19:20.620100 22762 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:19:20.627403 22762 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:19:20.627513 22762 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:19:20.627633 22762 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:19:20.627746 22762 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:19:20.627827 22762 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:19:20.637823 22762 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:44791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:35593
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:35593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:19:20.639621 22762 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:19:20.641392 22762 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:19:20.653534 22767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:20.653501 22768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:20.653877 22770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:20.654417 22762 server_base.cc:1034] running on GCE node
I20260807 04:19:20.655265 22762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:19:20.656834 22762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:19:20.658094 22762 hybrid_clock.cc:648] HybridClock initialized: now 1786076360658046 us; error 51 us; skew 500 ppm
I20260807 04:19:20.658537 22762 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:19:20 dist-test-slave-qg60 krb5kdc[22747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076360, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:19:20.662009 22762 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:19:20.663813 22762 webserver.cc:460] Webserver started at http://127.7.200.254:37927/ using document root <none> and password file <none>
I20260807 04:19:20.664530 22762 fs_manager.cc:359] Metadata directory not provided
I20260807 04:19:20.664681 22762 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:19:20.665058 22762 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:19:20.668182 22762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "ec1cd6ccd087498cbe67569501ab58c0"
format_stamp: "Formatted at 2026-08-07 04:19:20 on dist-test-slave-qg60"
server_key: "4c5a6a5e49e556c8156f6529eed26947"
server_key_iv: "44babfb858bce08f139481a65d540513"
server_key_version: "encryptionkey@0"
I20260807 04:19:20.669072 22762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "ec1cd6ccd087498cbe67569501ab58c0"
format_stamp: "Formatted at 2026-08-07 04:19:20 on dist-test-slave-qg60"
server_key: "4c5a6a5e49e556c8156f6529eed26947"
server_key_iv: "44babfb858bce08f139481a65d540513"
server_key_version: "encryptionkey@0"
I20260807 04:19:20.674590 22762 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 04:19:20.678460 22778 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:20.679879 22762 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 04:19:20.680099 22762 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "ec1cd6ccd087498cbe67569501ab58c0"
format_stamp: "Formatted at 2026-08-07 04:19:20 on dist-test-slave-qg60"
server_key: "4c5a6a5e49e556c8156f6529eed26947"
server_key_iv: "44babfb858bce08f139481a65d540513"
server_key_version: "encryptionkey@0"
I20260807 04:19:20.680330 22762 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:19:20.698318 22762 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:19:20.702580 22762 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:19:20.702888 22762 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:19:20.722813 22762 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:35593
I20260807 04:19:20.722849 22829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:35593 every 8 connection(s)
I20260807 04:19:20.724232 22762 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:19:20.725378 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 22762
I20260807 04:19:20.725653 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:19:20.726502 7971 external_mini_cluster.cc:1428] Setting key 6670407463cf7ce23f454f03c4f8436d
I20260807 04:19:20.729218 22830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 04:19:20 dist-test-slave-qg60 krb5kdc[22747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076360, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:19:20.742780 22830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0: Bootstrap starting.
I20260807 04:19:20.747638 22830 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0: Neither blocks nor log segments found. Creating new log.
I20260807 04:19:20.749194 22830 log.cc:824] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0: Log is configured to *not* fsync() on all Append() calls
I20260807 04:19:20.753357 22830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0: No bootstrap required, opened a new log
I20260807 04:19:20.753993 22834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:20.728645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56432 (local address 127.7.200.254:35593)
0807 04:19:20.729476 (+ 831us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:20.729489 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:20.729539 (+ 50us) server_negotiation.cc:407] Connection header received
0807 04:19:20.731162 (+ 1623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:20.731182 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:20.731560 (+ 378us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:20.731879 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:20.733915 (+ 2036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:20.735272 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:20.737143 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:20.737835 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:20.737968 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:20.743243 (+ 5275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:20.743254 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:20.743293 (+ 39us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:20.743345 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:20.748260 (+ 4915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:20.749380 (+ 1120us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:20.749389 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:20.749398 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:20.749712 (+ 314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:20.750327 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:20.750335 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:20.750338 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:20.751183 (+ 845us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:20.751510 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:20.752300 (+ 790us) server_negotiation.cc:299] Negotiation successful
0807 04:19:20.752840 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":374,"threads_started":1}
I20260807 04:19:20.761310 22830 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec1cd6ccd087498cbe67569501ab58c0" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 35593 } }
I20260807 04:19:20.761726 22830 raft_consensus.cc:374] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:19:20.761837 22830 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec1cd6ccd087498cbe67569501ab58c0, State: Initialized, Role: FOLLOWER
I20260807 04:19:20.762405 22830 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec1cd6ccd087498cbe67569501ab58c0" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 35593 } }
I20260807 04:19:20.762651 22830 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:19:20.762805 22830 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:19:20.762990 22830 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:19:20.765419 22830 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec1cd6ccd087498cbe67569501ab58c0" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 35593 } }
I20260807 04:19:20.765947 22830 leader_election.cc:302] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec1cd6ccd087498cbe67569501ab58c0; no voters:
I20260807 04:19:20.766546 22830 leader_election.cc:288] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:19:20.766690 22836 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:19:20.767443 22836 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [term 1 LEADER]: Becoming Leader. State: Replica: ec1cd6ccd087498cbe67569501ab58c0, State: Running, Role: LEADER
I20260807 04:19:20.768046 22836 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec1cd6ccd087498cbe67569501ab58c0" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 35593 } }
I20260807 04:19:20.768769 22830 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:19:20.770946 22838 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec1cd6ccd087498cbe67569501ab58c0. Latest consensus state: current_term: 1 leader_uuid: "ec1cd6ccd087498cbe67569501ab58c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec1cd6ccd087498cbe67569501ab58c0" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 35593 } } }
I20260807 04:19:20.771381 22838 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [sys.catalog]: This master's current role is: LEADER
I20260807 04:19:20.772254 22837 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ec1cd6ccd087498cbe67569501ab58c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec1cd6ccd087498cbe67569501ab58c0" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 35593 } } }
I20260807 04:19:20.772866 22837 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [sys.catalog]: This master's current role is: LEADER
I20260807 04:19:20.774817 22842 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:19:20.785032 22842 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:19:20.794586 22842 catalog_manager.cc:1347] Generated new cluster ID: 66fb6c76f93e4cd6bd6bf7a9369bc717
I20260807 04:19:20.794741 22842 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:19:20.806018 22842 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:19:20.807928 22842 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:19:20.825789 22842 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0: Generated new TSK 0
I20260807 04:19:20.827000 22842 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.200.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
I20260807 04:19:20.908679 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:0
--local_ip_for_outbound_sockets=127.7.200.193
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:35593
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:44791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:19:21.257530 22858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:19:21.257855 22858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:19:21.258039 22858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:19:21.266038 22858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:19:21.266151 22858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:19:21.266341 22858 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:19:21.277441 22858 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:44791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:35593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:19:21.278853 22858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:19:21.280247 22858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:19:21.294448 22863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:21.294354 22864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:21.294391 22866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:21.295252 22858 server_base.cc:1034] running on GCE node
I20260807 04:19:21.295954 22858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:19:21.297026 22858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:19:21.298283 22858 hybrid_clock.cc:648] HybridClock initialized: now 1786076361298229 us; error 62 us; skew 500 ppm
I20260807 04:19:21.298615 22858 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:19:21 dist-test-slave-qg60 krb5kdc[22747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076361, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:19:21.301849 22858 init.cc:377] Logged in from keytab as kudu/127.7.200.193@KRBTEST.COM (short username kudu)
I20260807 04:19:21.303259 22858 webserver.cc:460] Webserver started at http://127.7.200.193:44841/ using document root <none> and password file <none>
I20260807 04:19:21.303958 22858 fs_manager.cc:359] Metadata directory not provided
I20260807 04:19:21.304111 22858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:19:21.304414 22858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:19:21.307405 22858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/data/instance:
uuid: "d2c61112bec14a61ae16ca15538b1eaa"
format_stamp: "Formatted at 2026-08-07 04:19:21 on dist-test-slave-qg60"
server_key: "b857994cab454b685b6fa78a57a57afb"
server_key_iv: "00994403a20cbc3ab5a6e104461850cd"
server_key_version: "encryptionkey@0"
I20260807 04:19:21.308169 22858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance:
uuid: "d2c61112bec14a61ae16ca15538b1eaa"
format_stamp: "Formatted at 2026-08-07 04:19:21 on dist-test-slave-qg60"
server_key: "b857994cab454b685b6fa78a57a57afb"
server_key_iv: "00994403a20cbc3ab5a6e104461850cd"
server_key_version: "encryptionkey@0"
I20260807 04:19:21.313310 22858 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260807 04:19:21.316715 22873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:21.318051 22858 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:19:21.318243 22858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "d2c61112bec14a61ae16ca15538b1eaa"
format_stamp: "Formatted at 2026-08-07 04:19:21 on dist-test-slave-qg60"
server_key: "b857994cab454b685b6fa78a57a57afb"
server_key_iv: "00994403a20cbc3ab5a6e104461850cd"
server_key_version: "encryptionkey@0"
I20260807 04:19:21.318460 22858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:19:21.340955 22858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:19:21.345438 22858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:19:21.345775 22858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:19:21.346895 22858 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:19:21.348387 22858 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:19:21.348510 22858 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:21.348672 22858 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:19:21.348773 22858 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:21.385524 22858 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:32971
I20260807 04:19:21.385619 22989 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:32971 every 8 connection(s)
I20260807 04:19:21.386922 22858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:19:21.391350 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 22858
I20260807 04:19:21.391588 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance
I20260807 04:19:21.392553 7971 external_mini_cluster.cc:1428] Setting key 927db366816f614271458da07d8f50d1
Aug 07 04:19:21 dist-test-slave-qg60 krb5kdc[22747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076361, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:19:21.410509 22992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:21.389683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:38247 (local address 127.7.200.254:35593)
0807 04:19:21.390185 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:21.390190 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:21.391363 (+ 1173us) server_negotiation.cc:407] Connection header received
0807 04:19:21.393884 (+ 2521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:21.393888 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:21.394020 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:21.394116 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:21.396095 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:21.396872 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:21.399523 (+ 2651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:21.399908 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:21.400030 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:21.404498 (+ 4468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:21.404503 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:21.404507 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:21.404539 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:21.407298 (+ 2759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:21.408071 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:21.408077 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:21.408080 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:21.408206 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:21.408641 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:21.408647 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:21.408651 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:21.409016 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:21.409184 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:21.409888 (+ 704us) server_negotiation.cc:299] Negotiation successful
0807 04:19:21.410119 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":266,"threads_started":1}
I20260807 04:19:21.411513 22994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:21.390252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.193:38247)
0807 04:19:21.391151 (+ 899us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:21.391205 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:21.393577 (+ 2372us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:21.394409 (+ 832us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:21.394420 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:21.395100 (+ 680us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:19:21.395904 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:21.395933 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:21.397040 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:21.397047 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:21.399329 (+ 2282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:21.399349 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:21.400168 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:21.400178 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:21.400566 (+ 388us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:21.401365 (+ 799us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:19:21.401402 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:19:21.404250 (+ 2848us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:19:21.407457 (+ 3207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:21.407466 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:21.407482 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:21.407914 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:21.408324 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:21.408329 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:21.408333 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:21.408524 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:21.409157 (+ 633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:19:21.409165 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:19:21.409506 (+ 341us) client_negotiation.cc:769] Sending connection context
0807 04:19:21.409782 (+ 276us) client_negotiation.cc:240] Negotiation successful
0807 04:19:21.410323 (+ 541us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":313,"threads_started":1}
I20260807 04:19:21.413228 22990 heartbeater.cc:347] Connected to a master server at 127.7.200.254:35593
I20260807 04:19:21.413578 22990 heartbeater.cc:464] Registering TS with master...
I20260807 04:19:21.414528 22990 heartbeater.cc:511] Master 127.7.200.254:35593 requested a full tablet report, sending...
I20260807 04:19:21.417276 22795 ts_manager.cc:194] Registered new tserver with Master: d2c61112bec14a61ae16ca15538b1eaa (127.7.200.193:32971)
I20260807 04:19:21.419740 22795 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.193@KRBTEST.COM'} at 127.7.200.193:38247
WARNING: no policy specified for kudu/127.7.200.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
I20260807 04:19:21.464017 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:0
--local_ip_for_outbound_sockets=127.7.200.194
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:35593
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:44791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:19:21.811930 22997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:19:21.812247 22997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:19:21.812415 22997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:19:21.820535 22997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:19:21.820654 22997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:19:21.820891 22997 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:19:21.831009 22997 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:44791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:35593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:19:21.832331 22997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:19:21.833789 22997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:19:21.847580 23005 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:21.847679 23003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:21.848186 22997 server_base.cc:1034] running on GCE node
W20260807 04:19:21.848320 23002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:21.849143 22997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:19:21.850320 22997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:19:21.851568 22997 hybrid_clock.cc:648] HybridClock initialized: now 1786076361851524 us; error 37 us; skew 500 ppm
I20260807 04:19:21.851900 22997 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:19:21 dist-test-slave-qg60 krb5kdc[22747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076361, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:19:21.860000 22997 init.cc:377] Logged in from keytab as kudu/127.7.200.194@KRBTEST.COM (short username kudu)
I20260807 04:19:21.861642 22997 webserver.cc:460] Webserver started at http://127.7.200.194:46667/ using document root <none> and password file <none>
I20260807 04:19:21.862339 22997 fs_manager.cc:359] Metadata directory not provided
I20260807 04:19:21.862444 22997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:19:21.862715 22997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:19:21.865852 22997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/data/instance:
uuid: "95f26855a5584d049517b1071b164d96"
format_stamp: "Formatted at 2026-08-07 04:19:21 on dist-test-slave-qg60"
server_key: "c5e85a2b0cc4246711b4df4702401288"
server_key_iv: "acac4033209c62b66b75660686770637"
server_key_version: "encryptionkey@0"
I20260807 04:19:21.866559 22997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance:
uuid: "95f26855a5584d049517b1071b164d96"
format_stamp: "Formatted at 2026-08-07 04:19:21 on dist-test-slave-qg60"
server_key: "c5e85a2b0cc4246711b4df4702401288"
server_key_iv: "acac4033209c62b66b75660686770637"
server_key_version: "encryptionkey@0"
I20260807 04:19:21.871977 22997 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 04:19:21.875514 23012 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:21.877199 22997 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:19:21.877381 22997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "95f26855a5584d049517b1071b164d96"
format_stamp: "Formatted at 2026-08-07 04:19:21 on dist-test-slave-qg60"
server_key: "c5e85a2b0cc4246711b4df4702401288"
server_key_iv: "acac4033209c62b66b75660686770637"
server_key_version: "encryptionkey@0"
I20260807 04:19:21.877595 22997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:19:21.890368 22997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:19:21.894958 22997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:19:21.895285 22997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:19:21.896317 22997 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:19:21.897828 22997 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:19:21.897919 22997 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:21.898093 22997 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:19:21.898155 22997 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:21.935683 22997 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:36673
I20260807 04:19:21.935781 23128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:36673 every 8 connection(s)
I20260807 04:19:21.937156 22997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:19:21.946038 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 22997
I20260807 04:19:21.946254 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance
I20260807 04:19:21.946736 7971 external_mini_cluster.cc:1428] Setting key efc2700126ee0e4d3b9ef56d286a38a2
Aug 07 04:19:21 dist-test-slave-qg60 krb5kdc[22747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076361, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:19:21.960186 23131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:21.939895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:52409 (local address 127.7.200.254:35593)
0807 04:19:21.940343 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:21.940347 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:21.941497 (+ 1150us) server_negotiation.cc:407] Connection header received
0807 04:19:21.943341 (+ 1844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:21.943346 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:21.943437 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:21.943559 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:21.945117 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:21.945862 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:21.947570 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:21.948219 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:21.948354 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:21.952699 (+ 4345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:21.952708 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:21.952715 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:21.952798 (+ 83us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:21.956444 (+ 3646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:21.957279 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:21.957287 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:21.957293 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:21.957467 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:21.957978 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:21.957993 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:21.957999 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:21.958398 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:21.958559 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:21.959409 (+ 850us) server_negotiation.cc:299] Negotiation successful
0807 04:19:21.959686 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":228,"threads_started":1}
I20260807 04:19:21.961107 23132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:21.940579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.194:52409)
0807 04:19:21.941339 (+ 760us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:21.941377 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:21.943069 (+ 1692us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:21.943791 (+ 722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:21.943801 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:21.944321 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:19:21.944946 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:21.944964 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:21.946030 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:21.946034 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:21.947424 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:21.947437 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:21.948443 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:21.948448 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:21.948839 (+ 391us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:21.949641 (+ 802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:19:21.949678 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:19:21.952446 (+ 2768us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:19:21.956614 (+ 4168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:21.956622 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:21.956643 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:21.957137 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:21.957609 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:21.957614 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:21.957617 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:21.957855 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:21.958533 (+ 678us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:19:21.958543 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:19:21.958973 (+ 430us) client_negotiation.cc:769] Sending connection context
0807 04:19:21.959253 (+ 280us) client_negotiation.cc:240] Negotiation successful
0807 04:19:21.959777 (+ 524us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":312,"threads_started":1}
I20260807 04:19:21.962589 23129 heartbeater.cc:347] Connected to a master server at 127.7.200.254:35593
I20260807 04:19:21.962916 23129 heartbeater.cc:464] Registering TS with master...
I20260807 04:19:21.963786 23129 heartbeater.cc:511] Master 127.7.200.254:35593 requested a full tablet report, sending...
I20260807 04:19:21.965451 22795 ts_manager.cc:194] Registered new tserver with Master: 95f26855a5584d049517b1071b164d96 (127.7.200.194:36673)
I20260807 04:19:21.966733 22795 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.194@KRBTEST.COM'} at 127.7.200.194:52409
WARNING: no policy specified for kudu/127.7.200.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
I20260807 04:19:22.015478 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:0
--local_ip_for_outbound_sockets=127.7.200.195
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:35593
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:44791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:19:22.359360 23136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:19:22.359935 23136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:19:22.360144 23136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:19:22.368916 23136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:19:22.369089 23136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:19:22.369288 23136 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:19:22.380263 23136 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:44791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:35593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:19:22.381757 23136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:19:22.383168 23136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:19:22.396943 23142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:22.396904 23144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:22.396981 23141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:22.397672 23136 server_base.cc:1034] running on GCE node
I20260807 04:19:22.398398 23136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:19:22.399437 23136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:19:22.400713 23136 hybrid_clock.cc:648] HybridClock initialized: now 1786076362400639 us; error 45 us; skew 500 ppm
I20260807 04:19:22.401160 23136 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:19:22 dist-test-slave-qg60 krb5kdc[22747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076362, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:19:22.404618 23136 init.cc:377] Logged in from keytab as kudu/127.7.200.195@KRBTEST.COM (short username kudu)
I20260807 04:19:22.406172 23136 webserver.cc:460] Webserver started at http://127.7.200.195:41433/ using document root <none> and password file <none>
I20260807 04:19:22.406975 23136 fs_manager.cc:359] Metadata directory not provided
I20260807 04:19:22.407140 23136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:19:22.407495 23136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:19:22.410820 23136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/data/instance:
uuid: "dedf5c84979746fc8dabdf755997edfa"
format_stamp: "Formatted at 2026-08-07 04:19:22 on dist-test-slave-qg60"
server_key: "e60329edbb36256f102c1a1a240fda04"
server_key_iv: "7b10d18fbf7bbe79d9412f3af1c50f7b"
server_key_version: "encryptionkey@0"
I20260807 04:19:22.411676 23136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance:
uuid: "dedf5c84979746fc8dabdf755997edfa"
format_stamp: "Formatted at 2026-08-07 04:19:22 on dist-test-slave-qg60"
server_key: "e60329edbb36256f102c1a1a240fda04"
server_key_iv: "7b10d18fbf7bbe79d9412f3af1c50f7b"
server_key_version: "encryptionkey@0"
I20260807 04:19:22.417452 23136 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260807 04:19:22.421219 23151 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:22.422801 23136 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 04:19:22.422976 23136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "dedf5c84979746fc8dabdf755997edfa"
format_stamp: "Formatted at 2026-08-07 04:19:22 on dist-test-slave-qg60"
server_key: "e60329edbb36256f102c1a1a240fda04"
server_key_iv: "7b10d18fbf7bbe79d9412f3af1c50f7b"
server_key_version: "encryptionkey@0"
I20260807 04:19:22.423216 23136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:19:22.424252 22990 heartbeater.cc:503] Master 127.7.200.254:35593 was elected leader, sending a full tablet report...
I20260807 04:19:22.447297 23136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:19:22.451802 23136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:19:22.452126 23136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:19:22.453258 23136 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:19:22.454710 23136 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:19:22.454824 23136 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:22.454977 23136 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:19:22.455054 23136 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:22.493999 23136 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:41185
I20260807 04:19:22.494017 23267 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:41185 every 8 connection(s)
I20260807 04:19:22.495445 23136 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:19:22.495962 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 23136
I20260807 04:19:22.496212 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance
I20260807 04:19:22.496908 7971 external_mini_cluster.cc:1428] Setting key cc2903c7911c0f453a0630300e25f02e
Aug 07 04:19:22 dist-test-slave-qg60 krb5kdc[22747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076362, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:19:22.517824 23271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:22.498585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:53443 (local address 127.7.200.254:35593)
0807 04:19:22.499118 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:22.499123 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:22.500287 (+ 1164us) server_negotiation.cc:407] Connection header received
0807 04:19:22.502316 (+ 2029us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:22.502320 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:22.502411 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:22.502513 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:22.503958 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:22.504850 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:22.506389 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:22.506816 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:22.506934 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:22.511205 (+ 4271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:22.511211 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:22.511221 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:22.511259 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:22.514845 (+ 3586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:22.515574 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:22.515579 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:22.515581 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:22.515717 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:22.516115 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:22.516119 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:22.516121 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:22.516409 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:22.516551 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:22.517306 (+ 755us) server_negotiation.cc:299] Negotiation successful
0807 04:19:22.517520 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":255,"threads_started":1}
I20260807 04:19:22.518795 23272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:22.499301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.195:53443)
0807 04:19:22.500130 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:22.500173 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:22.502037 (+ 1864us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:22.502712 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:22.502720 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:22.503254 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:19:22.503792 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:22.503809 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:22.504998 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:22.505002 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:22.506245 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:22.506257 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:22.507003 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:22.507008 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:22.507223 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:22.508017 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:19:22.508051 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:19:22.510966 (+ 2915us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:19:22.514996 (+ 4030us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:22.515004 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:22.515019 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:22.515461 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:22.515818 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:22.515822 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:22.515824 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:22.516011 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:22.516529 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:19:22.516535 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:19:22.516945 (+ 410us) client_negotiation.cc:769] Sending connection context
0807 04:19:22.517192 (+ 247us) client_negotiation.cc:240] Negotiation successful
0807 04:19:22.517604 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"thread_start_us":345,"threads_started":1}
I20260807 04:19:22.520368 23268 heartbeater.cc:347] Connected to a master server at 127.7.200.254:35593
I20260807 04:19:22.520682 23268 heartbeater.cc:464] Registering TS with master...
I20260807 04:19:22.521464 23268 heartbeater.cc:511] Master 127.7.200.254:35593 requested a full tablet report, sending...
I20260807 04:19:22.523157 22795 ts_manager.cc:194] Registered new tserver with Master: dedf5c84979746fc8dabdf755997edfa (127.7.200.195:41185)
I20260807 04:19:22.523959 22795 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.195@KRBTEST.COM'} at 127.7.200.195:53443
I20260807 04:19:22.526201 7971 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 04:19:22.548302 23271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:22.530966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56442 (local address 127.7.200.254:35593)
0807 04:19:22.531146 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:22.531150 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:22.531663 (+ 513us) server_negotiation.cc:407] Connection header received
0807 04:19:22.531800 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:22.531803 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:22.531865 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:22.531947 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:22.533431 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:22.534180 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:22.535528 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:22.535895 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:22.535996 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:22.538323 (+ 2327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:22.538328 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:22.538331 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:22.538361 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:22.544120 (+ 5759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:22.545247 (+ 1127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:22.545254 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:22.545260 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:22.545420 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:22.545976 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:22.545983 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:22.546004 (+ 21us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:22.546534 (+ 530us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:22.546816 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:22.547573 (+ 757us) server_negotiation.cc:299] Negotiation successful
0807 04:19:22.547868 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 04:19:22.553256 22795 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56442:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:19:22.560400 22795 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:19:22.600328 23283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:22.575133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:36673 (local address 127.0.0.1:50406)
0807 04:19:22.584630 (+ 9497us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:22.584691 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:22.584929 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:22.588480 (+ 3551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:22.588491 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:22.588547 (+ 56us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:19:22.589106 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:22.589129 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:22.593023 (+ 3894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:22.593031 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:22.596127 (+ 3096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:22.596149 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:22.598951 (+ 2802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:22.598961 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:22.599282 (+ 321us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:22.599367 (+ 85us) client_negotiation.cc:769] Sending connection context
0807 04:19:22.599530 (+ 163us) client_negotiation.cc:240] Negotiation successful
0807 04:19:22.599799 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9165,"thread_start_us":10010,"threads_started":1}
I20260807 04:19:22.602437 23285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:22.575427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50406 (local address 127.7.200.194:36673)
0807 04:19:22.587719 (+ 12292us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:22.587730 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:22.587766 (+ 36us) server_negotiation.cc:407] Connection header received
0807 04:19:22.587881 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:22.587893 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:22.588185 (+ 292us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:22.588584 (+ 399us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:19:22.589383 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:22.592815 (+ 3432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:22.596369 (+ 3554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:22.598345 (+ 1976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:22.598522 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:22.598790 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:22.601752 (+ 2962us) server_negotiation.cc:299] Negotiation successful
0807 04:19:22.602001 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11154,"thread_start_us":11893,"threads_started":1}
I20260807 04:19:22.606371 23286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:22.575488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41894 (local address 127.7.200.193:32971)
0807 04:19:22.587290 (+ 11802us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:22.587302 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:22.592182 (+ 4880us) server_negotiation.cc:407] Connection header received
0807 04:19:22.592561 (+ 379us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:22.592572 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:22.593012 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:22.593599 (+ 587us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:19:22.596704 (+ 3105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:22.598900 (+ 2196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:22.602925 (+ 4025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:22.604765 (+ 1840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:22.604902 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:22.605148 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:22.605854 (+ 706us) server_negotiation.cc:299] Negotiation successful
0807 04:19:22.606034 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11572,"thread_start_us":13251,"threads_started":1}
I20260807 04:19:22.607185 23284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:22.575294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:32971 (local address 127.0.0.1:41894)
0807 04:19:22.592040 (+ 16746us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:22.592064 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:22.592331 (+ 267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:22.594034 (+ 1703us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:22.594043 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:22.594085 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:19:22.596418 (+ 2333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:22.596444 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:22.599153 (+ 2709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:22.599162 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:22.602692 (+ 3530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:22.602714 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:22.605364 (+ 2650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:22.605371 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:22.605608 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:22.605644 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 04:19:22.606596 (+ 952us) client_negotiation.cc:240] Negotiation successful
0807 04:19:22.606752 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16527,"thread_start_us":13865,"threads_started":1}
I20260807 04:19:22.607048 23061 tablet_service.cc:1467] Processing CreateTablet for tablet fc3bcb27ece84efb8df7c8570b8e05fd (DEFAULT_TABLE table=test-table [id=357a4421590b42fc904f23dd86b4287d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:19:22.609978 23061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc3bcb27ece84efb8df7c8570b8e05fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:19:22.611552 22923 tablet_service.cc:1467] Processing CreateTablet for tablet fc3bcb27ece84efb8df7c8570b8e05fd (DEFAULT_TABLE table=test-table [id=357a4421590b42fc904f23dd86b4287d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:19:22.613282 22923 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc3bcb27ece84efb8df7c8570b8e05fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:19:22.614697 23283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:22.579001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:41185 (local address 127.0.0.1:57000)
0807 04:19:22.603841 (+ 24840us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:22.603866 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:22.603987 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:22.605937 (+ 1950us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:22.605946 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:22.605984 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:19:22.606213 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:22.606225 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:22.609490 (+ 3265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:22.609498 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:22.611443 (+ 1945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:22.611461 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:22.613866 (+ 2405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:22.613874 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:22.614070 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:22.614124 (+ 54us) client_negotiation.cc:769] Sending connection context
0807 04:19:22.614221 (+ 97us) client_negotiation.cc:240] Negotiation successful
0807 04:19:22.614361 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24696,"thread_start_us":29382,"threads_started":1}
I20260807 04:19:22.615731 23288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:22.579795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57000 (local address 127.7.200.195:41185)
0807 04:19:22.604816 (+ 25021us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:22.604828 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:22.604879 (+ 51us) server_negotiation.cc:407] Connection header received
0807 04:19:22.605000 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:22.605013 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:22.605323 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:22.605547 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:19:22.608002 (+ 2455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:22.609336 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:22.611673 (+ 2337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:22.613278 (+ 1605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:22.613507 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:22.613769 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:22.615222 (+ 1453us) server_negotiation.cc:299] Negotiation successful
0807 04:19:22.615388 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24785,"thread_start_us":24602,"threads_started":1}
I20260807 04:19:22.619812 23200 tablet_service.cc:1467] Processing CreateTablet for tablet fc3bcb27ece84efb8df7c8570b8e05fd (DEFAULT_TABLE table=test-table [id=357a4421590b42fc904f23dd86b4287d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:19:22.621424 23200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc3bcb27ece84efb8df7c8570b8e05fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:19:22.633713 23290 tablet_bootstrap.cc:492] T fc3bcb27ece84efb8df7c8570b8e05fd P d2c61112bec14a61ae16ca15538b1eaa: Bootstrap starting.
I20260807 04:19:22.639958 23289 tablet_bootstrap.cc:492] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96: Bootstrap starting.
I20260807 04:19:22.642083 23290 tablet_bootstrap.cc:654] T fc3bcb27ece84efb8df7c8570b8e05fd P d2c61112bec14a61ae16ca15538b1eaa: Neither blocks nor log segments found. Creating new log.
I20260807 04:19:22.643605 23290 log.cc:824] T fc3bcb27ece84efb8df7c8570b8e05fd P d2c61112bec14a61ae16ca15538b1eaa: Log is configured to *not* fsync() on all Append() calls
I20260807 04:19:22.645038 23291 tablet_bootstrap.cc:492] T fc3bcb27ece84efb8df7c8570b8e05fd P dedf5c84979746fc8dabdf755997edfa: Bootstrap starting.
I20260807 04:19:22.645084 23289 tablet_bootstrap.cc:654] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96: Neither blocks nor log segments found. Creating new log.
I20260807 04:19:22.646502 23289 log.cc:824] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96: Log is configured to *not* fsync() on all Append() calls
I20260807 04:19:22.649756 23290 tablet_bootstrap.cc:492] T fc3bcb27ece84efb8df7c8570b8e05fd P d2c61112bec14a61ae16ca15538b1eaa: No bootstrap required, opened a new log
I20260807 04:19:22.650220 23290 ts_tablet_manager.cc:1397] T fc3bcb27ece84efb8df7c8570b8e05fd P d2c61112bec14a61ae16ca15538b1eaa: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.004s
I20260807 04:19:22.650840 23291 tablet_bootstrap.cc:654] T fc3bcb27ece84efb8df7c8570b8e05fd P dedf5c84979746fc8dabdf755997edfa: Neither blocks nor log segments found. Creating new log.
I20260807 04:19:22.652259 23291 log.cc:824] T fc3bcb27ece84efb8df7c8570b8e05fd P dedf5c84979746fc8dabdf755997edfa: Log is configured to *not* fsync() on all Append() calls
I20260807 04:19:22.656267 23289 tablet_bootstrap.cc:492] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96: No bootstrap required, opened a new log
I20260807 04:19:22.656632 23289 ts_tablet_manager.cc:1397] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.007s
I20260807 04:19:22.664487 23290 raft_consensus.cc:348] T fc3bcb27ece84efb8df7c8570b8e05fd P d2c61112bec14a61ae16ca15538b1eaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f26855a5584d049517b1071b164d96" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36673 } } peers { permanent_uuid: "d2c61112bec14a61ae16ca15538b1eaa" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32971 } } peers { permanent_uuid: "dedf5c84979746fc8dabdf755997edfa" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41185 } }
I20260807 04:19:22.665095 23290 raft_consensus.cc:374] T fc3bcb27ece84efb8df7c8570b8e05fd P d2c61112bec14a61ae16ca15538b1eaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:19:22.665236 23290 raft_consensus.cc:729] T fc3bcb27ece84efb8df7c8570b8e05fd P d2c61112bec14a61ae16ca15538b1eaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2c61112bec14a61ae16ca15538b1eaa, State: Initialized, Role: FOLLOWER
I20260807 04:19:22.666061 23290 consensus_queue.cc:260] T fc3bcb27ece84efb8df7c8570b8e05fd P d2c61112bec14a61ae16ca15538b1eaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f26855a5584d049517b1071b164d96" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36673 } } peers { permanent_uuid: "d2c61112bec14a61ae16ca15538b1eaa" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32971 } } peers { permanent_uuid: "dedf5c84979746fc8dabdf755997edfa" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41185 } }
I20260807 04:19:22.668329 23291 tablet_bootstrap.cc:492] T fc3bcb27ece84efb8df7c8570b8e05fd P dedf5c84979746fc8dabdf755997edfa: No bootstrap required, opened a new log
I20260807 04:19:22.668723 23291 ts_tablet_manager.cc:1397] T fc3bcb27ece84efb8df7c8570b8e05fd P dedf5c84979746fc8dabdf755997edfa: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.013s
I20260807 04:19:22.671348 23289 raft_consensus.cc:348] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f26855a5584d049517b1071b164d96" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36673 } } peers { permanent_uuid: "d2c61112bec14a61ae16ca15538b1eaa" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32971 } } peers { permanent_uuid: "dedf5c84979746fc8dabdf755997edfa" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41185 } }
I20260807 04:19:22.672034 23289 raft_consensus.cc:374] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:19:22.672178 23289 raft_consensus.cc:729] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95f26855a5584d049517b1071b164d96, State: Initialized, Role: FOLLOWER
I20260807 04:19:22.673235 23289 consensus_queue.cc:260] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f26855a5584d049517b1071b164d96" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36673 } } peers { permanent_uuid: "d2c61112bec14a61ae16ca15538b1eaa" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32971 } } peers { permanent_uuid: "dedf5c84979746fc8dabdf755997edfa" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41185 } }
I20260807 04:19:22.675657 23290 ts_tablet_manager.cc:1428] T fc3bcb27ece84efb8df7c8570b8e05fd P d2c61112bec14a61ae16ca15538b1eaa: Time spent starting tablet: real 0.025s user 0.021s sys 0.004s
I20260807 04:19:22.679934 23129 heartbeater.cc:503] Master 127.7.200.254:35593 was elected leader, sending a full tablet report...
I20260807 04:19:22.681310 23289 ts_tablet_manager.cc:1428] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96: Time spent starting tablet: real 0.025s user 0.012s sys 0.008s
I20260807 04:19:22.682752 23291 raft_consensus.cc:348] T fc3bcb27ece84efb8df7c8570b8e05fd P dedf5c84979746fc8dabdf755997edfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f26855a5584d049517b1071b164d96" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36673 } } peers { permanent_uuid: "d2c61112bec14a61ae16ca15538b1eaa" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32971 } } peers { permanent_uuid: "dedf5c84979746fc8dabdf755997edfa" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41185 } }
I20260807 04:19:22.683370 23291 raft_consensus.cc:374] T fc3bcb27ece84efb8df7c8570b8e05fd P dedf5c84979746fc8dabdf755997edfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:19:22.683525 23291 raft_consensus.cc:729] T fc3bcb27ece84efb8df7c8570b8e05fd P dedf5c84979746fc8dabdf755997edfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dedf5c84979746fc8dabdf755997edfa, State: Initialized, Role: FOLLOWER
I20260807 04:19:22.684230 23291 consensus_queue.cc:260] T fc3bcb27ece84efb8df7c8570b8e05fd P dedf5c84979746fc8dabdf755997edfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f26855a5584d049517b1071b164d96" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36673 } } peers { permanent_uuid: "d2c61112bec14a61ae16ca15538b1eaa" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32971 } } peers { permanent_uuid: "dedf5c84979746fc8dabdf755997edfa" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41185 } }
W20260807 04:19:22.689440 23130 tablet.cc:2369] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:19:22.689618 23268 heartbeater.cc:503] Master 127.7.200.254:35593 was elected leader, sending a full tablet report...
I20260807 04:19:22.690335 23291 ts_tablet_manager.cc:1428] T fc3bcb27ece84efb8df7c8570b8e05fd P dedf5c84979746fc8dabdf755997edfa: Time spent starting tablet: real 0.021s user 0.010s sys 0.009s
I20260807 04:19:22.690970 23297 raft_consensus.cc:482] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:19:22.691241 23297 raft_consensus.cc:504] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f26855a5584d049517b1071b164d96" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36673 } } peers { permanent_uuid: "d2c61112bec14a61ae16ca15538b1eaa" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32971 } } peers { permanent_uuid: "dedf5c84979746fc8dabdf755997edfa" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41185 } }
I20260807 04:19:22.696894 23297 leader_election.cc:288] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2c61112bec14a61ae16ca15538b1eaa (127.7.200.193:32971), dedf5c84979746fc8dabdf755997edfa (127.7.200.195:41185)
I20260807 04:19:22.709870 23286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:22.693821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:34567 (local address 127.7.200.193:32971)
0807 04:19:22.694004 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:22.694012 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:22.702597 (+ 8585us) server_negotiation.cc:407] Connection header received
0807 04:19:22.702819 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:22.702827 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:22.702913 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:22.703011 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:19:22.703518 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:22.704260 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:22.706968 (+ 2708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:22.708948 (+ 1980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:22.709158 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:22.709274 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:22.709467 (+ 193us) server_negotiation.cc:299] Negotiation successful
0807 04:19:22.709603 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 04:19:22.709950 23299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:22.693314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:32971 (local address 127.7.200.194:34567)
0807 04:19:22.702424 (+ 9110us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:22.702464 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:22.702654 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:22.703024 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:22.703029 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:22.703051 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:19:22.703374 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:22.703382 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:22.704399 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:22.704405 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:22.706751 (+ 2346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:22.706772 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:22.709172 (+ 2400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:22.709176 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:22.709291 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:22.709317 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 04:19:22.709433 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 04:19:22.709570 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8922,"thread_start_us":7693,"threads_started":1}
I20260807 04:19:22.710865 22943 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc3bcb27ece84efb8df7c8570b8e05fd" candidate_uuid: "95f26855a5584d049517b1071b164d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2c61112bec14a61ae16ca15538b1eaa" is_pre_election: true
I20260807 04:19:22.711449 22943 raft_consensus.cc:2454] T fc3bcb27ece84efb8df7c8570b8e05fd P d2c61112bec14a61ae16ca15538b1eaa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95f26855a5584d049517b1071b164d96 in term 0.
I20260807 04:19:22.712198 23288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:22.693774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:36455 (local address 127.7.200.195:41185)
0807 04:19:22.693967 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:22.693973 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:22.701639 (+ 7666us) server_negotiation.cc:407] Connection header received
0807 04:19:22.701889 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:22.701897 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:22.702000 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:22.702105 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:19:22.702924 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:22.704517 (+ 1593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:22.709385 (+ 4868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:22.711131 (+ 1746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:22.711345 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:22.711462 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:22.711809 (+ 347us) server_negotiation.cc:299] Negotiation successful
0807 04:19:22.711961 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 04:19:22.712216 23014 leader_election.cc:302] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95f26855a5584d049517b1071b164d96, d2c61112bec14a61ae16ca15538b1eaa; no voters:
I20260807 04:19:22.712678 23297 raft_consensus.cc:2781] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:19:22.712931 23297 raft_consensus.cc:482] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:19:22.713091 23300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:22.693218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:41185 (local address 127.7.200.194:36455)
0807 04:19:22.701481 (+ 8263us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:22.701509 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:22.701708 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:22.702287 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:22.702291 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:22.702312 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:19:22.702679 (+ 367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:22.702690 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:22.704667 (+ 1977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:22.704674 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:22.706781 (+ 2107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:22.706789 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:22.711371 (+ 4582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:22.711380 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:22.711600 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:22.711636 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 04:19:22.712448 (+ 812us) client_negotiation.cc:240] Negotiation successful
0807 04:19:22.712611 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8059,"mutex_wait_us":1,"thread_start_us":8786,"threads_started":1}
I20260807 04:19:22.713088 23297 raft_consensus.cc:3037] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:19:22.714118 23222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc3bcb27ece84efb8df7c8570b8e05fd" candidate_uuid: "95f26855a5584d049517b1071b164d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dedf5c84979746fc8dabdf755997edfa" is_pre_election: true
I20260807 04:19:22.714598 23222 raft_consensus.cc:2454] T fc3bcb27ece84efb8df7c8570b8e05fd P dedf5c84979746fc8dabdf755997edfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95f26855a5584d049517b1071b164d96 in term 0.
I20260807 04:19:22.717618 23297 raft_consensus.cc:504] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f26855a5584d049517b1071b164d96" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36673 } } peers { permanent_uuid: "d2c61112bec14a61ae16ca15538b1eaa" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32971 } } peers { permanent_uuid: "dedf5c84979746fc8dabdf755997edfa" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41185 } }
I20260807 04:19:22.718713 23297 leader_election.cc:288] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96 [CANDIDATE]: Term 1 election: Requested vote from peers d2c61112bec14a61ae16ca15538b1eaa (127.7.200.193:32971), dedf5c84979746fc8dabdf755997edfa (127.7.200.195:41185)
I20260807 04:19:22.719142 23222 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc3bcb27ece84efb8df7c8570b8e05fd" candidate_uuid: "95f26855a5584d049517b1071b164d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dedf5c84979746fc8dabdf755997edfa"
I20260807 04:19:22.719161 22943 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc3bcb27ece84efb8df7c8570b8e05fd" candidate_uuid: "95f26855a5584d049517b1071b164d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2c61112bec14a61ae16ca15538b1eaa"
I20260807 04:19:22.719345 23222 raft_consensus.cc:3037] T fc3bcb27ece84efb8df7c8570b8e05fd P dedf5c84979746fc8dabdf755997edfa [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:19:22.719439 22943 raft_consensus.cc:3037] T fc3bcb27ece84efb8df7c8570b8e05fd P d2c61112bec14a61ae16ca15538b1eaa [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:19:22.721818 23222 raft_consensus.cc:2454] T fc3bcb27ece84efb8df7c8570b8e05fd P dedf5c84979746fc8dabdf755997edfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95f26855a5584d049517b1071b164d96 in term 1.
I20260807 04:19:22.722316 23015 leader_election.cc:302] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95f26855a5584d049517b1071b164d96, dedf5c84979746fc8dabdf755997edfa; no voters:
I20260807 04:19:22.722609 23297 raft_consensus.cc:2781] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:19:22.723307 23297 raft_consensus.cc:686] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96 [term 1 LEADER]: Becoming Leader. State: Replica: 95f26855a5584d049517b1071b164d96, State: Running, Role: LEADER
I20260807 04:19:22.723889 23297 consensus_queue.cc:237] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f26855a5584d049517b1071b164d96" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36673 } } peers { permanent_uuid: "d2c61112bec14a61ae16ca15538b1eaa" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32971 } } peers { permanent_uuid: "dedf5c84979746fc8dabdf755997edfa" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41185 } }
I20260807 04:19:22.729794 22943 raft_consensus.cc:2454] T fc3bcb27ece84efb8df7c8570b8e05fd P d2c61112bec14a61ae16ca15538b1eaa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95f26855a5584d049517b1071b164d96 in term 1.
I20260807 04:19:22.729252 22794 catalog_manager.cc:5495] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95f26855a5584d049517b1071b164d96 (127.7.200.194). New cstate: current_term: 1 leader_uuid: "95f26855a5584d049517b1071b164d96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f26855a5584d049517b1071b164d96" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2c61112bec14a61ae16ca15538b1eaa" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dedf5c84979746fc8dabdf755997edfa" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41185 } health_report { overall_health: UNKNOWN } } }
W20260807 04:19:22.747498 23270 tablet.cc:2369] T fc3bcb27ece84efb8df7c8570b8e05fd P dedf5c84979746fc8dabdf755997edfa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:19:22.765173 23285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:22.757441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50420 (local address 127.7.200.194:36673)
0807 04:19:22.757696 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:22.757702 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:22.757724 (+ 22us) server_negotiation.cc:407] Connection header received
0807 04:19:22.757954 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:22.757964 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:22.758123 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:22.758325 (+ 202us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:19:22.758809 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:22.760305 (+ 1496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:22.761882 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:22.762801 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:22.762998 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:22.763502 (+ 504us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:19:22.764355 (+ 853us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:19:22.764552 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:22.764613 (+ 61us) server_negotiation.cc:299] Negotiation successful
0807 04:19:22.764766 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 04:19:22.773840 22943 raft_consensus.cc:1261] T fc3bcb27ece84efb8df7c8570b8e05fd P d2c61112bec14a61ae16ca15538b1eaa [term 1 FOLLOWER]: Refusing update from remote peer 95f26855a5584d049517b1071b164d96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:19:22.774128 23222 raft_consensus.cc:1261] T fc3bcb27ece84efb8df7c8570b8e05fd P dedf5c84979746fc8dabdf755997edfa [term 1 FOLLOWER]: Refusing update from remote peer 95f26855a5584d049517b1071b164d96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:19:22.774880 23301 consensus_queue.cc:1035] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2c61112bec14a61ae16ca15538b1eaa" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:19:22.775295 23297 consensus_queue.cc:1035] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dedf5c84979746fc8dabdf755997edfa" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:19:22.791741 23304 mvcc.cc:205] Tried to move back new op lower bound from 7315768781911097344 to 7315768781721624576. Current Snapshot: MvccSnapshot[applied={T|T < 7315768781911097344}]
I20260807 04:19:22.814925 22794 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56442:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:19:22.815294 22794 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56442:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:19:22.820168 22794 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0: Sending DeleteTablet for 3 replicas of tablet fc3bcb27ece84efb8df7c8570b8e05fd
I20260807 04:19:22.821583 22923 tablet_service.cc:1514] Processing DeleteTablet for tablet fc3bcb27ece84efb8df7c8570b8e05fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:19:22 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:41894
I20260807 04:19:22.821624 23061 tablet_service.cc:1514] Processing DeleteTablet for tablet fc3bcb27ece84efb8df7c8570b8e05fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:19:22 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:50406
I20260807 04:19:22.825807 23200 tablet_service.cc:1514] Processing DeleteTablet for tablet fc3bcb27ece84efb8df7c8570b8e05fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:19:22 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:57000
I20260807 04:19:22.826331 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 22858
I20260807 04:19:22.834595 23313 tablet_replica.cc:330] T fc3bcb27ece84efb8df7c8570b8e05fd P d2c61112bec14a61ae16ca15538b1eaa: stopping tablet replica
I20260807 04:19:22.835140 23313 raft_consensus.cc:2229] T fc3bcb27ece84efb8df7c8570b8e05fd P d2c61112bec14a61ae16ca15538b1eaa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:19:22.835778 23313 raft_consensus.cc:2258] T fc3bcb27ece84efb8df7c8570b8e05fd P d2c61112bec14a61ae16ca15538b1eaa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:19:22.836704 23314 tablet_replica.cc:330] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96: stopping tablet replica
I20260807 04:19:22.837386 23314 raft_consensus.cc:2229] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96 [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:19:22.838387 23314 raft_consensus.cc:2258] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:19:22.839357 23315 tablet_replica.cc:330] T fc3bcb27ece84efb8df7c8570b8e05fd P dedf5c84979746fc8dabdf755997edfa: stopping tablet replica
I20260807 04:19:22.841993 23314 ts_tablet_manager.cc:1905] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:19:22.842017 23313 ts_tablet_manager.cc:1905] T fc3bcb27ece84efb8df7c8570b8e05fd P d2c61112bec14a61ae16ca15538b1eaa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:19:22.850613 23313 ts_tablet_manager.cc:1918] T fc3bcb27ece84efb8df7c8570b8e05fd P d2c61112bec14a61ae16ca15538b1eaa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:19:22.850852 23313 log.cc:1196] T fc3bcb27ece84efb8df7c8570b8e05fd P d2c61112bec14a61ae16ca15538b1eaa: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/wal/wals/fc3bcb27ece84efb8df7c8570b8e05fd
I20260807 04:19:22.851475 23314 ts_tablet_manager.cc:1918] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:19:22.851521 23313 ts_tablet_manager.cc:1939] T fc3bcb27ece84efb8df7c8570b8e05fd P d2c61112bec14a61ae16ca15538b1eaa: Deleting consensus metadata
I20260807 04:19:22.851828 23314 log.cc:1196] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/wal/wals/fc3bcb27ece84efb8df7c8570b8e05fd
I20260807 04:19:22.852717 23314 ts_tablet_manager.cc:1939] T fc3bcb27ece84efb8df7c8570b8e05fd P 95f26855a5584d049517b1071b164d96: Deleting consensus metadata
I20260807 04:19:22.852957 23315 raft_consensus.cc:2229] T fc3bcb27ece84efb8df7c8570b8e05fd P dedf5c84979746fc8dabdf755997edfa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:19:22.853605 23315 raft_consensus.cc:2258] T fc3bcb27ece84efb8df7c8570b8e05fd P dedf5c84979746fc8dabdf755997edfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:19:22.855008 22782 catalog_manager.cc:4841] TS 95f26855a5584d049517b1071b164d96 (127.7.200.194:36673): tablet fc3bcb27ece84efb8df7c8570b8e05fd (table test-table [id=357a4421590b42fc904f23dd86b4287d]) successfully deleted
I20260807 04:19:22.856016 23315 ts_tablet_manager.cc:1905] T fc3bcb27ece84efb8df7c8570b8e05fd P dedf5c84979746fc8dabdf755997edfa: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 07 04:19:22 dist-test-slave-qg60 krb5kdc[22747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076360, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.193@KRBTEST.COM
I20260807 04:19:22.864557 23315 ts_tablet_manager.cc:1918] T fc3bcb27ece84efb8df7c8570b8e05fd P dedf5c84979746fc8dabdf755997edfa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:19:22.865904 22780 catalog_manager.cc:4841] TS d2c61112bec14a61ae16ca15538b1eaa (127.7.200.193:32971): tablet fc3bcb27ece84efb8df7c8570b8e05fd (table test-table [id=357a4421590b42fc904f23dd86b4287d]) successfully deleted
I20260807 04:19:22.866358 23315 log.cc:1196] T fc3bcb27ece84efb8df7c8570b8e05fd P dedf5c84979746fc8dabdf755997edfa: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/wal/wals/fc3bcb27ece84efb8df7c8570b8e05fd
I20260807 04:19:22.867066 23315 ts_tablet_manager.cc:1939] T fc3bcb27ece84efb8df7c8570b8e05fd P dedf5c84979746fc8dabdf755997edfa: Deleting consensus metadata
I20260807 04:19:22.869299 22781 catalog_manager.cc:4841] TS dedf5c84979746fc8dabdf755997edfa (127.7.200.195:41185): tablet fc3bcb27ece84efb8df7c8570b8e05fd (table test-table [id=357a4421590b42fc904f23dd86b4287d]) successfully deleted
I20260807 04:19:22.871112 23286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:22.827858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41904 (local address 127.7.200.193:32971)
0807 04:19:22.828101 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:22.828110 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:22.839737 (+ 11627us) server_negotiation.cc:407] Connection header received
0807 04:19:22.840112 (+ 375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:22.840126 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:22.840232 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:22.840318 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:22.844874 (+ 4556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:22.846145 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:22.853090 (+ 6945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:22.853883 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:22.854017 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:22.861385 (+ 7368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:22.861407 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:22.861427 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:22.861497 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:22.866183 (+ 4686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:22.867664 (+ 1481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:22.867674 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:22.867678 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:22.867870 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:22.868526 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:22.868533 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:22.868539 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:22.869194 (+ 655us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:22.869696 (+ 502us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:22.870353 (+ 657us) server_negotiation.cc:299] Negotiation successful
0807 04:19:22.870605 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260807 04:19:22.871935 22985 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:19:22.982877 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 22858
I20260807 04:19:23.004316 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 22997
Aug 07 04:19:23 dist-test-slave-qg60 krb5kdc[22747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076360, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.194@KRBTEST.COM
I20260807 04:19:23.023188 23285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:23.005251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50434 (local address 127.7.200.194:36673)
0807 04:19:23.005481 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:23.005487 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:23.005511 (+ 24us) server_negotiation.cc:407] Connection header received
0807 04:19:23.005594 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:23.005599 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:23.005690 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:23.005806 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:23.007195 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:23.008485 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:23.010265 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:23.010983 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:23.011120 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:23.015693 (+ 4573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:23.015713 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:23.015736 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:23.015787 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:23.020074 (+ 4287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:23.020845 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:23.020855 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:23.020859 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:23.021037 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:23.021428 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:23.021433 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:23.021436 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:23.021935 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:23.022327 (+ 392us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:23.022526 (+ 199us) server_negotiation.cc:299] Negotiation successful
0807 04:19:23.022783 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 04:19:23.023936 23123 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:19:23.145763 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 22997
I20260807 04:19:23.168264 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 23136
Aug 07 04:19:23 dist-test-slave-qg60 krb5kdc[22747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076360, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.195@KRBTEST.COM
I20260807 04:19:23.185587 23288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:23.169107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57010 (local address 127.7.200.195:41185)
0807 04:19:23.169369 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:23.169376 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:23.169538 (+ 162us) server_negotiation.cc:407] Connection header received
0807 04:19:23.169646 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:23.169650 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:23.169779 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:23.169879 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:23.171194 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:23.171944 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:23.173702 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:23.174137 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:23.174240 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:23.179419 (+ 5179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:23.179435 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:23.179453 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:23.179515 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:23.182478 (+ 2963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:23.183193 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:23.183200 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:23.183203 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:23.183342 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:23.183809 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:23.183817 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:23.183822 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:23.184251 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:23.184576 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:23.184942 (+ 366us) server_negotiation.cc:299] Negotiation successful
0807 04:19:23.185197 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260807 04:19:23.186257 23263 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:19:23.282130 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 23136
I20260807 04:19:23.301863 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 22762
I20260807 04:19:23.303066 22825 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:19:23.416137 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 22762
I20260807 04:19:23.441510 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:35593
--webserver_interface=127.7.200.254
--webserver_port=37927
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:44791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:35593
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:19:23.790549 23321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:19:23.790941 23321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:19:23.791109 23321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:19:23.798766 23321 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:19:23.798966 23321 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:19:23.799078 23321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:19:23.799190 23321 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:19:23.799270 23321 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:19:23.809867 23321 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:44791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:35593
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:35593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=37927
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:19:23.811348 23321 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:19:23.812747 23321 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:19:23.841531 23327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:23.841533 23328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:23.841741 23330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:23.842234 23321 server_base.cc:1034] running on GCE node
I20260807 04:19:23.843413 23321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:19:23.845109 23321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:19:23.846324 23321 hybrid_clock.cc:648] HybridClock initialized: now 1786076363846250 us; error 59 us; skew 500 ppm
I20260807 04:19:23.846760 23321 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:19:23 dist-test-slave-qg60 krb5kdc[22747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076363, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:19:23.850636 23321 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:19:23.852519 23321 webserver.cc:460] Webserver started at http://127.7.200.254:37927/ using document root <none> and password file <none>
I20260807 04:19:23.853408 23321 fs_manager.cc:359] Metadata directory not provided
I20260807 04:19:23.853576 23321 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:19:23.860282 23321 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.004s
I20260807 04:19:23.863564 23337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:23.865154 23321 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 04:19:23.865346 23321 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "ec1cd6ccd087498cbe67569501ab58c0"
format_stamp: "Formatted at 2026-08-07 04:19:20 on dist-test-slave-qg60"
server_key: "4c5a6a5e49e556c8156f6529eed26947"
server_key_iv: "44babfb858bce08f139481a65d540513"
server_key_version: "encryptionkey@0"
I20260807 04:19:23.866449 23321 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:19:23.898362 23321 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:19:23.903445 23321 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:19:23.903786 23321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:19:23.926493 23321 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:35593
I20260807 04:19:23.926467 23388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:35593 every 8 connection(s)
I20260807 04:19:23.928340 23321 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:19:23.933320 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 23321
I20260807 04:19:23.934286 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:32971
--local_ip_for_outbound_sockets=127.7.200.193
--tserver_master_addrs=127.7.200.254:35593
--webserver_port=44841
--webserver_interface=127.7.200.193
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:44791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 04:19:23.936064 23389 sys_catalog.cc:263] Verifying existing consensus state
I20260807 04:19:23.939543 23389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0: Bootstrap starting.
I20260807 04:19:23.960001 23389 log.cc:824] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0: Log is configured to *not* fsync() on all Append() calls
I20260807 04:19:23.972680 23389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 04:19:23.973306 23389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0: Bootstrap complete.
I20260807 04:19:23.982915 23389 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec1cd6ccd087498cbe67569501ab58c0" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 35593 } }
I20260807 04:19:23.983839 23389 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec1cd6ccd087498cbe67569501ab58c0, State: Initialized, Role: FOLLOWER
I20260807 04:19:23.984469 23389 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec1cd6ccd087498cbe67569501ab58c0" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 35593 } }
I20260807 04:19:23.984795 23389 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:19:23.984958 23389 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:19:23.985158 23389 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [term 1 FOLLOWER]: Advancing to term 2
I20260807 04:19:23.989334 23389 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec1cd6ccd087498cbe67569501ab58c0" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 35593 } }
I20260807 04:19:23.989902 23389 leader_election.cc:302] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec1cd6ccd087498cbe67569501ab58c0; no voters:
I20260807 04:19:23.990603 23389 leader_election.cc:288] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 04:19:23.990747 23393 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 04:19:23.992039 23393 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [term 2 LEADER]: Becoming Leader. State: Replica: ec1cd6ccd087498cbe67569501ab58c0, State: Running, Role: LEADER
I20260807 04:19:23.992686 23393 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec1cd6ccd087498cbe67569501ab58c0" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 35593 } }
I20260807 04:19:23.993114 23389 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:19:23.995515 23394 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ec1cd6ccd087498cbe67569501ab58c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec1cd6ccd087498cbe67569501ab58c0" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 35593 } } }
I20260807 04:19:23.996011 23394 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [sys.catalog]: This master's current role is: LEADER
I20260807 04:19:23.999917 23395 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec1cd6ccd087498cbe67569501ab58c0. Latest consensus state: current_term: 2 leader_uuid: "ec1cd6ccd087498cbe67569501ab58c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec1cd6ccd087498cbe67569501ab58c0" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 35593 } } }
I20260807 04:19:24.000272 23395 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [sys.catalog]: This master's current role is: LEADER
I20260807 04:19:24.002144 23398 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:19:24.012635 23398 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:19:24.014572 23398 catalog_manager.cc:1259] Loaded cluster ID: 66fb6c76f93e4cd6bd6bf7a9369bc717
I20260807 04:19:24.014710 23398 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:19:24.019066 23398 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260807 04:19:24.041242 23398 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260807 04:19:24.048691 23398 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:19:24.050122 23398 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0: Loaded TSK: 0
I20260807 04:19:24.051214 23398 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 04:19:24.339214 23391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:19:24.339563 23391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:19:24.339737 23391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:19:24.347470 23391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:19:24.347640 23391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:19:24.347831 23391 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:19:24.358206 23391 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:44791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:32971
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=44841
--tserver_master_addrs=127.7.200.254:35593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:19:24.359591 23391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:19:24.361025 23391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:19:24.375322 23417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:24.375385 23419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:24.376180 23416 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:24.376809 23391 server_base.cc:1034] running on GCE node
I20260807 04:19:24.377441 23391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:19:24.378487 23391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:19:24.379714 23391 hybrid_clock.cc:648] HybridClock initialized: now 1786076364379668 us; error 40 us; skew 500 ppm
I20260807 04:19:24.380050 23391 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:19:24 dist-test-slave-qg60 krb5kdc[22747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076364, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:19:24.383473 23391 init.cc:377] Logged in from keytab as kudu/127.7.200.193@KRBTEST.COM (short username kudu)
I20260807 04:19:24.385155 23391 webserver.cc:460] Webserver started at http://127.7.200.193:44841/ using document root <none> and password file <none>
I20260807 04:19:24.385867 23391 fs_manager.cc:359] Metadata directory not provided
I20260807 04:19:24.386042 23391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:19:24.391898 23391 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 04:19:24.395020 23427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:24.396526 23391 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 04:19:24.396710 23391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "d2c61112bec14a61ae16ca15538b1eaa"
format_stamp: "Formatted at 2026-08-07 04:19:21 on dist-test-slave-qg60"
server_key: "b857994cab454b685b6fa78a57a57afb"
server_key_iv: "00994403a20cbc3ab5a6e104461850cd"
server_key_version: "encryptionkey@0"
I20260807 04:19:24.397804 23391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:19:24.411195 23391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:19:24.415577 23391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:19:24.415884 23391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:19:24.417040 23391 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:19:24.418444 23391 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:19:24.418535 23391 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:24.418681 23391 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:19:24.418779 23391 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:24.454257 23391 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:32971
I20260807 04:19:24.454350 23542 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:32971 every 8 connection(s)
I20260807 04:19:24.455762 23391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:19:24.457202 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 23391
I20260807 04:19:24.458071 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:36673
--local_ip_for_outbound_sockets=127.7.200.194
--tserver_master_addrs=127.7.200.254:35593
--webserver_port=46667
--webserver_interface=127.7.200.194
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:44791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 04:19:24 dist-test-slave-qg60 krb5kdc[22747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076364, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:19:24.484946 23545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:24.459199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:35033 (local address 127.7.200.254:35593)
0807 04:19:24.459951 (+ 752us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:24.459969 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:24.461565 (+ 1596us) server_negotiation.cc:407] Connection header received
0807 04:19:24.463809 (+ 2244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:24.463828 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:24.464265 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:24.464686 (+ 421us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:24.466184 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:24.468135 (+ 1951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:24.470300 (+ 2165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:24.471220 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:24.471355 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:24.476166 (+ 4811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:24.476175 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:24.476191 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:24.476237 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:24.479380 (+ 3143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:24.480454 (+ 1074us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:24.480462 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:24.480467 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:24.480649 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:24.481216 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:24.481220 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:24.481222 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:24.481752 (+ 530us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:24.481913 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:24.483037 (+ 1124us) server_negotiation.cc:299] Negotiation successful
0807 04:19:24.483526 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":500,"thread_start_us":321,"threads_started":1}
I20260807 04:19:24.485044 23546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:24.459421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.193:35033)
0807 04:19:24.461357 (+ 1936us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:24.461404 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:24.463216 (+ 1812us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:24.464833 (+ 1617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:24.464840 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:24.465375 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:19:24.465916 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:24.465933 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:24.468321 (+ 2388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:24.468326 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:24.470114 (+ 1788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:24.470133 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:24.471464 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:24.471474 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:24.471797 (+ 323us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:24.472573 (+ 776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:19:24.472607 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:19:24.475814 (+ 3207us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:19:24.479562 (+ 3748us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:24.479575 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:24.479595 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:24.480304 (+ 709us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:24.480805 (+ 501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:24.480813 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:24.480819 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:24.481086 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:24.481910 (+ 824us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:19:24.481921 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:19:24.482401 (+ 480us) client_negotiation.cc:769] Sending connection context
0807 04:19:24.482752 (+ 351us) client_negotiation.cc:240] Negotiation successful
0807 04:19:24.483445 (+ 693us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1638,"thread_start_us":1382,"threads_started":1}
I20260807 04:19:24.488782 23543 heartbeater.cc:347] Connected to a master server at 127.7.200.254:35593
I20260807 04:19:24.489195 23543 heartbeater.cc:464] Registering TS with master...
I20260807 04:19:24.489993 23543 heartbeater.cc:511] Master 127.7.200.254:35593 requested a full tablet report, sending...
I20260807 04:19:24.492470 23354 ts_manager.cc:194] Registered new tserver with Master: d2c61112bec14a61ae16ca15538b1eaa (127.7.200.193:32971)
I20260807 04:19:24.494154 23354 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.193@KRBTEST.COM'} at 127.7.200.193:35033
W20260807 04:19:24.811251 23547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:19:24.811587 23547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:19:24.811765 23547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:19:24.819154 23547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:19:24.819319 23547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:19:24.819502 23547 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:19:24.830168 23547 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:44791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:36673
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=46667
--tserver_master_addrs=127.7.200.254:35593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:19:24.831502 23547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:19:24.832891 23547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:19:24.846196 23552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:24.846272 23555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:24.846267 23553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:24.847308 23547 server_base.cc:1034] running on GCE node
I20260807 04:19:24.847934 23547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:19:24.849005 23547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:19:24.850236 23547 hybrid_clock.cc:648] HybridClock initialized: now 1786076364850204 us; error 36 us; skew 500 ppm
I20260807 04:19:24.850598 23547 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:19:24 dist-test-slave-qg60 krb5kdc[22747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076364, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:19:24.853927 23547 init.cc:377] Logged in from keytab as kudu/127.7.200.194@KRBTEST.COM (short username kudu)
I20260807 04:19:24.855504 23547 webserver.cc:460] Webserver started at http://127.7.200.194:46667/ using document root <none> and password file <none>
I20260807 04:19:24.856261 23547 fs_manager.cc:359] Metadata directory not provided
I20260807 04:19:24.856429 23547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:19:24.862130 23547 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 04:19:24.864941 23563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:24.866360 23547 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:19:24.866571 23547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "95f26855a5584d049517b1071b164d96"
format_stamp: "Formatted at 2026-08-07 04:19:21 on dist-test-slave-qg60"
server_key: "c5e85a2b0cc4246711b4df4702401288"
server_key_iv: "acac4033209c62b66b75660686770637"
server_key_version: "encryptionkey@0"
I20260807 04:19:24.867587 23547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:19:24.880700 23547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:19:24.884500 23547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:19:24.884857 23547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:19:24.885818 23547 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:19:24.887115 23547 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:19:24.887252 23547 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:24.887392 23547 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:19:24.887485 23547 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:24.922955 23547 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:36673
I20260807 04:19:24.923009 23680 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:36673 every 8 connection(s)
I20260807 04:19:24.924417 23547 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:19:24.933209 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 23547
I20260807 04:19:24.934029 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:41185
--local_ip_for_outbound_sockets=127.7.200.195
--tserver_master_addrs=127.7.200.254:35593
--webserver_port=41433
--webserver_interface=127.7.200.195
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:44791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 04:19:24 dist-test-slave-qg60 krb5kdc[22747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076364, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:19:24.949865 23545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:24.927159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:57859 (local address 127.7.200.254:35593)
0807 04:19:24.927383 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:24.927389 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:24.928824 (+ 1435us) server_negotiation.cc:407] Connection header received
0807 04:19:24.931430 (+ 2606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:24.931435 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:24.931502 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:24.931600 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:24.933617 (+ 2017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:24.934772 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:24.937169 (+ 2397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:24.937947 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:24.938107 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:24.942854 (+ 4747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:24.942861 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:24.942866 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:24.942916 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:24.946312 (+ 3396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:24.947162 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:24.947170 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:24.947177 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:24.947350 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:24.947767 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:24.947775 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:24.947781 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:24.948199 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:24.948356 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:24.949109 (+ 753us) server_negotiation.cc:299] Negotiation successful
0807 04:19:24.949409 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 04:19:24.950474 23683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:24.927716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.194:57859)
0807 04:19:24.928603 (+ 887us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:24.928658 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:24.931114 (+ 2456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:24.931852 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:24.931863 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:24.932621 (+ 758us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:19:24.933419 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:24.933442 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:24.934953 (+ 1511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:24.934958 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:24.936985 (+ 2027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:24.937000 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:24.938205 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:24.938213 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:24.938505 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:24.939339 (+ 834us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:19:24.939370 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:19:24.942580 (+ 3210us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:19:24.946471 (+ 3891us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:24.946481 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:24.946497 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:24.947016 (+ 519us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:24.947462 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:24.947466 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:24.947470 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:24.947649 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:24.948328 (+ 679us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:19:24.948333 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:19:24.948637 (+ 304us) client_negotiation.cc:769] Sending connection context
0807 04:19:24.948943 (+ 306us) client_negotiation.cc:240] Negotiation successful
0807 04:19:24.949342 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":318,"threads_started":1}
I20260807 04:19:24.951982 23681 heartbeater.cc:347] Connected to a master server at 127.7.200.254:35593
I20260807 04:19:24.952322 23681 heartbeater.cc:464] Registering TS with master...
I20260807 04:19:24.953269 23681 heartbeater.cc:511] Master 127.7.200.254:35593 requested a full tablet report, sending...
I20260807 04:19:24.954875 23354 ts_manager.cc:194] Registered new tserver with Master: 95f26855a5584d049517b1071b164d96 (127.7.200.194:36673)
I20260807 04:19:24.955708 23354 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.194@KRBTEST.COM'} at 127.7.200.194:57859
W20260807 04:19:25.283246 23684 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:19:25.283540 23684 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:19:25.283715 23684 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:19:25.291246 23684 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:19:25.291363 23684 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:19:25.291591 23684 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:19:25.301956 23684 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:44791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:41185
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=41433
--tserver_master_addrs=127.7.200.254:35593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:19:25.303382 23684 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:19:25.304845 23684 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:19:25.318312 23690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:25.318390 23689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:25.318640 23692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:25.319660 23684 server_base.cc:1034] running on GCE node
I20260807 04:19:25.320362 23684 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:19:25.321502 23684 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:19:25.322757 23684 hybrid_clock.cc:648] HybridClock initialized: now 1786076365322707 us; error 52 us; skew 500 ppm
I20260807 04:19:25.323100 23684 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:19:25 dist-test-slave-qg60 krb5kdc[22747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076365, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:19:25.326570 23684 init.cc:377] Logged in from keytab as kudu/127.7.200.195@KRBTEST.COM (short username kudu)
I20260807 04:19:25.328131 23684 webserver.cc:460] Webserver started at http://127.7.200.195:41433/ using document root <none> and password file <none>
I20260807 04:19:25.328984 23684 fs_manager.cc:359] Metadata directory not provided
I20260807 04:19:25.329114 23684 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:19:25.334673 23684 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 04:19:25.337409 23699 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:25.338857 23684 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:19:25.339077 23684 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "dedf5c84979746fc8dabdf755997edfa"
format_stamp: "Formatted at 2026-08-07 04:19:22 on dist-test-slave-qg60"
server_key: "e60329edbb36256f102c1a1a240fda04"
server_key_iv: "7b10d18fbf7bbe79d9412f3af1c50f7b"
server_key_version: "encryptionkey@0"
I20260807 04:19:25.340098 23684 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:19:25.363336 23684 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:19:25.367779 23684 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:19:25.368016 23684 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:19:25.369012 23684 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:19:25.370428 23684 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:19:25.370517 23684 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:25.370653 23684 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:19:25.370748 23684 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:25.406255 23684 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:41185
I20260807 04:19:25.406354 23815 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:41185 every 8 connection(s)
I20260807 04:19:25.407836 23684 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:19:25.408375 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 23684
Aug 07 04:19:25 dist-test-slave-qg60 krb5kdc[22747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076365, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:19:25.428627 23545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:25.409656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34014 (local address 127.7.200.254:35593)
0807 04:19:25.409879 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:25.409886 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:25.411150 (+ 1264us) server_negotiation.cc:407] Connection header received
0807 04:19:25.411383 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:25.411390 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:25.411502 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:25.411630 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:25.413861 (+ 2231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.414734 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.417087 (+ 2353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.417490 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.417596 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:25.421659 (+ 4063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:25.421665 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:25.421668 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:25.421702 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:25.425354 (+ 3652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:25.426358 (+ 1004us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:25.426362 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:25.426364 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:25.426583 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:25.427015 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:25.427020 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:25.427023 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:25.427316 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:25.427679 (+ 363us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:25.427993 (+ 314us) server_negotiation.cc:299] Negotiation successful
0807 04:19:25.428221 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 04:19:25.433933 23819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:25.411152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:59841 (local address 127.7.200.254:35593)
0807 04:19:25.414051 (+ 2899us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:25.414057 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:25.414076 (+ 19us) server_negotiation.cc:407] Connection header received
0807 04:19:25.415665 (+ 1589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:25.415669 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:25.415728 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:25.415836 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:25.417920 (+ 2084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.418830 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.422335 (+ 3505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.422940 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.423054 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:25.427343 (+ 4289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:25.427348 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:25.427351 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:25.427381 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:25.431021 (+ 3640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:25.431917 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:25.431921 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:25.431923 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:25.432042 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:25.432425 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:25.432428 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:25.432430 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:25.432679 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:25.432869 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:25.433499 (+ 630us) server_negotiation.cc:299] Negotiation successful
0807 04:19:25.433655 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2747,"thread_start_us":336,"threads_started":1}
I20260807 04:19:25.434916 23820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:25.411954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.195:59841)
0807 04:19:25.412934 (+ 980us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:25.413000 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:25.415346 (+ 2346us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:25.416135 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:25.416147 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:25.417021 (+ 874us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:19:25.417723 (+ 702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:25.417751 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.419001 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.419008 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:25.421428 (+ 2420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:25.421454 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.423209 (+ 1755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.423218 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:25.423552 (+ 334us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:25.424194 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:19:25.424236 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:19:25.427093 (+ 2857us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:19:25.431187 (+ 4094us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:25.431196 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:25.431214 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:25.431791 (+ 577us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:25.432140 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:25.432143 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:25.432145 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:25.432325 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:25.432833 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:19:25.432839 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:19:25.433153 (+ 314us) client_negotiation.cc:769] Sending connection context
0807 04:19:25.433388 (+ 235us) client_negotiation.cc:240] Negotiation successful
0807 04:19:25.433776 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"thread_start_us":335,"threads_started":1}
I20260807 04:19:25.436182 23816 heartbeater.cc:347] Connected to a master server at 127.7.200.254:35593
I20260807 04:19:25.436506 23816 heartbeater.cc:464] Registering TS with master...
I20260807 04:19:25.437314 23816 heartbeater.cc:511] Master 127.7.200.254:35593 requested a full tablet report, sending...
I20260807 04:19:25.438771 23354 ts_manager.cc:194] Registered new tserver with Master: dedf5c84979746fc8dabdf755997edfa (127.7.200.195:41185)
I20260807 04:19:25.439659 23354 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.195@KRBTEST.COM'} at 127.7.200.195:59841
I20260807 04:19:25.443768 7971 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 04:19:25.450935 23819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:25.444793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34030 (local address 127.7.200.254:35593)
0807 04:19:25.444976 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:25.444984 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:25.445525 (+ 541us) server_negotiation.cc:407] Connection header received
0807 04:19:25.445767 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:25.445771 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:25.445909 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:25.446064 (+ 155us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:19:25.446523 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.447209 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.448701 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.449185 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.449338 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:25.449866 (+ 528us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:19:25.450353 (+ 487us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:19:25.450524 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:25.450583 (+ 59us) server_negotiation.cc:299] Negotiation successful
0807 04:19:25.450663 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 04:19:25.451804 23354 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:34030:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:19:25.461717 23354 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:19:25.498200 23543 heartbeater.cc:503] Master 127.7.200.254:35593 was elected leader, sending a full tablet report...
I20260807 04:19:25.503328 23827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:25.474335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39108 (local address 127.7.200.193:32971)
0807 04:19:25.493694 (+ 19359us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:25.493702 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:25.493730 (+ 28us) server_negotiation.cc:407] Connection header received
0807 04:19:25.493824 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:25.493835 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:25.494057 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:25.494456 (+ 399us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:19:25.495552 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.497156 (+ 1604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.500596 (+ 3440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.501970 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.502106 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:25.502353 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:25.502744 (+ 391us) server_negotiation.cc:299] Negotiation successful
0807 04:19:25.502929 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19182,"thread_start_us":19042,"threads_started":1}
I20260807 04:19:25.503443 23828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:25.473816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:32971 (local address 127.0.0.1:39108)
0807 04:19:25.486027 (+ 12211us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:25.486081 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:25.486309 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:25.494294 (+ 7985us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:25.494306 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:25.494337 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:19:25.495273 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:25.495285 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.497342 (+ 2057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.497351 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:25.500422 (+ 3071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:25.500435 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.502195 (+ 1760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.502201 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:25.502465 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:25.502534 (+ 69us) client_negotiation.cc:769] Sending connection context
0807 04:19:25.502682 (+ 148us) client_negotiation.cc:240] Negotiation successful
0807 04:19:25.502942 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11905,"mutex_wait_us":706,"thread_start_us":12828,"threads_started":1}
I20260807 04:19:25.504210 23826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:25.474331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:41185 (local address 127.0.0.1:60154)
0807 04:19:25.486916 (+ 12585us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:25.486935 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:25.487055 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:25.495753 (+ 8698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:25.495758 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:25.495785 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:19:25.496157 (+ 372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:25.496169 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.498144 (+ 1975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.498149 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:25.501246 (+ 3097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:25.501259 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.503015 (+ 1756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.503022 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:25.503202 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:25.503233 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 04:19:25.503306 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 04:19:25.503463 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12449,"mutex_wait_us":655,"thread_start_us":10410,"threads_started":1}
I20260807 04:19:25.504315 23830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:25.474744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:36673 (local address 127.0.0.1:35802)
0807 04:19:25.487547 (+ 12803us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:25.487566 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:25.487684 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:25.494018 (+ 6334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:25.494030 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:25.494078 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:19:25.494907 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:25.494922 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.497304 (+ 2382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.497310 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:25.501174 (+ 3864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:25.501191 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.503443 (+ 2252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.503452 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:25.503632 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:25.503666 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 04:19:25.503756 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 04:19:25.503897 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12684,"mutex_wait_us":614,"thread_start_us":13370,"threads_started":1}
I20260807 04:19:25.504952 23831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:25.475432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35802 (local address 127.7.200.194:36673)
0807 04:19:25.493238 (+ 17806us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:25.493251 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:25.493291 (+ 40us) server_negotiation.cc:407] Connection header received
0807 04:19:25.493406 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:25.493415 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:25.493717 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:25.493945 (+ 228us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:19:25.495527 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.497137 (+ 1610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.501450 (+ 4313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.502879 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.503014 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:25.503211 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:25.504477 (+ 1266us) server_negotiation.cc:299] Negotiation successful
0807 04:19:25.504656 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17639,"thread_start_us":17514,"threads_started":1}
I20260807 04:19:25.505903 23829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:25.474661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60154 (local address 127.7.200.195:41185)
0807 04:19:25.495182 (+ 20521us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:25.495190 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:25.495222 (+ 32us) server_negotiation.cc:407] Connection header received
0807 04:19:25.495319 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:25.495323 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:25.495541 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:25.495738 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:19:25.496372 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.497999 (+ 1627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.501443 (+ 3444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.502766 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.505048 (+ 2282us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:25.505290 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:25.505365 (+ 75us) server_negotiation.cc:299] Negotiation successful
0807 04:19:25.505564 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20348,"thread_start_us":20176,"threads_started":1}
I20260807 04:19:25.507956 23614 tablet_service.cc:1467] Processing CreateTablet for tablet bfb6b037468445eb8815efae89fa4ccd (DEFAULT_TABLE table=test-table [id=37a5bfefe1604725a7cab37d235195e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:19:25.508069 23477 tablet_service.cc:1467] Processing CreateTablet for tablet bfb6b037468445eb8815efae89fa4ccd (DEFAULT_TABLE table=test-table [id=37a5bfefe1604725a7cab37d235195e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:19:25.509301 23614 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfb6b037468445eb8815efae89fa4ccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:19:25.509857 23477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfb6b037468445eb8815efae89fa4ccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:19:25.509353 23750 tablet_service.cc:1467] Processing CreateTablet for tablet bfb6b037468445eb8815efae89fa4ccd (DEFAULT_TABLE table=test-table [id=37a5bfefe1604725a7cab37d235195e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:19:25.510718 23750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfb6b037468445eb8815efae89fa4ccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:19:25.522950 23832 tablet_bootstrap.cc:492] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96: Bootstrap starting.
I20260807 04:19:25.526299 23832 tablet_bootstrap.cc:654] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96: Neither blocks nor log segments found. Creating new log.
I20260807 04:19:25.526480 23833 tablet_bootstrap.cc:492] T bfb6b037468445eb8815efae89fa4ccd P dedf5c84979746fc8dabdf755997edfa: Bootstrap starting.
I20260807 04:19:25.527828 23832 log.cc:824] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96: Log is configured to *not* fsync() on all Append() calls
I20260807 04:19:25.529551 23834 tablet_bootstrap.cc:492] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa: Bootstrap starting.
I20260807 04:19:25.530299 23833 tablet_bootstrap.cc:654] T bfb6b037468445eb8815efae89fa4ccd P dedf5c84979746fc8dabdf755997edfa: Neither blocks nor log segments found. Creating new log.
I20260807 04:19:25.531302 23832 tablet_bootstrap.cc:492] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96: No bootstrap required, opened a new log
I20260807 04:19:25.531665 23832 ts_tablet_manager.cc:1397] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260807 04:19:25.531736 23833 log.cc:824] T bfb6b037468445eb8815efae89fa4ccd P dedf5c84979746fc8dabdf755997edfa: Log is configured to *not* fsync() on all Append() calls
I20260807 04:19:25.533280 23834 tablet_bootstrap.cc:654] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa: Neither blocks nor log segments found. Creating new log.
I20260807 04:19:25.534636 23834 log.cc:824] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa: Log is configured to *not* fsync() on all Append() calls
I20260807 04:19:25.535593 23833 tablet_bootstrap.cc:492] T bfb6b037468445eb8815efae89fa4ccd P dedf5c84979746fc8dabdf755997edfa: No bootstrap required, opened a new log
I20260807 04:19:25.535884 23833 ts_tablet_manager.cc:1397] T bfb6b037468445eb8815efae89fa4ccd P dedf5c84979746fc8dabdf755997edfa: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260807 04:19:25.538036 23834 tablet_bootstrap.cc:492] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa: No bootstrap required, opened a new log
I20260807 04:19:25.538321 23834 ts_tablet_manager.cc:1397] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260807 04:19:25.540302 23832 raft_consensus.cc:348] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c61112bec14a61ae16ca15538b1eaa" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32971 } } peers { permanent_uuid: "dedf5c84979746fc8dabdf755997edfa" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41185 } } peers { permanent_uuid: "95f26855a5584d049517b1071b164d96" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36673 } }
I20260807 04:19:25.540714 23832 raft_consensus.cc:374] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:19:25.540868 23832 raft_consensus.cc:729] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95f26855a5584d049517b1071b164d96, State: Initialized, Role: FOLLOWER
I20260807 04:19:25.541536 23832 consensus_queue.cc:260] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c61112bec14a61ae16ca15538b1eaa" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32971 } } peers { permanent_uuid: "dedf5c84979746fc8dabdf755997edfa" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41185 } } peers { permanent_uuid: "95f26855a5584d049517b1071b164d96" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36673 } }
I20260807 04:19:25.544801 23681 heartbeater.cc:503] Master 127.7.200.254:35593 was elected leader, sending a full tablet report...
I20260807 04:19:25.545621 23832 ts_tablet_manager.cc:1428] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260807 04:19:25.547137 23833 raft_consensus.cc:348] T bfb6b037468445eb8815efae89fa4ccd P dedf5c84979746fc8dabdf755997edfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c61112bec14a61ae16ca15538b1eaa" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32971 } } peers { permanent_uuid: "dedf5c84979746fc8dabdf755997edfa" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41185 } } peers { permanent_uuid: "95f26855a5584d049517b1071b164d96" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36673 } }
I20260807 04:19:25.547616 23833 raft_consensus.cc:374] T bfb6b037468445eb8815efae89fa4ccd P dedf5c84979746fc8dabdf755997edfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:19:25.547716 23833 raft_consensus.cc:729] T bfb6b037468445eb8815efae89fa4ccd P dedf5c84979746fc8dabdf755997edfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dedf5c84979746fc8dabdf755997edfa, State: Initialized, Role: FOLLOWER
I20260807 04:19:25.548355 23833 consensus_queue.cc:260] T bfb6b037468445eb8815efae89fa4ccd P dedf5c84979746fc8dabdf755997edfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c61112bec14a61ae16ca15538b1eaa" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32971 } } peers { permanent_uuid: "dedf5c84979746fc8dabdf755997edfa" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41185 } } peers { permanent_uuid: "95f26855a5584d049517b1071b164d96" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36673 } }
I20260807 04:19:25.549242 23834 raft_consensus.cc:348] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c61112bec14a61ae16ca15538b1eaa" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32971 } } peers { permanent_uuid: "dedf5c84979746fc8dabdf755997edfa" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41185 } } peers { permanent_uuid: "95f26855a5584d049517b1071b164d96" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36673 } }
I20260807 04:19:25.549613 23816 heartbeater.cc:503] Master 127.7.200.254:35593 was elected leader, sending a full tablet report...
I20260807 04:19:25.549772 23834 raft_consensus.cc:374] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:19:25.549939 23834 raft_consensus.cc:729] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2c61112bec14a61ae16ca15538b1eaa, State: Initialized, Role: FOLLOWER
I20260807 04:19:25.550379 23833 ts_tablet_manager.cc:1428] T bfb6b037468445eb8815efae89fa4ccd P dedf5c84979746fc8dabdf755997edfa: Time spent starting tablet: real 0.014s user 0.012s sys 0.004s
I20260807 04:19:25.550704 23834 consensus_queue.cc:260] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c61112bec14a61ae16ca15538b1eaa" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32971 } } peers { permanent_uuid: "dedf5c84979746fc8dabdf755997edfa" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41185 } } peers { permanent_uuid: "95f26855a5584d049517b1071b164d96" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36673 } }
I20260807 04:19:25.552424 23834 ts_tablet_manager.cc:1428] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
W20260807 04:19:25.659873 23817 tablet.cc:2369] T bfb6b037468445eb8815efae89fa4ccd P dedf5c84979746fc8dabdf755997edfa: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 04:19:25.676550 23682 tablet.cc:2369] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 04:19:25.708491 23544 tablet.cc:2369] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:19:25.825749 23838 raft_consensus.cc:482] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:19:25.826200 23838 raft_consensus.cc:504] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c61112bec14a61ae16ca15538b1eaa" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32971 } } peers { permanent_uuid: "dedf5c84979746fc8dabdf755997edfa" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41185 } } peers { permanent_uuid: "95f26855a5584d049517b1071b164d96" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36673 } }
I20260807 04:19:25.828249 23838 leader_election.cc:288] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2c61112bec14a61ae16ca15538b1eaa (127.7.200.193:32971), dedf5c84979746fc8dabdf755997edfa (127.7.200.195:41185)
I20260807 04:19:25.835713 23827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:25.828616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:49005 (local address 127.7.200.193:32971)
0807 04:19:25.828900 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:25.828909 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:25.830057 (+ 1148us) server_negotiation.cc:407] Connection header received
0807 04:19:25.830174 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:25.830179 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:25.830247 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:25.830336 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:19:25.831032 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.831765 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.833941 (+ 2176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.834697 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.834905 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:25.834991 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:25.835312 (+ 321us) server_negotiation.cc:299] Negotiation successful
0807 04:19:25.835437 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 04:19:25.835713 23829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:25.829013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:58943 (local address 127.7.200.195:41185)
0807 04:19:25.829271 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:25.829279 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:25.829698 (+ 419us) server_negotiation.cc:407] Connection header received
0807 04:19:25.829949 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:25.829954 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:25.830052 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:25.830145 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:19:25.831103 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.831914 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.833868 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.834695 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.834882 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:25.834974 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:25.835304 (+ 330us) server_negotiation.cc:299] Negotiation successful
0807 04:19:25.835442 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260807 04:19:25.835930 23841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:25.828624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:41185 (local address 127.7.200.194:58943)
0807 04:19:25.829574 (+ 950us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:25.829589 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:25.829794 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:25.830476 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:25.830480 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:25.830500 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:19:25.830928 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:25.830965 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.832066 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.832070 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:25.833703 (+ 1633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:25.833719 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.834939 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.834946 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:25.835142 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:25.835166 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 04:19:25.835279 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 04:19:25.835413 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":815,"mutex_wait_us":32,"thread_start_us":510,"threads_started":1}
I20260807 04:19:25.836030 23842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:25.828660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:32971 (local address 127.7.200.194:49005)
0807 04:19:25.829928 (+ 1268us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:25.829948 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:25.830067 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:25.830421 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:25.830425 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:25.830449 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:19:25.830846 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:25.830856 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.831994 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.832008 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:25.833733 (+ 1725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:25.833745 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.834975 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.834982 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:25.835147 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:25.835170 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 04:19:25.835283 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 04:19:25.835417 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1149,"mutex_wait_us":53,"thread_start_us":916,"threads_started":1}
I20260807 04:19:25.837148 23770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfb6b037468445eb8815efae89fa4ccd" candidate_uuid: "95f26855a5584d049517b1071b164d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dedf5c84979746fc8dabdf755997edfa" is_pre_election: true
I20260807 04:19:25.837157 23497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfb6b037468445eb8815efae89fa4ccd" candidate_uuid: "95f26855a5584d049517b1071b164d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2c61112bec14a61ae16ca15538b1eaa" is_pre_election: true
I20260807 04:19:25.837658 23770 raft_consensus.cc:2454] T bfb6b037468445eb8815efae89fa4ccd P dedf5c84979746fc8dabdf755997edfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95f26855a5584d049517b1071b164d96 in term 0.
I20260807 04:19:25.837658 23497 raft_consensus.cc:2454] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95f26855a5584d049517b1071b164d96 in term 0.
I20260807 04:19:25.838342 23565 leader_election.cc:302] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95f26855a5584d049517b1071b164d96, d2c61112bec14a61ae16ca15538b1eaa; no voters:
I20260807 04:19:25.838795 23838 raft_consensus.cc:2781] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:19:25.838946 23838 raft_consensus.cc:482] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:19:25.839052 23838 raft_consensus.cc:3037] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:19:25.841357 23838 raft_consensus.cc:504] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c61112bec14a61ae16ca15538b1eaa" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32971 } } peers { permanent_uuid: "dedf5c84979746fc8dabdf755997edfa" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41185 } } peers { permanent_uuid: "95f26855a5584d049517b1071b164d96" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36673 } }
I20260807 04:19:25.842072 23838 leader_election.cc:288] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96 [CANDIDATE]: Term 1 election: Requested vote from peers d2c61112bec14a61ae16ca15538b1eaa (127.7.200.193:32971), dedf5c84979746fc8dabdf755997edfa (127.7.200.195:41185)
I20260807 04:19:25.842500 23497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfb6b037468445eb8815efae89fa4ccd" candidate_uuid: "95f26855a5584d049517b1071b164d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2c61112bec14a61ae16ca15538b1eaa"
I20260807 04:19:25.842710 23497 raft_consensus.cc:3037] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:19:25.842690 23770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfb6b037468445eb8815efae89fa4ccd" candidate_uuid: "95f26855a5584d049517b1071b164d96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dedf5c84979746fc8dabdf755997edfa"
I20260807 04:19:25.842898 23770 raft_consensus.cc:3037] T bfb6b037468445eb8815efae89fa4ccd P dedf5c84979746fc8dabdf755997edfa [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:19:25.845225 23497 raft_consensus.cc:2454] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95f26855a5584d049517b1071b164d96 in term 1.
I20260807 04:19:25.845504 23770 raft_consensus.cc:2454] T bfb6b037468445eb8815efae89fa4ccd P dedf5c84979746fc8dabdf755997edfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95f26855a5584d049517b1071b164d96 in term 1.
I20260807 04:19:25.845687 23565 leader_election.cc:302] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95f26855a5584d049517b1071b164d96, d2c61112bec14a61ae16ca15538b1eaa; no voters:
I20260807 04:19:25.845992 23838 raft_consensus.cc:2781] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:19:25.846448 23838 raft_consensus.cc:686] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96 [term 1 LEADER]: Becoming Leader. State: Replica: 95f26855a5584d049517b1071b164d96, State: Running, Role: LEADER
I20260807 04:19:25.846939 23838 consensus_queue.cc:237] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c61112bec14a61ae16ca15538b1eaa" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32971 } } peers { permanent_uuid: "dedf5c84979746fc8dabdf755997edfa" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41185 } } peers { permanent_uuid: "95f26855a5584d049517b1071b164d96" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36673 } }
I20260807 04:19:25.851890 23354 catalog_manager.cc:5495] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95f26855a5584d049517b1071b164d96 (127.7.200.194). New cstate: current_term: 1 leader_uuid: "95f26855a5584d049517b1071b164d96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c61112bec14a61ae16ca15538b1eaa" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dedf5c84979746fc8dabdf755997edfa" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41185 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95f26855a5584d049517b1071b164d96" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36673 } health_report { overall_health: HEALTHY } } }
I20260807 04:19:25.871217 23831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:25.865899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35806 (local address 127.7.200.194:36673)
0807 04:19:25.866101 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:25.866105 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:25.866124 (+ 19us) server_negotiation.cc:407] Connection header received
0807 04:19:25.866299 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:25.866303 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:25.866389 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:25.866514 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:19:25.866880 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.867578 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.869081 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.869474 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.869566 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:25.870037 (+ 471us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:19:25.870537 (+ 500us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:19:25.870656 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:25.870789 (+ 133us) server_negotiation.cc:299] Negotiation successful
0807 04:19:25.870854 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 04:19:25.879839 23497 raft_consensus.cc:1261] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [term 1 FOLLOWER]: Refusing update from remote peer 95f26855a5584d049517b1071b164d96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:19:25.879839 23770 raft_consensus.cc:1261] T bfb6b037468445eb8815efae89fa4ccd P dedf5c84979746fc8dabdf755997edfa [term 1 FOLLOWER]: Refusing update from remote peer 95f26855a5584d049517b1071b164d96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:19:25.881064 23843 consensus_queue.cc:1035] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dedf5c84979746fc8dabdf755997edfa" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:19:25.881459 23838 consensus_queue.cc:1035] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2c61112bec14a61ae16ca15538b1eaa" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:19:25.894066 23847 mvcc.cc:205] Tried to move back new op lower bound from 7315768794632413184 to 7315768794512900096. Current Snapshot: MvccSnapshot[applied={T|T < 7315768794632413184}]
I20260807 04:19:25.894145 23845 mvcc.cc:205] Tried to move back new op lower bound from 7315768794632413184 to 7315768794512900096. Current Snapshot: MvccSnapshot[applied={T|T < 7315768794632413184}]
I20260807 04:19:25.907693 23353 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:34030:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:19:25.908010 23353 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:34030:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:19:25.911976 23353 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0: Sending DeleteTablet for 3 replicas of tablet bfb6b037468445eb8815efae89fa4ccd
I20260807 04:19:25.913394 23750 tablet_service.cc:1514] Processing DeleteTablet for tablet bfb6b037468445eb8815efae89fa4ccd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:19:25 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:60154
I20260807 04:19:25.913515 23477 tablet_service.cc:1514] Processing DeleteTablet for tablet bfb6b037468445eb8815efae89fa4ccd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:19:25 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:39108
I20260807 04:19:25.913911 23614 tablet_service.cc:1514] Processing DeleteTablet for tablet bfb6b037468445eb8815efae89fa4ccd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:19:25 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:35802
I20260807 04:19:25.914405 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 23391
I20260807 04:19:25.926151 23855 tablet_replica.cc:330] T bfb6b037468445eb8815efae89fa4ccd P dedf5c84979746fc8dabdf755997edfa: stopping tablet replica
I20260807 04:19:25.926715 23857 tablet_replica.cc:330] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96: stopping tablet replica
I20260807 04:19:25.927264 23856 tablet_replica.cc:330] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa: stopping tablet replica
I20260807 04:19:25.928129 23856 raft_consensus.cc:2229] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:19:25.929194 23855 raft_consensus.cc:2229] T bfb6b037468445eb8815efae89fa4ccd P dedf5c84979746fc8dabdf755997edfa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:19:25.929436 23857 raft_consensus.cc:2229] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96 [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:19:25.930925 23857 raft_consensus.cc:2258] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:19:25.931404 23855 raft_consensus.cc:2258] T bfb6b037468445eb8815efae89fa4ccd P dedf5c84979746fc8dabdf755997edfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:19:25.930059 23856 raft_consensus.cc:2258] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:19:25.934077 23856 ts_tablet_manager.cc:1905] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:19:25.936650 23857 ts_tablet_manager.cc:1905] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:19:25.936889 23855 ts_tablet_manager.cc:1905] T bfb6b037468445eb8815efae89fa4ccd P dedf5c84979746fc8dabdf755997edfa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:19:25.937405 23827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:25.916082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39112 (local address 127.7.200.193:32971)
0807 04:19:25.916255 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:25.916261 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:25.916279 (+ 18us) server_negotiation.cc:407] Connection header received
0807 04:19:25.916336 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:25.916341 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:25.916429 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:25.916546 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:25.918794 (+ 2248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.919997 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.921978 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:25.922672 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:25.922801 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:25.927623 (+ 4822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:25.927637 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:25.927653 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:25.927692 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:25.933201 (+ 5509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:25.934147 (+ 946us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:25.934156 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:25.934160 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:25.934326 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:25.934832 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:25.934837 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:25.934841 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:25.935287 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:25.935573 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:25.936818 (+ 1245us) server_negotiation.cc:299] Negotiation successful
0807 04:19:25.937050 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 04:19:25.945452 23538 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:19:25.952116 23857 ts_tablet_manager.cc:1918] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:19:25.952306 23857 log.cc:1196] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/wal/wals/bfb6b037468445eb8815efae89fa4ccd
I20260807 04:19:25.952975 23857 ts_tablet_manager.cc:1939] T bfb6b037468445eb8815efae89fa4ccd P 95f26855a5584d049517b1071b164d96: Deleting consensus metadata
I20260807 04:19:25.953575 23855 ts_tablet_manager.cc:1918] T bfb6b037468445eb8815efae89fa4ccd P dedf5c84979746fc8dabdf755997edfa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:19:25.953755 23855 log.cc:1196] T bfb6b037468445eb8815efae89fa4ccd P dedf5c84979746fc8dabdf755997edfa: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/wal/wals/bfb6b037468445eb8815efae89fa4ccd
I20260807 04:19:25.954305 23855 ts_tablet_manager.cc:1939] T bfb6b037468445eb8815efae89fa4ccd P dedf5c84979746fc8dabdf755997edfa: Deleting consensus metadata
I20260807 04:19:25.955030 23341 catalog_manager.cc:4841] TS 95f26855a5584d049517b1071b164d96 (127.7.200.194:36673): tablet bfb6b037468445eb8815efae89fa4ccd (table test-table [id=37a5bfefe1604725a7cab37d235195e0]) successfully deleted
I20260807 04:19:25.956195 23340 catalog_manager.cc:4841] TS dedf5c84979746fc8dabdf755997edfa (127.7.200.195:41185): tablet bfb6b037468445eb8815efae89fa4ccd (table test-table [id=37a5bfefe1604725a7cab37d235195e0]) successfully deleted
I20260807 04:19:26.045572 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 23391
I20260807 04:19:26.072605 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 23547
W20260807 04:19:26.072700 23339 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.200.193:32971 (error 108)
I20260807 04:19:26.076639 23860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:26.074551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:32971 (local address 127.0.0.1:39114)
0807 04:19:26.076289 (+ 1738us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:26.076427 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:32971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1610,"thread_start_us":1483,"threads_started":1}
W20260807 04:19:26.077078 23339 catalog_manager.cc:4584] TS d2c61112bec14a61ae16ca15538b1eaa (127.7.200.193:32971): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bfb6b037468445eb8815efae89fa4ccd: Network error: Client connection negotiation failed: client connection to 127.7.200.193:32971: connect: Connection refused (error 111)
I20260807 04:19:26.088325 23831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:26.073912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35808 (local address 127.7.200.194:36673)
0807 04:19:26.074119 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:26.074126 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:26.074151 (+ 25us) server_negotiation.cc:407] Connection header received
0807 04:19:26.074327 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:26.074332 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:26.074422 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:26.074548 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:26.075941 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:26.077349 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:26.078797 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:26.079264 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:26.079404 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:26.082245 (+ 2841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:26.082258 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:26.082273 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:26.082313 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:26.085376 (+ 3063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:26.086145 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:26.086155 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:26.086158 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:26.086313 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:26.086691 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:26.086696 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:26.086704 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:26.087052 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:26.087424 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:26.087713 (+ 289us) server_negotiation.cc:299] Negotiation successful
0807 04:19:26.087938 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260807 04:19:26.089051 23676 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:19:26.130702 23860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:26.130239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:32971 (local address 127.0.0.1:39116)
0807 04:19:26.130455 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:26.130549 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:32971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260807 04:19:26.131798 23860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:26.131390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:32971 (local address 127.0.0.1:39126)
0807 04:19:26.131543 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:26.131646 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:32971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260807 04:19:26.192631 23860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:26.192168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:32971 (local address 127.0.0.1:39136)
0807 04:19:26.192387 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:26.192477 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:32971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260807 04:19:26.193770 23860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:26.193354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:32971 (local address 127.0.0.1:39138)
0807 04:19:26.193535 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:26.193634 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:32971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260807 04:19:26.205677 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 23547
I20260807 04:19:26.229010 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 23684
I20260807 04:19:26.243561 23829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:26.229843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60160 (local address 127.7.200.195:41185)
0807 04:19:26.230176 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:26.230182 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:26.230203 (+ 21us) server_negotiation.cc:407] Connection header received
0807 04:19:26.230317 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:26.230322 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:26.230412 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:26.230526 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:26.231951 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:26.232691 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:26.234148 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:26.234563 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:26.234708 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:26.237519 (+ 2811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:26.237535 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:26.237553 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:26.237587 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:26.240539 (+ 2952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:26.241368 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:26.241375 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:26.241378 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:26.241524 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:26.241918 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:26.241924 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:26.241927 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:26.242307 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:26.242631 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:26.242972 (+ 341us) server_negotiation.cc:299] Negotiation successful
0807 04:19:26.243209 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194}
I20260807 04:19:26.244225 23811 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:19:26.274899 23860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:26.274403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:32971 (local address 127.0.0.1:39152)
0807 04:19:26.274660 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:26.274740 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:32971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159}
I20260807 04:19:26.276026 23860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:26.275639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:32971 (local address 127.0.0.1:39160)
0807 04:19:26.275824 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:26.275892 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:32971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260807 04:19:26.337262 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 23684
I20260807 04:19:26.356860 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 23321
I20260807 04:19:26.358047 23384 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:19:26.475226 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 23321
I20260807 04:19:26.501250 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:35593
--webserver_interface=127.7.200.254
--webserver_port=37927
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:44791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:35593
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:19:26.854557 23864 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:19:26.854931 23864 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:19:26.855115 23864 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:19:26.862835 23864 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:19:26.863047 23864 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:19:26.863152 23864 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:19:26.863257 23864 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:19:26.863346 23864 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:19:26.873538 23864 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:44791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:35593
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:35593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=37927
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:19:26.874944 23864 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:19:26.876332 23864 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:19:26.888939 23870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:26.889050 23871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:26.889027 23873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:26.889906 23864 server_base.cc:1034] running on GCE node
I20260807 04:19:26.890683 23864 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:19:26.892073 23864 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:19:26.893319 23864 hybrid_clock.cc:648] HybridClock initialized: now 1786076366893276 us; error 54 us; skew 500 ppm
I20260807 04:19:26.893752 23864 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:19:26 dist-test-slave-qg60 krb5kdc[22747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076366, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:19:26.902215 23864 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:19:26.903864 23864 webserver.cc:460] Webserver started at http://127.7.200.254:37927/ using document root <none> and password file <none>
I20260807 04:19:26.904606 23864 fs_manager.cc:359] Metadata directory not provided
I20260807 04:19:26.904793 23864 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:19:26.910563 23864 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 04:19:26.913532 23881 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:26.914878 23864 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:19:26.915067 23864 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "ec1cd6ccd087498cbe67569501ab58c0"
format_stamp: "Formatted at 2026-08-07 04:19:20 on dist-test-slave-qg60"
server_key: "4c5a6a5e49e556c8156f6529eed26947"
server_key_iv: "44babfb858bce08f139481a65d540513"
server_key_version: "encryptionkey@0"
I20260807 04:19:26.916080 23864 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:19:26.945132 23864 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:19:26.949564 23864 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:19:26.949872 23864 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:19:26.968636 23864 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:35593
I20260807 04:19:26.968662 23933 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:35593 every 8 connection(s)
I20260807 04:19:26.970203 23864 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:19:26.971411 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 23864
I20260807 04:19:26.972642 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:32971
--local_ip_for_outbound_sockets=127.7.200.193
--tserver_master_addrs=127.7.200.254:35593
--webserver_port=44841
--webserver_interface=127.7.200.193
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:44791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 04:19:26.980510 23934 sys_catalog.cc:263] Verifying existing consensus state
I20260807 04:19:26.985724 23934 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0: Bootstrap starting.
I20260807 04:19:27.007158 23934 log.cc:824] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0: Log is configured to *not* fsync() on all Append() calls
I20260807 04:19:27.026422 23934 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 04:19:27.027077 23934 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0: Bootstrap complete.
I20260807 04:19:27.036859 23934 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec1cd6ccd087498cbe67569501ab58c0" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 35593 } }
I20260807 04:19:27.037822 23934 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec1cd6ccd087498cbe67569501ab58c0, State: Initialized, Role: FOLLOWER
I20260807 04:19:27.038534 23934 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec1cd6ccd087498cbe67569501ab58c0" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 35593 } }
I20260807 04:19:27.038797 23934 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:19:27.038920 23934 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:19:27.039135 23934 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [term 2 FOLLOWER]: Advancing to term 3
I20260807 04:19:27.043094 23934 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec1cd6ccd087498cbe67569501ab58c0" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 35593 } }
I20260807 04:19:27.043637 23934 leader_election.cc:302] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec1cd6ccd087498cbe67569501ab58c0; no voters:
I20260807 04:19:27.044358 23934 leader_election.cc:288] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 04:19:27.044497 23938 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 04:19:27.045783 23938 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [term 3 LEADER]: Becoming Leader. State: Replica: ec1cd6ccd087498cbe67569501ab58c0, State: Running, Role: LEADER
I20260807 04:19:27.046406 23938 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec1cd6ccd087498cbe67569501ab58c0" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 35593 } }
I20260807 04:19:27.046733 23934 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:19:27.049615 23940 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec1cd6ccd087498cbe67569501ab58c0. Latest consensus state: current_term: 3 leader_uuid: "ec1cd6ccd087498cbe67569501ab58c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec1cd6ccd087498cbe67569501ab58c0" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 35593 } } }
I20260807 04:19:27.049612 23939 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "ec1cd6ccd087498cbe67569501ab58c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec1cd6ccd087498cbe67569501ab58c0" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 35593 } } }
I20260807 04:19:27.050062 23939 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [sys.catalog]: This master's current role is: LEADER
I20260807 04:19:27.050066 23940 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec1cd6ccd087498cbe67569501ab58c0 [sys.catalog]: This master's current role is: LEADER
I20260807 04:19:27.058256 23944 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:19:27.069185 23944 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:19:27.071302 23944 catalog_manager.cc:1259] Loaded cluster ID: 66fb6c76f93e4cd6bd6bf7a9369bc717
I20260807 04:19:27.071529 23944 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260807 04:19:27.074340 23944 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f0934ccc9ad google::LogMessage::Fail() at ??:0
@ 0x7f0934ccf88a google::LogMessage::SendToLog() at ??:0
@ 0x7f0934ccc4de google::LogMessage::Flush() at ??:0
@ 0x7f0934ccda19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f094a703512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f094a700976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f094a788610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f094a788439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f0937918345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f093791b91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f093791b799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f09378f6eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f093abd06db start_thread at ??:0
@ 0x7f0933b6661f clone at ??:0
W20260807 04:19:27.402277 23936 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:19:27.402644 23936 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:19:27.402822 23936 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:19:27.411614 23936 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:19:27.411800 23936 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:19:27.412001 23936 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:19:27.423234 23936 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:44791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:32971
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=44841
--tserver_master_addrs=127.7.200.254:35593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:19:27.424674 23936 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:19:27.426250 23936 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:19:27.440311 23976 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:27.440438 23977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:27.440652 23979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:27.441493 23936 server_base.cc:1034] running on GCE node
I20260807 04:19:27.442205 23936 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:19:27.443245 23936 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:19:27.444550 23936 hybrid_clock.cc:648] HybridClock initialized: now 1786076367444478 us; error 64 us; skew 500 ppm
I20260807 04:19:27.444940 23936 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:19:27 dist-test-slave-qg60 krb5kdc[22747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076367, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:19:27.448271 23936 init.cc:377] Logged in from keytab as kudu/127.7.200.193@KRBTEST.COM (short username kudu)
I20260807 04:19:27.449826 23936 webserver.cc:460] Webserver started at http://127.7.200.193:44841/ using document root <none> and password file <none>
I20260807 04:19:27.450506 23936 fs_manager.cc:359] Metadata directory not provided
I20260807 04:19:27.450611 23936 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:19:27.456066 23936 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260807 04:19:27.459501 23986 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:27.460983 23936 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:19:27.461169 23936 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "d2c61112bec14a61ae16ca15538b1eaa"
format_stamp: "Formatted at 2026-08-07 04:19:21 on dist-test-slave-qg60"
server_key: "b857994cab454b685b6fa78a57a57afb"
server_key_iv: "00994403a20cbc3ab5a6e104461850cd"
server_key_version: "encryptionkey@0"
I20260807 04:19:27.462162 23936 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:19:27.488664 23936 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:19:27.493165 23936 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:19:27.493466 23936 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:19:27.494822 23936 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:19:27.497483 23993 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260807 04:19:27.503304 23936 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 04:19:27.503470 23936 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260807 04:19:27.503634 23936 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 04:19:27.506913 23936 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 04:19:27.507017 23936 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.002s sys 0.000s
I20260807 04:19:27.507386 23993 tablet_bootstrap.cc:492] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa: Bootstrap starting.
I20260807 04:19:27.516559 23993 log.cc:824] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa: Log is configured to *not* fsync() on all Append() calls
I20260807 04:19:27.532627 23993 tablet_bootstrap.cc:492] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 04:19:27.533666 23993 tablet_bootstrap.cc:492] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa: Bootstrap complete.
I20260807 04:19:27.534350 23993 ts_tablet_manager.cc:1397] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa: Time spent bootstrapping tablet: real 0.027s user 0.025s sys 0.000s
I20260807 04:19:27.546512 23993 raft_consensus.cc:348] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c61112bec14a61ae16ca15538b1eaa" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32971 } } peers { permanent_uuid: "dedf5c84979746fc8dabdf755997edfa" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41185 } } peers { permanent_uuid: "95f26855a5584d049517b1071b164d96" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36673 } }
I20260807 04:19:27.548485 23993 raft_consensus.cc:729] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2c61112bec14a61ae16ca15538b1eaa, State: Initialized, Role: FOLLOWER
I20260807 04:19:27.549587 23993 consensus_queue.cc:260] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c61112bec14a61ae16ca15538b1eaa" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32971 } } peers { permanent_uuid: "dedf5c84979746fc8dabdf755997edfa" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41185 } } peers { permanent_uuid: "95f26855a5584d049517b1071b164d96" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36673 } }
I20260807 04:19:27.551524 23993 ts_tablet_manager.cc:1428] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa: Time spent starting tablet: real 0.017s user 0.017s sys 0.000s
I20260807 04:19:27.556205 23936 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:32971
I20260807 04:19:27.556286 24105 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:32971 every 8 connection(s)
I20260807 04:19:27.557552 23936 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:19:27.559149 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 23936
I20260807 04:19:27.559999 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:36673
--local_ip_for_outbound_sockets=127.7.200.194
--tserver_master_addrs=127.7.200.254:35593
--webserver_port=46667
--webserver_interface=127.7.200.194
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:44791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 04:19:27.562955 24108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:27.560846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.193:41963)
0807 04:19:27.561747 (+ 901us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:27.561981 (+ 234us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":642,"thread_start_us":406,"threads_started":1}
W20260807 04:19:27.563732 24106 heartbeater.cc:644] Failed to heartbeat to 127.7.200.254:35593 (0 consecutive failures): Network error: Failed to ping master at 127.7.200.254:35593: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
I20260807 04:19:27.564651 24108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:27.564333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.193:49159)
0807 04:19:27.564479 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:27.564546 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260807 04:19:27.565707 24108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:27.565209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.193:54333)
0807 04:19:27.565409 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:27.565529 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260807 04:19:27.566015 24106 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 04:19:27.911725 24109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:19:27.912088 24109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:19:27.912263 24109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:19:27.919718 24109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:19:27.919898 24109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:19:27.920092 24109 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:19:27.930315 24109 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:44791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:36673
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=46667
--tserver_master_addrs=127.7.200.254:35593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:19:27.931756 24109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:19:27.933223 24109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:19:27.949782 24115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:27.950466 24117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:27.950496 24109 server_base.cc:1034] running on GCE node
W20260807 04:19:27.950764 24114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:27.951623 24109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:19:27.952692 24109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:19:27.954000 24109 hybrid_clock.cc:648] HybridClock initialized: now 1786076367953951 us; error 98 us; skew 500 ppm
I20260807 04:19:27.954375 24109 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:19:27 dist-test-slave-qg60 krb5kdc[22747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076367, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:19:27.957909 24109 init.cc:377] Logged in from keytab as kudu/127.7.200.194@KRBTEST.COM (short username kudu)
I20260807 04:19:27.959491 24109 webserver.cc:460] Webserver started at http://127.7.200.194:46667/ using document root <none> and password file <none>
I20260807 04:19:27.960184 24109 fs_manager.cc:359] Metadata directory not provided
I20260807 04:19:27.960289 24109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:19:27.966334 24109 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.003s
I20260807 04:19:27.969372 24124 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:27.970929 24109 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 04:19:27.971127 24109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "95f26855a5584d049517b1071b164d96"
format_stamp: "Formatted at 2026-08-07 04:19:21 on dist-test-slave-qg60"
server_key: "c5e85a2b0cc4246711b4df4702401288"
server_key_iv: "acac4033209c62b66b75660686770637"
server_key_version: "encryptionkey@0"
I20260807 04:19:27.972136 24109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:19:27.992121 24109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:19:27.997012 24109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:19:27.997351 24109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:19:27.998560 24109 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:19:28.000133 24109 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:19:28.000236 24109 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:28.000424 24109 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:19:28.000533 24109 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:28.040426 24109 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:36673
I20260807 04:19:28.040481 24239 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:36673 every 8 connection(s)
I20260807 04:19:28.042062 24109 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:19:28.042739 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 24109
I20260807 04:19:28.043609 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:41185
--local_ip_for_outbound_sockets=127.7.200.195
--tserver_master_addrs=127.7.200.254:35593
--webserver_port=41433
--webserver_interface=127.7.200.195
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:44791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 04:19:28.048101 24242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:28.045587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.194:43853)
0807 04:19:28.046533 (+ 946us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:28.046850 (+ 317us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":576,"thread_start_us":344,"threads_started":1}
W20260807 04:19:28.049059 24240 heartbeater.cc:644] Failed to heartbeat to 127.7.200.254:35593 (0 consecutive failures): Network error: Failed to ping master at 127.7.200.254:35593: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
I20260807 04:19:28.050168 24242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:28.049679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.194:58325)
0807 04:19:28.049888 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:28.050005 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260807 04:19:28.051191 24242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:28.050808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.194:60023)
0807 04:19:28.050988 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:28.051069 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260807 04:19:28.051537 24240 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 04:19:28.407919 24243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:19:28.408244 24243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:19:28.408465 24243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:19:28.416635 24243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:19:28.416777 24243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:19:28.416961 24243 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:19:28.427361 24243 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:44791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:41185
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=41433
--tserver_master_addrs=127.7.200.254:35593
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:19:28.428897 24243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:19:28.430347 24243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:19:28.444656 24248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:28.444573 24249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:28.444597 24251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:28.445693 24243 server_base.cc:1034] running on GCE node
I20260807 04:19:28.446316 24243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:19:28.447261 24243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:19:28.448500 24243 hybrid_clock.cc:648] HybridClock initialized: now 1786076368448438 us; error 43 us; skew 500 ppm
I20260807 04:19:28.448864 24243 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:19:28 dist-test-slave-qg60 krb5kdc[22747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076368, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:19:28.452127 24243 init.cc:377] Logged in from keytab as kudu/127.7.200.195@KRBTEST.COM (short username kudu)
I20260807 04:19:28.453718 24243 webserver.cc:460] Webserver started at http://127.7.200.195:41433/ using document root <none> and password file <none>
I20260807 04:19:28.454399 24243 fs_manager.cc:359] Metadata directory not provided
I20260807 04:19:28.454500 24243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:19:28.460098 24243 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 04:19:28.462924 24259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:28.464342 24243 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 04:19:28.464483 24243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "dedf5c84979746fc8dabdf755997edfa"
format_stamp: "Formatted at 2026-08-07 04:19:22 on dist-test-slave-qg60"
server_key: "e60329edbb36256f102c1a1a240fda04"
server_key_iv: "7b10d18fbf7bbe79d9412f3af1c50f7b"
server_key_version: "encryptionkey@0"
I20260807 04:19:28.465636 24243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:19:28.487231 24243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:19:28.491353 24243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:19:28.491657 24243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:19:28.492687 24243 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:19:28.494084 24243 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:19:28.494195 24243 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:28.494328 24243 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:19:28.494437 24243 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:28.532265 24243 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:41185
I20260807 04:19:28.532363 24374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:41185 every 8 connection(s)
I20260807 04:19:28.533833 24243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:19:28.538093 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 24243
I20260807 04:19:28.539249 24377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:28.536964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.195:40317)
0807 04:19:28.537744 (+ 780us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:28.538089 (+ 345us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":303,"threads_started":1}
W20260807 04:19:28.540167 24375 heartbeater.cc:644] Failed to heartbeat to 127.7.200.254:35593 (0 consecutive failures): Network error: Failed to ping master at 127.7.200.254:35593: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
I20260807 04:19:28.541157 24377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:28.540713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.195:43845)
0807 04:19:28.540961 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:28.541045 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260807 04:19:28.542057 24377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:28.541663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.195:53869)
0807 04:19:28.541798 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:28.541873 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260807 04:19:28.542315 24375 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 04:19:28.567652 24379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:28.566552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.193:37069)
0807 04:19:28.567336 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:28.567436 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":673,"thread_start_us":295,"threads_started":1}
I20260807 04:19:28.754784 24380 raft_consensus.cc:482] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:19:28.755137 24380 raft_consensus.cc:504] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c61112bec14a61ae16ca15538b1eaa" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32971 } } peers { permanent_uuid: "dedf5c84979746fc8dabdf755997edfa" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41185 } } peers { permanent_uuid: "95f26855a5584d049517b1071b164d96" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36673 } }
I20260807 04:19:28.757035 24380 leader_election.cc:288] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dedf5c84979746fc8dabdf755997edfa (127.7.200.195:41185), 95f26855a5584d049517b1071b164d96 (127.7.200.194:36673)
Aug 07 04:19:28 dist-test-slave-qg60 krb5kdc[22747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076367, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for kudu/127.7.200.195@KRBTEST.COM
Aug 07 04:19:28 dist-test-slave-qg60 krb5kdc[22747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076367, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for kudu/127.7.200.194@KRBTEST.COM
I20260807 04:19:28.780603 24381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:28.757426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:36673 (local address 127.7.200.193:45781)
0807 04:19:28.759015 (+ 1589us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:28.759038 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:28.759169 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:28.761911 (+ 2742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:28.761916 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:28.762744 (+ 828us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:19:28.763386 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:28.763407 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:28.765078 (+ 1671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:28.765084 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:28.767068 (+ 1984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:28.767081 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:28.768109 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:28.768116 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:28.768410 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:28.769287 (+ 877us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:19:28.769318 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:19:28.772338 (+ 3020us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:19:28.776592 (+ 4254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:28.776598 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:28.776602 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:28.777258 (+ 656us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:28.777849 (+ 591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:28.777856 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:28.777859 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:28.778091 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:28.779122 (+ 1031us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:19:28.779128 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:19:28.779303 (+ 175us) client_negotiation.cc:769] Sending connection context
0807 04:19:28.779509 (+ 206us) client_negotiation.cc:240] Negotiation successful
0807 04:19:28.780043 (+ 534us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1405,"mutex_wait_us":183,"spinlock_wait_cycles":13696,"thread_start_us":1214,"threads_started":1}
I20260807 04:19:28.780632 24382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:28.757596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:52109 (local address 127.7.200.195:41185)
0807 04:19:28.759465 (+ 1869us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:28.759475 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:28.759511 (+ 36us) server_negotiation.cc:407] Connection header received
0807 04:19:28.761083 (+ 1572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:28.761092 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:28.761448 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:28.761768 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:28.763620 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:28.764875 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:28.767205 (+ 2330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:28.767852 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:28.768064 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:28.772311 (+ 4247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:28.772319 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:28.772333 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:28.772376 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:28.775782 (+ 3406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:28.776694 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:28.776704 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:28.776712 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:28.777064 (+ 352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:28.777659 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:28.777665 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:28.777668 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:28.778545 (+ 877us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:28.778751 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:28.779687 (+ 936us) server_negotiation.cc:299] Negotiation successful
0807 04:19:28.780140 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1707,"thread_start_us":1527,"threads_started":1}
I20260807 04:19:28.780689 24379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:28.757181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:41185 (local address 127.7.200.193:52109)
0807 04:19:28.757398 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:28.757470 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:28.758068 (+ 598us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:28.761888 (+ 3820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:28.761901 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:28.762713 (+ 812us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:19:28.763390 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:28.763407 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:28.765093 (+ 1686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:28.765096 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:28.767062 (+ 1966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:28.767074 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:28.768084 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:28.768091 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:28.768394 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:28.769350 (+ 956us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:19:28.769367 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:19:28.772003 (+ 2636us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:19:28.775973 (+ 3970us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:28.775984 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:28.776000 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:28.776515 (+ 515us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:28.777233 (+ 718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:28.777238 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:28.777242 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:28.777541 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:28.778703 (+ 1162us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:19:28.778709 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:19:28.779110 (+ 401us) client_negotiation.cc:769] Sending connection context
0807 04:19:28.779441 (+ 331us) client_negotiation.cc:240] Negotiation successful
0807 04:19:28.780224 (+ 783us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89,"mutex_wait_us":412,"spinlock_wait_cycles":34560}
I20260807 04:19:28.780717 24383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:28.757842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:45781 (local address 127.7.200.194:36673)
0807 04:19:28.759693 (+ 1851us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:28.759703 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:28.759734 (+ 31us) server_negotiation.cc:407] Connection header received
0807 04:19:28.761307 (+ 1573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:28.761316 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:28.761650 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:28.761948 (+ 298us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:28.763599 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:28.764871 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:28.767213 (+ 2342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:28.767853 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:28.768090 (+ 237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:28.772627 (+ 4537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:28.772636 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:28.772648 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:28.772693 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:28.776406 (+ 3713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:28.777419 (+ 1013us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:28.777430 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:28.777437 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:28.777689 (+ 252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:28.778236 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:28.778241 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:28.778245 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:28.778961 (+ 716us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:28.779171 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:28.779782 (+ 611us) server_negotiation.cc:299] Negotiation successful
0807 04:19:28.780256 (+ 474us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1705,"thread_start_us":1563,"threads_started":1}
W20260807 04:19:28.784564 23990 leader_election.cc:341] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 95f26855a5584d049517b1071b164d96 (127.7.200.194:36673): Not found: Tablet not found: bfb6b037468445eb8815efae89fa4ccd
W20260807 04:19:28.784893 23989 leader_election.cc:341] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dedf5c84979746fc8dabdf755997edfa (127.7.200.195:41185): Not found: Tablet not found: bfb6b037468445eb8815efae89fa4ccd
I20260807 04:19:28.785082 23989 leader_election.cc:302] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2c61112bec14a61ae16ca15538b1eaa; no voters: 95f26855a5584d049517b1071b164d96, dedf5c84979746fc8dabdf755997edfa
I20260807 04:19:28.785565 24380 raft_consensus.cc:2726] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 04:19:29.053043 24384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:29.052077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.194:45533)
0807 04:19:29.052577 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:29.052788 (+ 211us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":228,"threads_started":1}
I20260807 04:19:29.543763 24385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:29.542959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.195:34067)
0807 04:19:29.543420 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:29.543564 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":220,"threads_started":1}
I20260807 04:19:29.569815 24386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:29.568927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.193:34721)
0807 04:19:29.569522 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:29.569614 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":323,"threads_started":1}
I20260807 04:19:30.054757 24387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:30.054048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.194:55001)
0807 04:19:30.054495 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:30.054582 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":229,"threads_started":1}
I20260807 04:19:30.445314 24388 raft_consensus.cc:482] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:19:30.445503 24388 raft_consensus.cc:504] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c61112bec14a61ae16ca15538b1eaa" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32971 } } peers { permanent_uuid: "dedf5c84979746fc8dabdf755997edfa" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41185 } } peers { permanent_uuid: "95f26855a5584d049517b1071b164d96" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36673 } }
I20260807 04:19:30.446180 24388 leader_election.cc:288] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dedf5c84979746fc8dabdf755997edfa (127.7.200.195:41185), 95f26855a5584d049517b1071b164d96 (127.7.200.194:36673)
W20260807 04:19:30.447173 23990 leader_election.cc:341] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 95f26855a5584d049517b1071b164d96 (127.7.200.194:36673): Not found: Tablet not found: bfb6b037468445eb8815efae89fa4ccd
W20260807 04:19:30.447358 23989 leader_election.cc:341] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dedf5c84979746fc8dabdf755997edfa (127.7.200.195:41185): Not found: Tablet not found: bfb6b037468445eb8815efae89fa4ccd
I20260807 04:19:30.447460 23989 leader_election.cc:302] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2c61112bec14a61ae16ca15538b1eaa; no voters: 95f26855a5584d049517b1071b164d96, dedf5c84979746fc8dabdf755997edfa
I20260807 04:19:30.447696 24388 raft_consensus.cc:2726] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 04:19:30.545851 24389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:30.544722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.195:40225)
0807 04:19:30.545400 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:30.545529 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":299,"threads_started":1}
I20260807 04:19:30.571812 24390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:30.570964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.193:55383)
0807 04:19:30.571494 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:30.571621 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":251,"threads_started":1}
I20260807 04:19:31.056501 24391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:31.055736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.194:44081)
0807 04:19:31.056240 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:31.056327 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":266,"threads_started":1}
I20260807 04:19:31.547832 24392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:31.546925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.195:40845)
0807 04:19:31.547518 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:31.547623 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":260,"threads_started":1}
I20260807 04:19:31.573698 24393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:31.572823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.193:59351)
0807 04:19:31.573434 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:31.573521 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":387,"threads_started":1}
I20260807 04:19:32.058563 24394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:32.057556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.194:59161)
0807 04:19:32.058251 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:32.058343 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":446,"threads_started":1}
I20260807 04:19:32.549932 24395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:32.549097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.195:43115)
0807 04:19:32.549631 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:32.549733 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":249,"threads_started":1}
I20260807 04:19:32.575609 24396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:32.574703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.193:52365)
0807 04:19:32.575266 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:32.575398 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":307,"threads_started":1}
I20260807 04:19:32.928511 24397 raft_consensus.cc:482] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:19:32.928808 24397 raft_consensus.cc:504] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c61112bec14a61ae16ca15538b1eaa" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32971 } } peers { permanent_uuid: "dedf5c84979746fc8dabdf755997edfa" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41185 } } peers { permanent_uuid: "95f26855a5584d049517b1071b164d96" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36673 } }
I20260807 04:19:32.929591 24397 leader_election.cc:288] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dedf5c84979746fc8dabdf755997edfa (127.7.200.195:41185), 95f26855a5584d049517b1071b164d96 (127.7.200.194:36673)
W20260807 04:19:32.930619 23989 leader_election.cc:341] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dedf5c84979746fc8dabdf755997edfa (127.7.200.195:41185): Not found: Tablet not found: bfb6b037468445eb8815efae89fa4ccd
W20260807 04:19:32.930817 23990 leader_election.cc:341] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 95f26855a5584d049517b1071b164d96 (127.7.200.194:36673): Not found: Tablet not found: bfb6b037468445eb8815efae89fa4ccd
I20260807 04:19:32.930953 23990 leader_election.cc:302] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2c61112bec14a61ae16ca15538b1eaa; no voters: 95f26855a5584d049517b1071b164d96, dedf5c84979746fc8dabdf755997edfa
I20260807 04:19:32.931213 24397 raft_consensus.cc:2726] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 04:19:33.061378 24398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:33.059738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.194:38193)
0807 04:19:33.061101 (+ 1363us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:33.061191 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1234,"thread_start_us":1082,"threads_started":1}
I20260807 04:19:33.551934 24399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:33.551057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.195:55407)
0807 04:19:33.551639 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:33.551752 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":298,"threads_started":1}
I20260807 04:19:33.577586 24400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:33.576822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.193:45709)
0807 04:19:33.577319 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:33.577414 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":265,"threads_started":1}
I20260807 04:19:34.063239 24401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:34.062387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.194:46301)
0807 04:19:34.062908 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:34.063050 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":280,"threads_started":1}
I20260807 04:19:34.553769 24402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:34.553021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.195:47343)
0807 04:19:34.553473 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:34.553557 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":234,"threads_started":1}
I20260807 04:19:34.579299 24403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:34.578551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.193:60185)
0807 04:19:34.579014 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:34.579101 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":232,"threads_started":1}
I20260807 04:19:35.065325 24404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:35.064313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.194:48389)
0807 04:19:35.064977 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:35.065090 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":267,"threads_started":1}
I20260807 04:19:35.555765 24405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:35.554736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.195:55555)
0807 04:19:35.555433 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:35.555536 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":354,"threads_started":1}
I20260807 04:19:35.581284 24407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:35.580305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.193:43693)
0807 04:19:35.581000 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:35.581113 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":300,"threads_started":1}
I20260807 04:19:36.067358 24408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:36.066552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.194:39719)
0807 04:19:36.067061 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:36.067159 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":266,"threads_started":1}
I20260807 04:19:36.558080 24409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:36.557045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.195:58241)
0807 04:19:36.557719 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:36.557824 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":283,"threads_started":1}
I20260807 04:19:36.583190 24410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:36.582306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.193:50411)
0807 04:19:36.582836 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:36.582988 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":271,"threads_started":1}
I20260807 04:19:36.681401 24411 raft_consensus.cc:482] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:19:36.681752 24411 raft_consensus.cc:504] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c61112bec14a61ae16ca15538b1eaa" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32971 } } peers { permanent_uuid: "dedf5c84979746fc8dabdf755997edfa" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41185 } } peers { permanent_uuid: "95f26855a5584d049517b1071b164d96" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36673 } }
I20260807 04:19:36.682739 24411 leader_election.cc:288] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dedf5c84979746fc8dabdf755997edfa (127.7.200.195:41185), 95f26855a5584d049517b1071b164d96 (127.7.200.194:36673)
W20260807 04:19:36.683830 23989 leader_election.cc:341] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dedf5c84979746fc8dabdf755997edfa (127.7.200.195:41185): Not found: Tablet not found: bfb6b037468445eb8815efae89fa4ccd
W20260807 04:19:36.684032 23990 leader_election.cc:341] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 95f26855a5584d049517b1071b164d96 (127.7.200.194:36673): Not found: Tablet not found: bfb6b037468445eb8815efae89fa4ccd
I20260807 04:19:36.684192 23990 leader_election.cc:302] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2c61112bec14a61ae16ca15538b1eaa; no voters: 95f26855a5584d049517b1071b164d96, dedf5c84979746fc8dabdf755997edfa
I20260807 04:19:36.684496 24411 raft_consensus.cc:2726] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 04:19:37.069337 24412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:37.068390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.194:32813)
0807 04:19:37.069057 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:37.069152 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":262,"threads_started":1}
I20260807 04:19:37.559998 24413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:37.559150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.195:43245)
0807 04:19:37.559721 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:37.559828 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":284,"threads_started":1}
I20260807 04:19:37.585201 24414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:37.584346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.193:35499)
0807 04:19:37.584929 (+ 583us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:37.585028 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":267,"threads_started":1}
I20260807 04:19:38.071331 24415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:38.070422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.194:43465)
0807 04:19:38.070963 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:38.071082 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":279,"threads_started":1}
I20260807 04:19:38.561872 24416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:38.561089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.195:40447)
0807 04:19:38.561562 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:38.561650 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":253,"threads_started":1}
I20260807 04:19:38.587052 24417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:38.586285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.193:34247)
0807 04:19:38.586752 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:38.586858 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":245,"threads_started":1}
I20260807 04:19:39.073159 24419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:39.072287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.194:38781)
0807 04:19:39.072877 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:39.072988 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":263,"threads_started":1}
I20260807 04:19:39.563644 24420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:39.562885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.195:54859)
0807 04:19:39.563393 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:39.563488 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":263,"threads_started":1}
I20260807 04:19:39.589041 24421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:39.588175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.193:35141)
0807 04:19:39.588659 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:39.588831 (+ 172us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":277,"threads_started":1}
I20260807 04:19:40.075032 24422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:40.074266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.194:49883)
0807 04:19:40.074754 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:40.074840 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":259,"threads_started":1}
I20260807 04:19:40.565783 24423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:40.564651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.195:41619)
0807 04:19:40.565239 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:40.565332 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":354,"threads_started":1}
I20260807 04:19:40.590917 24424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:40.590105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.193:46523)
0807 04:19:40.590652 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:40.590731 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":300,"threads_started":1}
I20260807 04:19:41.076900 24425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:41.075929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.194:41375)
0807 04:19:41.076523 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:41.076629 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":264,"threads_started":1}
I20260807 04:19:41.567922 24426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:41.566995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.195:44493)
0807 04:19:41.567600 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:41.567718 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":330,"threads_started":1}
I20260807 04:19:41.592626 24427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:41.591797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.193:42177)
0807 04:19:41.592349 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:41.592431 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":338,"threads_started":1}
I20260807 04:19:42.078588 24428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:42.077794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.194:48559)
0807 04:19:42.078269 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:42.078361 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":249,"threads_started":1}
I20260807 04:19:42.551316 24429 raft_consensus.cc:482] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:19:42.551545 24429 raft_consensus.cc:504] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2c61112bec14a61ae16ca15538b1eaa" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 32971 } } peers { permanent_uuid: "dedf5c84979746fc8dabdf755997edfa" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41185 } } peers { permanent_uuid: "95f26855a5584d049517b1071b164d96" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36673 } }
I20260807 04:19:42.552486 24429 leader_election.cc:288] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dedf5c84979746fc8dabdf755997edfa (127.7.200.195:41185), 95f26855a5584d049517b1071b164d96 (127.7.200.194:36673)
W20260807 04:19:42.553536 23990 leader_election.cc:341] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 95f26855a5584d049517b1071b164d96 (127.7.200.194:36673): Not found: Tablet not found: bfb6b037468445eb8815efae89fa4ccd
W20260807 04:19:42.553735 23989 leader_election.cc:341] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dedf5c84979746fc8dabdf755997edfa (127.7.200.195:41185): Not found: Tablet not found: bfb6b037468445eb8815efae89fa4ccd
I20260807 04:19:42.553906 23989 leader_election.cc:302] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2c61112bec14a61ae16ca15538b1eaa; no voters: 95f26855a5584d049517b1071b164d96, dedf5c84979746fc8dabdf755997edfa
I20260807 04:19:42.554189 24429 raft_consensus.cc:2726] T bfb6b037468445eb8815efae89fa4ccd P d2c61112bec14a61ae16ca15538b1eaa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 04:19:42.569885 24430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:42.569007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.195:48819)
0807 04:19:42.569592 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:42.569677 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":331,"threads_started":1}
I20260807 04:19:42.594732 24431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:42.593829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.193:32821)
0807 04:19:42.594356 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:42.594491 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":272,"threads_started":1}
I20260807 04:19:43.080555 24432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:43.079750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.194:34251)
0807 04:19:43.080254 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:43.080384 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":277,"threads_started":1}
I20260807 04:19:43.541613 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 23936
I20260807 04:19:43.560105 24433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:43.543130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56864 (local address 127.7.200.193:32971)
0807 04:19:43.544576 (+ 1446us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:43.544584 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:43.544612 (+ 28us) server_negotiation.cc:407] Connection header received
0807 04:19:43.544683 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:43.544690 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:43.544980 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:43.545129 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:43.546672 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:43.547681 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:43.548947 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:43.549550 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:43.549655 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:43.552459 (+ 2804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:43.552510 (+ 51us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:43.552524 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:43.552558 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:43.556486 (+ 3928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:43.557518 (+ 1032us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:43.557531 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:43.557538 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:43.557739 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:43.558218 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:43.558224 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:43.558227 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:43.558618 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:43.558951 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:43.559363 (+ 412us) server_negotiation.cc:299] Negotiation successful
0807 04:19:43.559652 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1295,"thread_start_us":301,"threads_started":1}
I20260807 04:19:43.561786 24101 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:19:43.572005 24435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:43.571166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.195:37945)
0807 04:19:43.571685 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:43.571794 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":267,"threads_started":1}
I20260807 04:19:43.655009 24436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:43.653930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:35593 (local address 127.7.200.193:56611)
0807 04:19:43.654483 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:43.654662 (+ 179us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:35593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":249,"threads_started":1}
I20260807 04:19:43.655009 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 23936
I20260807 04:19:43.676631 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 24109
I20260807 04:19:43.691461 24437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:43.677497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57142 (local address 127.7.200.194:36673)
0807 04:19:43.677988 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:43.677992 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:43.678009 (+ 17us) server_negotiation.cc:407] Connection header received
0807 04:19:43.678066 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:43.678070 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:43.678131 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:43.678225 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:43.679799 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:43.680578 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:43.681921 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:43.682417 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:43.682530 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:43.685741 (+ 3211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:43.685746 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:43.685749 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:43.685789 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:43.688681 (+ 2892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:43.689571 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:43.689575 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:43.689577 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:43.689712 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:43.690194 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:43.690198 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:43.690200 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:43.690478 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:43.690723 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:43.690982 (+ 259us) server_negotiation.cc:299] Negotiation successful
0807 04:19:43.691170 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":280,"threads_started":1}
I20260807 04:19:43.692255 24235 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:19:43.778050 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 24109
I20260807 04:19:43.799417 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 24243
I20260807 04:19:43.814086 24439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:43.800270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42448 (local address 127.7.200.195:41185)
0807 04:19:43.800889 (+ 619us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:43.800894 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:43.800912 (+ 18us) server_negotiation.cc:407] Connection header received
0807 04:19:43.800969 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:43.800973 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:43.801043 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:43.801134 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:43.802567 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:43.803516 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:43.805157 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:43.805604 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:43.805701 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:43.808307 (+ 2606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:43.808312 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:43.808315 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:43.808348 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:43.811297 (+ 2949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:43.812086 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:43.812090 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:43.812092 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:43.812234 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:43.812631 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:43.812635 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:43.812637 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:43.812952 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:43.813163 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:43.813449 (+ 286us) server_negotiation.cc:299] Negotiation successful
0807 04:19:43.813656 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":484,"thread_start_us":310,"threads_started":1}
I20260807 04:19:43.815006 24369 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:19:43.906867 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 24243
2026-08-07T04:19:43Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (25192 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:19:44 dist-test-slave-qg60 krb5kdc[24443](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:19:44 dist-test-slave-qg60 krb5kdc[24443](info): set up 2 sockets
Aug 07 04:19:44 dist-test-slave-qg60 krb5kdc[24443](info): commencing operation
krb5kdc: starting...
W20260807 04:19:45.098299 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.146s user 0.006s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:19:45 dist-test-slave-qg60 krb5kdc[24443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076385, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:19:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:19:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
I20260807 04:19:45.429009 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:33243
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:44215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:33243
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:19:45.802227 24456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:19:45.802613 24456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:19:45.802790 24456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:19:45.810353 24456 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 04:19:45.810503 24456 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 04:19:45.810591 24456 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 04:19:45.810688 24456 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:19:45.810791 24456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:19:45.810912 24456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:19:45.811009 24456 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:19:45.811093 24456 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:19:45.821476 24456 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:44215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:33243
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:33243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:19:45.822970 24456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:19:45.824383 24456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:19:45.837184 24463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:45.837321 24461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:45.837288 24465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:45.838218 24456 server_base.cc:1034] running on GCE node
I20260807 04:19:45.839084 24456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:19:45.840636 24456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:19:45.841909 24456 hybrid_clock.cc:648] HybridClock initialized: now 1786076385841843 us; error 37 us; skew 500 ppm
I20260807 04:19:45.842275 24456 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:19:45 dist-test-slave-qg60 krb5kdc[24443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076385, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:19:45.850726 24456 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:19:45.852864 24456 webserver.cc:460] Webserver started at http://127.7.200.254:43423/ using document root <none> and password file <none>
I20260807 04:19:45.853780 24456 fs_manager.cc:359] Metadata directory not provided
I20260807 04:19:45.853962 24456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:19:45.854359 24456 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:19:45.857916 24456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "3319b95142dc425da470194be83b15d6"
format_stamp: "Formatted at 2026-08-07 04:19:45 on dist-test-slave-qg60"
server_key: "c57806b9c706ea7d21a867083593f456"
server_key_iv: "02844981e93a2ef35c9aba1cf1c34feb"
server_key_version: "encryptionkey@0"
I20260807 04:19:45.858834 24456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "3319b95142dc425da470194be83b15d6"
format_stamp: "Formatted at 2026-08-07 04:19:45 on dist-test-slave-qg60"
server_key: "c57806b9c706ea7d21a867083593f456"
server_key_iv: "02844981e93a2ef35c9aba1cf1c34feb"
server_key_version: "encryptionkey@0"
I20260807 04:19:45.864835 24456 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260807 04:19:45.869232 24472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:45.870891 24456 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260807 04:19:45.871176 24456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "3319b95142dc425da470194be83b15d6"
format_stamp: "Formatted at 2026-08-07 04:19:45 on dist-test-slave-qg60"
server_key: "c57806b9c706ea7d21a867083593f456"
server_key_iv: "02844981e93a2ef35c9aba1cf1c34feb"
server_key_version: "encryptionkey@0"
I20260807 04:19:45.871443 24456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:19:45.891271 24456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:19:45.896360 24456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:19:45.896682 24456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:19:45.919957 24456 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:33243
I20260807 04:19:45.920017 24528 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:33243 every 8 connection(s)
I20260807 04:19:45.921572 24456 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:19:45.922529 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 24456
I20260807 04:19:45.922852 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:19:45.923707 7971 external_mini_cluster.cc:1428] Setting key ef522c93ed2cc0570b824d221fb9de7c
I20260807 04:19:45.927233 24529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 04:19:45 dist-test-slave-qg60 krb5kdc[24443](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076385, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:19:45.941454 24529 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6: Bootstrap starting.
I20260807 04:19:45.945844 24529 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6: Neither blocks nor log segments found. Creating new log.
I20260807 04:19:45.947309 24529 log.cc:824] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6: Log is configured to *not* fsync() on all Append() calls
I20260807 04:19:45.951229 24529 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6: No bootstrap required, opened a new log
I20260807 04:19:45.952493 24532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:45.925868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39450 (local address 127.7.200.254:33243)
0807 04:19:45.926846 (+ 978us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:45.926865 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:45.927245 (+ 380us) server_negotiation.cc:407] Connection header received
0807 04:19:45.929869 (+ 2624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:45.929898 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:45.930429 (+ 531us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:45.930934 (+ 505us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:45.932455 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:45.934693 (+ 2238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:45.936333 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:45.937477 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:45.937687 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:45.942719 (+ 5032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:45.942731 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:45.942754 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:45.942812 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:45.947198 (+ 4386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:45.948340 (+ 1142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:45.948347 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:45.948353 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:45.948526 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:45.949104 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:45.949111 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:45.949119 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:45.949883 (+ 764us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:45.950192 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:45.950656 (+ 464us) server_negotiation.cc:299] Negotiation successful
0807 04:19:45.951109 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":680,"thread_start_us":430,"threads_started":1}
I20260807 04:19:45.959204 24529 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3319b95142dc425da470194be83b15d6" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 33243 } }
I20260807 04:19:45.959565 24529 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:19:45.959641 24529 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3319b95142dc425da470194be83b15d6, State: Initialized, Role: FOLLOWER
I20260807 04:19:45.960248 24529 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3319b95142dc425da470194be83b15d6" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 33243 } }
I20260807 04:19:45.960577 24529 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:19:45.960768 24529 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:19:45.960994 24529 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:19:45.963171 24529 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3319b95142dc425da470194be83b15d6" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 33243 } }
I20260807 04:19:45.963675 24529 leader_election.cc:302] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3319b95142dc425da470194be83b15d6; no voters:
I20260807 04:19:45.964275 24529 leader_election.cc:288] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:19:45.964435 24534 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:19:45.965207 24534 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [term 1 LEADER]: Becoming Leader. State: Replica: 3319b95142dc425da470194be83b15d6, State: Running, Role: LEADER
I20260807 04:19:45.965875 24534 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3319b95142dc425da470194be83b15d6" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 33243 } }
I20260807 04:19:45.966672 24529 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:19:45.968778 24536 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3319b95142dc425da470194be83b15d6. Latest consensus state: current_term: 1 leader_uuid: "3319b95142dc425da470194be83b15d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3319b95142dc425da470194be83b15d6" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 33243 } } }
I20260807 04:19:45.969278 24536 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [sys.catalog]: This master's current role is: LEADER
I20260807 04:19:45.970183 24542 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:19:45.970005 24535 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3319b95142dc425da470194be83b15d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3319b95142dc425da470194be83b15d6" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 33243 } } }
I20260807 04:19:45.970759 24535 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [sys.catalog]: This master's current role is: LEADER
I20260807 04:19:45.976469 24542 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:19:45.990286 24542 catalog_manager.cc:1347] Generated new cluster ID: 62fc90204ef344ea88c2afd9580e0a98
I20260807 04:19:45.990427 24542 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:19:46.004290 24542 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:19:46.006340 24542 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:19:46.016460 24542 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6: Generated new TSK 0
I20260807 04:19:46.017591 24542 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.200.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
I20260807 04:19:46.092181 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:0
--local_ip_for_outbound_sockets=127.7.200.193
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:33243
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:44215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:19:46.442615 24555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:19:46.442884 24555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:19:46.442981 24555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:19:46.450196 24555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:19:46.450310 24555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:19:46.450423 24555 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:19:46.460667 24555 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:44215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:33243
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:19:46.461990 24555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:19:46.463291 24555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:19:46.477413 24560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:46.477384 24563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:46.477329 24561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:46.478354 24555 server_base.cc:1034] running on GCE node
I20260807 04:19:46.478938 24555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:19:46.479903 24555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:19:46.481112 24555 hybrid_clock.cc:648] HybridClock initialized: now 1786076386481057 us; error 48 us; skew 500 ppm
I20260807 04:19:46.481453 24555 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:19:46 dist-test-slave-qg60 krb5kdc[24443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076386, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:19:46.484910 24555 init.cc:377] Logged in from keytab as kudu/127.7.200.193@KRBTEST.COM (short username kudu)
I20260807 04:19:46.486433 24555 webserver.cc:460] Webserver started at http://127.7.200.193:38665/ using document root <none> and password file <none>
I20260807 04:19:46.487177 24555 fs_manager.cc:359] Metadata directory not provided
I20260807 04:19:46.487284 24555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:19:46.487654 24555 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:19:46.491046 24555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/data/instance:
uuid: "7c2a6448647747aca04385a2c27a6f23"
format_stamp: "Formatted at 2026-08-07 04:19:46 on dist-test-slave-qg60"
server_key: "1433c1e1e0a26d0b2e91b7c6ed70b54c"
server_key_iv: "8dec78025135586da77ac0fc7e4cc10c"
server_key_version: "encryptionkey@0"
I20260807 04:19:46.491873 24555 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance:
uuid: "7c2a6448647747aca04385a2c27a6f23"
format_stamp: "Formatted at 2026-08-07 04:19:46 on dist-test-slave-qg60"
server_key: "1433c1e1e0a26d0b2e91b7c6ed70b54c"
server_key_iv: "8dec78025135586da77ac0fc7e4cc10c"
server_key_version: "encryptionkey@0"
I20260807 04:19:46.497213 24555 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260807 04:19:46.500835 24570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:46.502285 24555 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:19:46.502429 24555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "7c2a6448647747aca04385a2c27a6f23"
format_stamp: "Formatted at 2026-08-07 04:19:46 on dist-test-slave-qg60"
server_key: "1433c1e1e0a26d0b2e91b7c6ed70b54c"
server_key_iv: "8dec78025135586da77ac0fc7e4cc10c"
server_key_version: "encryptionkey@0"
I20260807 04:19:46.502662 24555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:19:46.517660 24555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:19:46.522274 24555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:19:46.522605 24555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:19:46.523654 24555 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:19:46.525141 24555 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:19:46.525220 24555 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:46.525365 24555 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:19:46.525422 24555 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:46.561121 24555 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:37671
I20260807 04:19:46.561249 24690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:37671 every 8 connection(s)
I20260807 04:19:46.562527 24555 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:19:46.564064 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 24555
I20260807 04:19:46.564350 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance
I20260807 04:19:46.565380 7971 external_mini_cluster.cc:1428] Setting key 3e19ebcbca88472104bb9decc75a9f66
Aug 07 04:19:46 dist-test-slave-qg60 krb5kdc[24443](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076386, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:19:46.590044 24693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:46.566075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:56981 (local address 127.7.200.254:33243)
0807 04:19:46.573185 (+ 7110us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:46.573192 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:46.573217 (+ 25us) server_negotiation.cc:407] Connection header received
0807 04:19:46.574059 (+ 842us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:46.574066 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:46.574164 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:46.574309 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:46.576155 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:46.577142 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:46.578889 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:46.579358 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:46.579517 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:46.583640 (+ 4123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:46.583646 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:46.583649 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:46.583707 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:46.586412 (+ 2705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:46.587485 (+ 1073us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:46.587489 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:46.587492 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:46.587607 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:46.588122 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:46.588126 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:46.588127 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:46.588388 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:46.588509 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:46.589604 (+ 1095us) server_negotiation.cc:299] Negotiation successful
0807 04:19:46.589783 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6963,"thread_start_us":6599,"threads_started":1}
I20260807 04:19:46.591805 24694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:46.566750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.193:56981)
0807 04:19:46.571320 (+ 4570us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:46.571398 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:46.573749 (+ 2351us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:46.574593 (+ 844us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:46.574603 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:46.575241 (+ 638us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:19:46.575962 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:46.575983 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:46.577330 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:46.577335 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:46.578707 (+ 1372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:46.578721 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:46.579646 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:46.579654 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:46.579916 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:46.580712 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:19:46.580800 (+ 88us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:19:46.583397 (+ 2597us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:19:46.586571 (+ 3174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:46.586584 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:46.586604 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:46.587359 (+ 755us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:46.587721 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:46.587729 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:46.587737 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:46.588003 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:46.588524 (+ 521us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:19:46.588535 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:19:46.589088 (+ 553us) client_negotiation.cc:769] Sending connection context
0807 04:19:46.589501 (+ 413us) client_negotiation.cc:240] Negotiation successful
0807 04:19:46.590147 (+ 646us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4236,"thread_start_us":3900,"threads_started":1}
I20260807 04:19:46.593662 24691 heartbeater.cc:347] Connected to a master server at 127.7.200.254:33243
I20260807 04:19:46.594012 24691 heartbeater.cc:464] Registering TS with master...
I20260807 04:19:46.594758 24691 heartbeater.cc:511] Master 127.7.200.254:33243 requested a full tablet report, sending...
I20260807 04:19:46.597381 24492 ts_manager.cc:194] Registered new tserver with Master: 7c2a6448647747aca04385a2c27a6f23 (127.7.200.193:37671)
I20260807 04:19:46.599956 24492 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.193@KRBTEST.COM'} at 127.7.200.193:56981
WARNING: no policy specified for kudu/127.7.200.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
I20260807 04:19:46.640717 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:0
--local_ip_for_outbound_sockets=127.7.200.194
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:33243
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:44215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:19:46.991948 24697 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:19:46.992257 24697 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:19:46.992355 24697 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:19:46.999895 24697 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:19:47.000077 24697 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:19:47.000283 24697 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:19:47.010852 24697 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:44215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:33243
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:19:47.012279 24697 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:19:47.013659 24697 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:19:47.027329 24702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:47.027302 24703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:47.027398 24705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:47.028115 24697 server_base.cc:1034] running on GCE node
I20260807 04:19:47.028976 24697 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:19:47.029970 24697 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:19:47.031184 24697 hybrid_clock.cc:648] HybridClock initialized: now 1786076387031145 us; error 31 us; skew 500 ppm
I20260807 04:19:47.031466 24697 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:19:47 dist-test-slave-qg60 krb5kdc[24443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076387, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:19:47.034825 24697 init.cc:377] Logged in from keytab as kudu/127.7.200.194@KRBTEST.COM (short username kudu)
I20260807 04:19:47.036486 24697 webserver.cc:460] Webserver started at http://127.7.200.194:39537/ using document root <none> and password file <none>
I20260807 04:19:47.037279 24697 fs_manager.cc:359] Metadata directory not provided
I20260807 04:19:47.037420 24697 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:19:47.037768 24697 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:19:47.041389 24697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/data/instance:
uuid: "d28d786ca0584e44be07550f5e15eeb4"
format_stamp: "Formatted at 2026-08-07 04:19:47 on dist-test-slave-qg60"
server_key: "c13774cf67abd51c61da3dbfba497db2"
server_key_iv: "a5c23015f7a979d59ac2b914bb849c91"
server_key_version: "encryptionkey@0"
I20260807 04:19:47.042246 24697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance:
uuid: "d28d786ca0584e44be07550f5e15eeb4"
format_stamp: "Formatted at 2026-08-07 04:19:47 on dist-test-slave-qg60"
server_key: "c13774cf67abd51c61da3dbfba497db2"
server_key_iv: "a5c23015f7a979d59ac2b914bb849c91"
server_key_version: "encryptionkey@0"
I20260807 04:19:47.047588 24697 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 04:19:47.051147 24712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:47.052520 24697 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 04:19:47.052702 24697 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "d28d786ca0584e44be07550f5e15eeb4"
format_stamp: "Formatted at 2026-08-07 04:19:47 on dist-test-slave-qg60"
server_key: "c13774cf67abd51c61da3dbfba497db2"
server_key_iv: "a5c23015f7a979d59ac2b914bb849c91"
server_key_version: "encryptionkey@0"
I20260807 04:19:47.052963 24697 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:19:47.074054 24697 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:19:47.078987 24697 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:19:47.079316 24697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:19:47.080411 24697 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:19:47.081846 24697 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:19:47.081959 24697 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:47.082126 24697 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:19:47.082199 24697 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:47.118191 24697 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:38375
I20260807 04:19:47.118283 24828 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:38375 every 8 connection(s)
I20260807 04:19:47.119513 24697 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:19:47.126847 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 24697
I20260807 04:19:47.127085 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance
I20260807 04:19:47.127568 7971 external_mini_cluster.cc:1428] Setting key eb1d5ee54d81ff364bf0179590635798
Aug 07 04:19:47 dist-test-slave-qg60 krb5kdc[24443](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076387, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:19:47.141579 24831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:47.122209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:37343 (local address 127.7.200.254:33243)
0807 04:19:47.122665 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:47.122669 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:47.123461 (+ 792us) server_negotiation.cc:407] Connection header received
0807 04:19:47.125449 (+ 1988us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:47.125454 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:47.125543 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:47.125850 (+ 307us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:47.127605 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:47.128474 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:47.130670 (+ 2196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:47.131384 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:47.131575 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:47.135350 (+ 3775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:47.135355 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:47.135358 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:47.135391 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:47.138235 (+ 2844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:47.139035 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:47.139040 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:47.139042 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:47.139180 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:47.139699 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:47.139703 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:47.139705 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:47.139987 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:47.140150 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:47.140954 (+ 804us) server_negotiation.cc:299] Negotiation successful
0807 04:19:47.141192 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":245,"threads_started":1}
I20260807 04:19:47.142760 24832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:47.122586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.194:37343)
0807 04:19:47.123296 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:47.123336 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:47.125178 (+ 1842us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:47.126106 (+ 928us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:47.126115 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:47.126703 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:19:47.127421 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:47.127443 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:47.128696 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:47.128705 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:47.130507 (+ 1802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:47.130521 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:47.131649 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:47.131654 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:47.131856 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:47.132654 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:19:47.132683 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:19:47.135086 (+ 2403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:19:47.138391 (+ 3305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:47.138401 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:47.138419 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:47.138880 (+ 461us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:47.139304 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:47.139310 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:47.139314 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:47.139561 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:47.140123 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:19:47.140132 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:19:47.140501 (+ 369us) client_negotiation.cc:769] Sending connection context
0807 04:19:47.140840 (+ 339us) client_negotiation.cc:240] Negotiation successful
0807 04:19:47.141410 (+ 570us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":270,"threads_started":1}
I20260807 04:19:47.144496 24829 heartbeater.cc:347] Connected to a master server at 127.7.200.254:33243
I20260807 04:19:47.144876 24829 heartbeater.cc:464] Registering TS with master...
I20260807 04:19:47.145632 24829 heartbeater.cc:511] Master 127.7.200.254:33243 requested a full tablet report, sending...
I20260807 04:19:47.147356 24492 ts_manager.cc:194] Registered new tserver with Master: d28d786ca0584e44be07550f5e15eeb4 (127.7.200.194:38375)
I20260807 04:19:47.148667 24492 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.194@KRBTEST.COM'} at 127.7.200.194:37343
WARNING: no policy specified for kudu/127.7.200.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
I20260807 04:19:47.200382 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:0
--local_ip_for_outbound_sockets=127.7.200.195
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:33243
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:44215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:19:47.561009 24835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:19:47.561408 24835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:19:47.561589 24835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:19:47.571832 24835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:19:47.572001 24835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:19:47.572235 24835 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:19:47.583704 24835 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:44215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:33243
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:19:47.585148 24835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:19:47.586519 24835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:19:47.600134 24840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:47.600235 24841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:19:47.600122 24843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:19:47.601315 24835 server_base.cc:1034] running on GCE node
I20260807 04:19:47.601933 24835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:19:47.602943 24835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:19:47.603287 24691 heartbeater.cc:503] Master 127.7.200.254:33243 was elected leader, sending a full tablet report...
I20260807 04:19:47.604230 24835 hybrid_clock.cc:648] HybridClock initialized: now 1786076387604150 us; error 55 us; skew 500 ppm
I20260807 04:19:47.604651 24835 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:19:47 dist-test-slave-qg60 krb5kdc[24443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076387, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:19:47.608263 24835 init.cc:377] Logged in from keytab as kudu/127.7.200.195@KRBTEST.COM (short username kudu)
I20260807 04:19:47.609805 24835 webserver.cc:460] Webserver started at http://127.7.200.195:36123/ using document root <none> and password file <none>
I20260807 04:19:47.610613 24835 fs_manager.cc:359] Metadata directory not provided
I20260807 04:19:47.610764 24835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:19:47.611088 24835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:19:47.614270 24835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/data/instance:
uuid: "accb8bfbee134c56a80bee01a851008c"
format_stamp: "Formatted at 2026-08-07 04:19:47 on dist-test-slave-qg60"
server_key: "a53350da6539d9575730382ab4a1b01e"
server_key_iv: "1609b82d5159674639c9a80903a9a731"
server_key_version: "encryptionkey@0"
I20260807 04:19:47.615077 24835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance:
uuid: "accb8bfbee134c56a80bee01a851008c"
format_stamp: "Formatted at 2026-08-07 04:19:47 on dist-test-slave-qg60"
server_key: "a53350da6539d9575730382ab4a1b01e"
server_key_iv: "1609b82d5159674639c9a80903a9a731"
server_key_version: "encryptionkey@0"
I20260807 04:19:47.620704 24835 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260807 04:19:47.624583 24850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:47.626163 24835 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 04:19:47.626363 24835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "accb8bfbee134c56a80bee01a851008c"
format_stamp: "Formatted at 2026-08-07 04:19:47 on dist-test-slave-qg60"
server_key: "a53350da6539d9575730382ab4a1b01e"
server_key_iv: "1609b82d5159674639c9a80903a9a731"
server_key_version: "encryptionkey@0"
I20260807 04:19:47.626597 24835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:19:47.651513 24835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:19:47.656211 24835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:19:47.656543 24835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:19:47.657775 24835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:19:47.659247 24835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:19:47.659374 24835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:47.659523 24835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:19:47.659600 24835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:19:47.696647 24835 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:39751
I20260807 04:19:47.696795 24968 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:39751 every 8 connection(s)
I20260807 04:19:47.698025 24835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:19:47.702642 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 24835
I20260807 04:19:47.702859 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance
I20260807 04:19:47.703450 7971 external_mini_cluster.cc:1428] Setting key 8f197af04f13f37d7d1a12009e8b9a34
Aug 07 04:19:47 dist-test-slave-qg60 krb5kdc[24443](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076387, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:19:47.721257 24971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:47.701006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:40121 (local address 127.7.200.254:33243)
0807 04:19:47.701528 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:47.701532 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:47.702515 (+ 983us) server_negotiation.cc:407] Connection header received
0807 04:19:47.705240 (+ 2725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:47.705243 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:47.705322 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:47.705415 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:47.707337 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:47.708259 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:47.710434 (+ 2175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:47.710827 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:47.710927 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:47.714842 (+ 3915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:47.714847 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:47.714851 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:47.714893 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:47.718056 (+ 3163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:47.718845 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:47.718850 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:47.718854 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:47.718994 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:47.719438 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:47.719443 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:47.719446 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:47.719719 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:47.719891 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:47.720603 (+ 712us) server_negotiation.cc:299] Negotiation successful
0807 04:19:47.720863 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":273,"threads_started":1}
I20260807 04:19:47.722227 24972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:47.701408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.195:40121)
0807 04:19:47.702290 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:47.702344 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:47.704807 (+ 2463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:47.705719 (+ 912us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:47.705727 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:47.706421 (+ 694us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:19:47.707180 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:47.707200 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:47.708429 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:47.708433 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:47.710293 (+ 1860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:47.710306 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:47.711103 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:47.711109 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:47.711335 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:47.712061 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:19:47.712087 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:19:47.714601 (+ 2514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:19:47.718229 (+ 3628us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:47.718239 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:47.718263 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:47.718712 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:47.719112 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:19:47.719117 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:19:47.719121 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:19:47.719316 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:19:47.719861 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:19:47.719869 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:19:47.720216 (+ 347us) client_negotiation.cc:769] Sending connection context
0807 04:19:47.720505 (+ 289us) client_negotiation.cc:240] Negotiation successful
0807 04:19:47.721080 (+ 575us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":294,"threads_started":1}
I20260807 04:19:47.723703 24969 heartbeater.cc:347] Connected to a master server at 127.7.200.254:33243
I20260807 04:19:47.724071 24969 heartbeater.cc:464] Registering TS with master...
I20260807 04:19:47.724959 24969 heartbeater.cc:511] Master 127.7.200.254:33243 requested a full tablet report, sending...
I20260807 04:19:47.726625 24492 ts_manager.cc:194] Registered new tserver with Master: accb8bfbee134c56a80bee01a851008c (127.7.200.195:39751)
I20260807 04:19:47.727553 24492 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.195@KRBTEST.COM'} at 127.7.200.195:40121
I20260807 04:19:47.732303 7971 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 04:19:47.752012 24971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:47.737170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39454 (local address 127.7.200.254:33243)
0807 04:19:47.737350 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:47.737355 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:47.737927 (+ 572us) server_negotiation.cc:407] Connection header received
0807 04:19:47.738090 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:47.738093 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:47.738156 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:47.738241 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:47.739950 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:47.740695 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:47.742401 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:47.742854 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:47.743021 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:47.746053 (+ 3032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:47.746066 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:47.746070 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:47.746107 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:47.749072 (+ 2965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:47.749813 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:47.749819 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:47.749823 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:47.749961 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:47.750384 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:47.750389 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:47.750392 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:47.750743 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:47.751044 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:47.751405 (+ 361us) server_negotiation.cc:299] Negotiation successful
0807 04:19:47.751672 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 04:19:47.756657 24492 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39454:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:19:47.763765 24492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:19:47.799978 24986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:47.778430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40524 (local address 127.7.200.195:39751)
0807 04:19:47.789669 (+ 11239us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:47.789679 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:47.789837 (+ 158us) server_negotiation.cc:407] Connection header received
0807 04:19:47.790403 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:47.790414 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:47.790711 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:47.790908 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:19:47.792270 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:47.794192 (+ 1922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:47.797079 (+ 2887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:47.798697 (+ 1618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:47.798853 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:47.799122 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:47.799400 (+ 278us) server_negotiation.cc:299] Negotiation successful
0807 04:19:47.799608 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11021,"thread_start_us":11253,"threads_started":1}
I20260807 04:19:47.800175 24983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:47.777727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:39751 (local address 127.0.0.1:40524)
0807 04:19:47.789660 (+ 11933us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:47.789695 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:47.790169 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:47.791371 (+ 1202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:47.791379 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:47.791416 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:19:47.792002 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:47.792017 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:47.794410 (+ 2393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:47.794415 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:47.796894 (+ 2479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:47.796909 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:47.798916 (+ 2007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:47.798922 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:47.799147 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:47.799206 (+ 59us) client_negotiation.cc:769] Sending connection context
0807 04:19:47.799352 (+ 146us) client_negotiation.cc:240] Negotiation successful
0807 04:19:47.799582 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11744,"mutex_wait_us":2,"thread_start_us":6554,"threads_started":1}
I20260807 04:19:47.800794 24985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:47.777564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37671 (local address 127.0.0.1:46060)
0807 04:19:47.784915 (+ 7351us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:47.785002 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:47.785274 (+ 272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:47.790678 (+ 5404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:47.790692 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:47.790737 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:19:47.791401 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:47.791421 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:47.795098 (+ 3677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:47.795106 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:47.797350 (+ 2244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:47.797362 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:47.799565 (+ 2203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:47.799573 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:47.799793 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:47.799841 (+ 48us) client_negotiation.cc:769] Sending connection context
0807 04:19:47.799927 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 04:19:47.800102 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6923,"thread_start_us":12300,"threads_started":1}
I20260807 04:19:47.802198 24984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:47.777637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46060 (local address 127.7.200.193:37671)
0807 04:19:47.789483 (+ 11846us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:47.789495 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:47.789535 (+ 40us) server_negotiation.cc:407] Connection header received
0807 04:19:47.789671 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:47.789681 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:47.790000 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:47.790253 (+ 253us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:19:47.791732 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:47.794909 (+ 3177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:47.797602 (+ 2693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:47.799271 (+ 1669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:47.801396 (+ 2125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:47.801655 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:47.801735 (+ 80us) server_negotiation.cc:299] Negotiation successful
0807 04:19:47.801922 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11610,"thread_start_us":11112,"threads_started":1}
I20260807 04:19:47.803607 24988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:47.790080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:38375 (local address 127.0.0.1:49272)
0807 04:19:47.794064 (+ 3984us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:47.794088 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:47.794219 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:47.794951 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:47.794959 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:47.794996 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:19:47.795660 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:47.795681 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:47.797562 (+ 1881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:47.797568 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:47.799974 (+ 2406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:47.799988 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:47.802835 (+ 2847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:47.802841 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:47.803009 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:47.803040 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 04:19:47.803129 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 04:19:47.803263 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3856,"thread_start_us":3797,"threads_started":1}
I20260807 04:19:47.803900 24987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:47.785781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49272 (local address 127.7.200.194:38375)
0807 04:19:47.793831 (+ 8050us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:47.793844 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:47.794352 (+ 508us) server_negotiation.cc:407] Connection header received
0807 04:19:47.794458 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:47.794468 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:47.794718 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:47.794914 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:19:47.795867 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:47.797407 (+ 1540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:47.800405 (+ 2998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:47.802327 (+ 1922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:47.802481 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:47.802694 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:47.803321 (+ 627us) server_negotiation.cc:299] Negotiation successful
0807 04:19:47.803533 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7830,"thread_start_us":7674,"threads_started":1}
I20260807 04:19:47.804800 24900 tablet_service.cc:1467] Processing CreateTablet for tablet 6e44d37d8a354698b2558944a1b43be6 (DEFAULT_TABLE table=test-table [id=9c13b562b05f44e58f4122a69e7861ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:19:47.806355 24900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e44d37d8a354698b2558944a1b43be6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:19:47.806221 24620 tablet_service.cc:1467] Processing CreateTablet for tablet 6e44d37d8a354698b2558944a1b43be6 (DEFAULT_TABLE table=test-table [id=9c13b562b05f44e58f4122a69e7861ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:19:47.807794 24620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e44d37d8a354698b2558944a1b43be6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:19:47.808072 24762 tablet_service.cc:1467] Processing CreateTablet for tablet 6e44d37d8a354698b2558944a1b43be6 (DEFAULT_TABLE table=test-table [id=9c13b562b05f44e58f4122a69e7861ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:19:47.809530 24762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e44d37d8a354698b2558944a1b43be6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:19:47.819250 24989 tablet_bootstrap.cc:492] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c: Bootstrap starting.
I20260807 04:19:47.822207 24989 tablet_bootstrap.cc:654] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c: Neither blocks nor log segments found. Creating new log.
I20260807 04:19:47.823289 24989 log.cc:824] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c: Log is configured to *not* fsync() on all Append() calls
I20260807 04:19:47.826409 24989 tablet_bootstrap.cc:492] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c: No bootstrap required, opened a new log
I20260807 04:19:47.826731 24989 ts_tablet_manager.cc:1397] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.005s
I20260807 04:19:47.827656 24992 tablet_bootstrap.cc:492] T 6e44d37d8a354698b2558944a1b43be6 P d28d786ca0584e44be07550f5e15eeb4: Bootstrap starting.
I20260807 04:19:47.828298 24991 tablet_bootstrap.cc:492] T 6e44d37d8a354698b2558944a1b43be6 P 7c2a6448647747aca04385a2c27a6f23: Bootstrap starting.
I20260807 04:19:47.831949 24992 tablet_bootstrap.cc:654] T 6e44d37d8a354698b2558944a1b43be6 P d28d786ca0584e44be07550f5e15eeb4: Neither blocks nor log segments found. Creating new log.
I20260807 04:19:47.832124 24991 tablet_bootstrap.cc:654] T 6e44d37d8a354698b2558944a1b43be6 P 7c2a6448647747aca04385a2c27a6f23: Neither blocks nor log segments found. Creating new log.
I20260807 04:19:47.833352 24991 log.cc:824] T 6e44d37d8a354698b2558944a1b43be6 P 7c2a6448647747aca04385a2c27a6f23: Log is configured to *not* fsync() on all Append() calls
I20260807 04:19:47.833356 24992 log.cc:824] T 6e44d37d8a354698b2558944a1b43be6 P d28d786ca0584e44be07550f5e15eeb4: Log is configured to *not* fsync() on all Append() calls
I20260807 04:19:47.836772 24991 tablet_bootstrap.cc:492] T 6e44d37d8a354698b2558944a1b43be6 P 7c2a6448647747aca04385a2c27a6f23: No bootstrap required, opened a new log
I20260807 04:19:47.837064 24991 ts_tablet_manager.cc:1397] T 6e44d37d8a354698b2558944a1b43be6 P 7c2a6448647747aca04385a2c27a6f23: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.005s
I20260807 04:19:47.838471 24992 tablet_bootstrap.cc:492] T 6e44d37d8a354698b2558944a1b43be6 P d28d786ca0584e44be07550f5e15eeb4: No bootstrap required, opened a new log
I20260807 04:19:47.838377 24989 raft_consensus.cc:348] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c2a6448647747aca04385a2c27a6f23" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37671 } } peers { permanent_uuid: "accb8bfbee134c56a80bee01a851008c" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39751 } } peers { permanent_uuid: "d28d786ca0584e44be07550f5e15eeb4" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 38375 } }
I20260807 04:19:47.838781 24992 ts_tablet_manager.cc:1397] T 6e44d37d8a354698b2558944a1b43be6 P d28d786ca0584e44be07550f5e15eeb4: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260807 04:19:47.838876 24989 raft_consensus.cc:374] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:19:47.838963 24989 raft_consensus.cc:729] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: accb8bfbee134c56a80bee01a851008c, State: Initialized, Role: FOLLOWER
I20260807 04:19:47.839608 24989 consensus_queue.cc:260] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c2a6448647747aca04385a2c27a6f23" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37671 } } peers { permanent_uuid: "accb8bfbee134c56a80bee01a851008c" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39751 } } peers { permanent_uuid: "d28d786ca0584e44be07550f5e15eeb4" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 38375 } }
I20260807 04:19:47.844532 24969 heartbeater.cc:503] Master 127.7.200.254:33243 was elected leader, sending a full tablet report...
I20260807 04:19:47.845324 24989 ts_tablet_manager.cc:1428] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c: Time spent starting tablet: real 0.018s user 0.020s sys 0.000s
I20260807 04:19:47.847800 24992 raft_consensus.cc:348] T 6e44d37d8a354698b2558944a1b43be6 P d28d786ca0584e44be07550f5e15eeb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c2a6448647747aca04385a2c27a6f23" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37671 } } peers { permanent_uuid: "accb8bfbee134c56a80bee01a851008c" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39751 } } peers { permanent_uuid: "d28d786ca0584e44be07550f5e15eeb4" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 38375 } }
I20260807 04:19:47.848294 24992 raft_consensus.cc:374] T 6e44d37d8a354698b2558944a1b43be6 P d28d786ca0584e44be07550f5e15eeb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:19:47.848415 24992 raft_consensus.cc:729] T 6e44d37d8a354698b2558944a1b43be6 P d28d786ca0584e44be07550f5e15eeb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28d786ca0584e44be07550f5e15eeb4, State: Initialized, Role: FOLLOWER
I20260807 04:19:47.849141 24992 consensus_queue.cc:260] T 6e44d37d8a354698b2558944a1b43be6 P d28d786ca0584e44be07550f5e15eeb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c2a6448647747aca04385a2c27a6f23" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37671 } } peers { permanent_uuid: "accb8bfbee134c56a80bee01a851008c" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39751 } } peers { permanent_uuid: "d28d786ca0584e44be07550f5e15eeb4" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 38375 } }
I20260807 04:19:47.849309 24991 raft_consensus.cc:348] T 6e44d37d8a354698b2558944a1b43be6 P 7c2a6448647747aca04385a2c27a6f23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c2a6448647747aca04385a2c27a6f23" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37671 } } peers { permanent_uuid: "accb8bfbee134c56a80bee01a851008c" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39751 } } peers { permanent_uuid: "d28d786ca0584e44be07550f5e15eeb4" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 38375 } }
I20260807 04:19:47.849761 24991 raft_consensus.cc:374] T 6e44d37d8a354698b2558944a1b43be6 P 7c2a6448647747aca04385a2c27a6f23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:19:47.849867 24991 raft_consensus.cc:729] T 6e44d37d8a354698b2558944a1b43be6 P 7c2a6448647747aca04385a2c27a6f23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2a6448647747aca04385a2c27a6f23, State: Initialized, Role: FOLLOWER
I20260807 04:19:47.850593 24829 heartbeater.cc:503] Master 127.7.200.254:33243 was elected leader, sending a full tablet report...
I20260807 04:19:47.850546 24991 consensus_queue.cc:260] T 6e44d37d8a354698b2558944a1b43be6 P 7c2a6448647747aca04385a2c27a6f23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c2a6448647747aca04385a2c27a6f23" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37671 } } peers { permanent_uuid: "accb8bfbee134c56a80bee01a851008c" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39751 } } peers { permanent_uuid: "d28d786ca0584e44be07550f5e15eeb4" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 38375 } }
I20260807 04:19:47.851234 24992 ts_tablet_manager.cc:1428] T 6e44d37d8a354698b2558944a1b43be6 P d28d786ca0584e44be07550f5e15eeb4: Time spent starting tablet: real 0.012s user 0.013s sys 0.000s
I20260807 04:19:47.854281 24991 ts_tablet_manager.cc:1428] T 6e44d37d8a354698b2558944a1b43be6 P 7c2a6448647747aca04385a2c27a6f23: Time spent starting tablet: real 0.017s user 0.008s sys 0.007s
W20260807 04:19:47.871686 24830 tablet.cc:2369] T 6e44d37d8a354698b2558944a1b43be6 P d28d786ca0584e44be07550f5e15eeb4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 04:19:47.949844 24970 tablet.cc:2369] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:19:47.986476 24995 raft_consensus.cc:482] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:19:47.986917 24995 raft_consensus.cc:504] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c2a6448647747aca04385a2c27a6f23" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37671 } } peers { permanent_uuid: "accb8bfbee134c56a80bee01a851008c" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39751 } } peers { permanent_uuid: "d28d786ca0584e44be07550f5e15eeb4" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 38375 } }
I20260807 04:19:47.988962 24995 leader_election.cc:288] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c2a6448647747aca04385a2c27a6f23 (127.7.200.193:37671), d28d786ca0584e44be07550f5e15eeb4 (127.7.200.194:38375)
I20260807 04:19:47.997617 24972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:47.989207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37671 (local address 127.7.200.195:33485)
0807 04:19:47.989420 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:47.989442 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:47.989585 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:47.990537 (+ 952us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:47.990542 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:47.990576 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:19:47.990800 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:47.990865 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:47.992619 (+ 1754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:47.992626 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:47.995194 (+ 2568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:47.995219 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:47.996610 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:47.996647 (+ 37us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:47.996910 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:47.996950 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 04:19:47.997081 (+ 131us) client_negotiation.cc:240] Negotiation successful
0807 04:19:47.997256 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":39}
I20260807 04:19:47.998303 24998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:47.989333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:38375 (local address 127.7.200.195:49299)
0807 04:19:47.990520 (+ 1187us) negotiation.cc:107] Waiting for socket to connect
0807 04:19:47.990538 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 04:19:47.990663 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:19:47.991355 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:19:47.991362 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:19:47.991389 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:19:47.991784 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:47.991795 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:47.993180 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:47.993186 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:47.995620 (+ 2434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:19:47.995637 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:19:47.997580 (+ 1943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:19:47.997586 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:19:47.997768 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:47.997799 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 04:19:47.997903 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 04:19:47.998029 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1058,"mutex_wait_us":120,"thread_start_us":819,"threads_started":1}
I20260807 04:19:47.998430 24987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:47.989841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:49299 (local address 127.7.200.194:38375)
0807 04:19:47.990826 (+ 985us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:47.990834 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:47.990868 (+ 34us) server_negotiation.cc:407] Connection header received
0807 04:19:47.990946 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:47.990951 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:47.991054 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:47.991156 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:19:47.991936 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:47.992977 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:47.995829 (+ 2852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:47.997352 (+ 1523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:47.997525 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:47.997605 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:47.998022 (+ 417us) server_negotiation.cc:299] Negotiation successful
0807 04:19:47.998165 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":812}
I20260807 04:19:47.998433 24984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:47.989851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:33485 (local address 127.7.200.193:37671)
0807 04:19:47.990101 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:47.990111 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:47.990142 (+ 31us) server_negotiation.cc:407] Connection header received
0807 04:19:47.990243 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:47.990253 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:47.990367 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:47.990505 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:19:47.991053 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:47.992443 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:47.995442 (+ 2999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:47.996431 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:47.996570 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:47.996625 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:47.997967 (+ 1342us) server_negotiation.cc:299] Negotiation successful
0807 04:19:47.998157 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 04:19:47.999469 24643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e44d37d8a354698b2558944a1b43be6" candidate_uuid: "accb8bfbee134c56a80bee01a851008c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2a6448647747aca04385a2c27a6f23" is_pre_election: true
I20260807 04:19:47.999814 24783 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e44d37d8a354698b2558944a1b43be6" candidate_uuid: "accb8bfbee134c56a80bee01a851008c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28d786ca0584e44be07550f5e15eeb4" is_pre_election: true
I20260807 04:19:48.000034 24643 raft_consensus.cc:2454] T 6e44d37d8a354698b2558944a1b43be6 P 7c2a6448647747aca04385a2c27a6f23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate accb8bfbee134c56a80bee01a851008c in term 0.
I20260807 04:19:48.000371 24783 raft_consensus.cc:2454] T 6e44d37d8a354698b2558944a1b43be6 P d28d786ca0584e44be07550f5e15eeb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate accb8bfbee134c56a80bee01a851008c in term 0.
I20260807 04:19:48.000824 24851 leader_election.cc:302] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2a6448647747aca04385a2c27a6f23, accb8bfbee134c56a80bee01a851008c; no voters:
I20260807 04:19:48.001323 24995 raft_consensus.cc:2781] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:19:48.001498 24995 raft_consensus.cc:482] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:19:48.001616 24995 raft_consensus.cc:3037] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:19:48.003952 24995 raft_consensus.cc:504] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c2a6448647747aca04385a2c27a6f23" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37671 } } peers { permanent_uuid: "accb8bfbee134c56a80bee01a851008c" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39751 } } peers { permanent_uuid: "d28d786ca0584e44be07550f5e15eeb4" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 38375 } }
I20260807 04:19:48.004714 24995 leader_election.cc:288] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c [CANDIDATE]: Term 1 election: Requested vote from peers 7c2a6448647747aca04385a2c27a6f23 (127.7.200.193:37671), d28d786ca0584e44be07550f5e15eeb4 (127.7.200.194:38375)
I20260807 04:19:48.005345 24643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e44d37d8a354698b2558944a1b43be6" candidate_uuid: "accb8bfbee134c56a80bee01a851008c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2a6448647747aca04385a2c27a6f23"
I20260807 04:19:48.005355 24783 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e44d37d8a354698b2558944a1b43be6" candidate_uuid: "accb8bfbee134c56a80bee01a851008c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28d786ca0584e44be07550f5e15eeb4"
I20260807 04:19:48.005576 24783 raft_consensus.cc:3037] T 6e44d37d8a354698b2558944a1b43be6 P d28d786ca0584e44be07550f5e15eeb4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:19:48.005569 24643 raft_consensus.cc:3037] T 6e44d37d8a354698b2558944a1b43be6 P 7c2a6448647747aca04385a2c27a6f23 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:19:48.008044 24643 raft_consensus.cc:2454] T 6e44d37d8a354698b2558944a1b43be6 P 7c2a6448647747aca04385a2c27a6f23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate accb8bfbee134c56a80bee01a851008c in term 1.
I20260807 04:19:48.008041 24783 raft_consensus.cc:2454] T 6e44d37d8a354698b2558944a1b43be6 P d28d786ca0584e44be07550f5e15eeb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate accb8bfbee134c56a80bee01a851008c in term 1.
I20260807 04:19:48.008538 24851 leader_election.cc:302] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2a6448647747aca04385a2c27a6f23, accb8bfbee134c56a80bee01a851008c; no voters:
I20260807 04:19:48.008874 24995 raft_consensus.cc:2781] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:19:48.009433 24995 raft_consensus.cc:686] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c [term 1 LEADER]: Becoming Leader. State: Replica: accb8bfbee134c56a80bee01a851008c, State: Running, Role: LEADER
I20260807 04:19:48.009917 24995 consensus_queue.cc:237] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c2a6448647747aca04385a2c27a6f23" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37671 } } peers { permanent_uuid: "accb8bfbee134c56a80bee01a851008c" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39751 } } peers { permanent_uuid: "d28d786ca0584e44be07550f5e15eeb4" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 38375 } }
I20260807 04:19:48.015386 24490 catalog_manager.cc:5495] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c reported cstate change: term changed from 0 to 1, leader changed from <none> to accb8bfbee134c56a80bee01a851008c (127.7.200.195). New cstate: current_term: 1 leader_uuid: "accb8bfbee134c56a80bee01a851008c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c2a6448647747aca04385a2c27a6f23" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "accb8bfbee134c56a80bee01a851008c" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d28d786ca0584e44be07550f5e15eeb4" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 38375 } health_report { overall_health: UNKNOWN } } }
I20260807 04:19:48.053576 24986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:48.047825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40534 (local address 127.7.200.195:39751)
0807 04:19:48.048076 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:48.048088 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:48.048104 (+ 16us) server_negotiation.cc:407] Connection header received
0807 04:19:48.048191 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:48.048195 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:48.048275 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:48.048436 (+ 161us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:19:48.048925 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:48.049715 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:48.051211 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:48.051629 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:48.051771 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:48.052335 (+ 564us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:19:48.052967 (+ 632us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:19:48.053128 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:48.053211 (+ 83us) server_negotiation.cc:299] Negotiation successful
0807 04:19:48.053298 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 04:19:48.062093 24643 raft_consensus.cc:1261] T 6e44d37d8a354698b2558944a1b43be6 P 7c2a6448647747aca04385a2c27a6f23 [term 1 FOLLOWER]: Refusing update from remote peer accb8bfbee134c56a80bee01a851008c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:19:48.062095 24783 raft_consensus.cc:1261] T 6e44d37d8a354698b2558944a1b43be6 P d28d786ca0584e44be07550f5e15eeb4 [term 1 FOLLOWER]: Refusing update from remote peer accb8bfbee134c56a80bee01a851008c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:19:48.063097 24999 consensus_queue.cc:1035] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2a6448647747aca04385a2c27a6f23" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:19:48.063535 24995 consensus_queue.cc:1035] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28d786ca0584e44be07550f5e15eeb4" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 38375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 04:19:48.065414 24692 tablet.cc:2369] T 6e44d37d8a354698b2558944a1b43be6 P 7c2a6448647747aca04385a2c27a6f23: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:19:48.095144 24490 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39454:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:19:48.095521 24490 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39454:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:19:48.099889 24490 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6: Sending DeleteTablet for 3 replicas of tablet 6e44d37d8a354698b2558944a1b43be6
I20260807 04:19:48.101240 24620 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e44d37d8a354698b2558944a1b43be6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:19:48 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:46060
I20260807 04:19:48.101349 24900 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e44d37d8a354698b2558944a1b43be6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:19:48 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:40524
I20260807 04:19:48.101521 24762 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e44d37d8a354698b2558944a1b43be6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:19:48 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:49272
I20260807 04:19:48.102771 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 24555
I20260807 04:19:48.131007 25013 tablet_replica.cc:330] T 6e44d37d8a354698b2558944a1b43be6 P 7c2a6448647747aca04385a2c27a6f23: stopping tablet replica
I20260807 04:19:48.133476 25013 raft_consensus.cc:2229] T 6e44d37d8a354698b2558944a1b43be6 P 7c2a6448647747aca04385a2c27a6f23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:19:48.140844 25013 raft_consensus.cc:2258] T 6e44d37d8a354698b2558944a1b43be6 P 7c2a6448647747aca04385a2c27a6f23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:19:48.147209 25012 tablet_replica.cc:330] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c: stopping tablet replica
I20260807 04:19:48.147459 25014 tablet_replica.cc:330] T 6e44d37d8a354698b2558944a1b43be6 P d28d786ca0584e44be07550f5e15eeb4: stopping tablet replica
I20260807 04:19:48.147994 25014 raft_consensus.cc:2229] T 6e44d37d8a354698b2558944a1b43be6 P d28d786ca0584e44be07550f5e15eeb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:19:48.148653 25014 raft_consensus.cc:2258] T 6e44d37d8a354698b2558944a1b43be6 P d28d786ca0584e44be07550f5e15eeb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:19:48.149411 25013 ts_tablet_manager.cc:1905] T 6e44d37d8a354698b2558944a1b43be6 P 7c2a6448647747aca04385a2c27a6f23: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:19:48.151350 25012 raft_consensus.cc:2229] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:19:48.153571 25012 raft_consensus.cc:2258] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c [term 1 FOLLOWER]: Raft consensus is shut down!
Aug 07 04:19:48 dist-test-slave-qg60 krb5kdc[24443](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076385, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.193@KRBTEST.COM
I20260807 04:19:48.158044 25014 ts_tablet_manager.cc:1905] T 6e44d37d8a354698b2558944a1b43be6 P d28d786ca0584e44be07550f5e15eeb4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:19:48.162649 25012 ts_tablet_manager.cc:1905] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:19:48.166949 25014 ts_tablet_manager.cc:1918] T 6e44d37d8a354698b2558944a1b43be6 P d28d786ca0584e44be07550f5e15eeb4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:19:48.167201 25014 log.cc:1196] T 6e44d37d8a354698b2558944a1b43be6 P d28d786ca0584e44be07550f5e15eeb4: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/wal/wals/6e44d37d8a354698b2558944a1b43be6
I20260807 04:19:48.167848 25014 ts_tablet_manager.cc:1939] T 6e44d37d8a354698b2558944a1b43be6 P d28d786ca0584e44be07550f5e15eeb4: Deleting consensus metadata
I20260807 04:19:48.170063 24475 catalog_manager.cc:4841] TS d28d786ca0584e44be07550f5e15eeb4 (127.7.200.194:38375): tablet 6e44d37d8a354698b2558944a1b43be6 (table test-table [id=9c13b562b05f44e58f4122a69e7861ab]) successfully deleted
I20260807 04:19:48.170713 25013 ts_tablet_manager.cc:1918] T 6e44d37d8a354698b2558944a1b43be6 P 7c2a6448647747aca04385a2c27a6f23: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:19:48.170894 25013 log.cc:1196] T 6e44d37d8a354698b2558944a1b43be6 P 7c2a6448647747aca04385a2c27a6f23: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/wal/wals/6e44d37d8a354698b2558944a1b43be6
I20260807 04:19:48.171442 25012 ts_tablet_manager.cc:1918] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:19:48.171537 25013 ts_tablet_manager.cc:1939] T 6e44d37d8a354698b2558944a1b43be6 P 7c2a6448647747aca04385a2c27a6f23: Deleting consensus metadata
I20260807 04:19:48.171649 25012 log.cc:1196] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/wal/wals/6e44d37d8a354698b2558944a1b43be6
I20260807 04:19:48.172369 25012 ts_tablet_manager.cc:1939] T 6e44d37d8a354698b2558944a1b43be6 P accb8bfbee134c56a80bee01a851008c: Deleting consensus metadata
I20260807 04:19:48.172410 24984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:48.104330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46068 (local address 127.7.200.193:37671)
0807 04:19:48.104584 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:48.104593 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:48.127409 (+ 22816us) server_negotiation.cc:407] Connection header received
0807 04:19:48.128155 (+ 746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:48.128166 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:48.128309 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:48.128414 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:48.134561 (+ 6147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:48.142794 (+ 8233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:48.149120 (+ 6326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:48.149839 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:48.149956 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:48.160956 (+ 11000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:48.160976 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:48.160998 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:48.161054 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:48.165490 (+ 4436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:48.166642 (+ 1152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:48.166653 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:48.166658 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:48.166830 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:48.167725 (+ 895us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:48.167733 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:48.167740 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:48.168357 (+ 617us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:48.168687 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:48.171603 (+ 2916us) server_negotiation.cc:299] Negotiation successful
0807 04:19:48.171985 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 04:19:48.174161 24475 catalog_manager.cc:4841] TS accb8bfbee134c56a80bee01a851008c (127.7.200.195:39751): tablet 6e44d37d8a354698b2558944a1b43be6 (table test-table [id=9c13b562b05f44e58f4122a69e7861ab]) successfully deleted
I20260807 04:19:48.174166 24473 catalog_manager.cc:4841] TS 7c2a6448647747aca04385a2c27a6f23 (127.7.200.193:37671): tablet 6e44d37d8a354698b2558944a1b43be6 (table test-table [id=9c13b562b05f44e58f4122a69e7861ab]) successfully deleted
I20260807 04:19:48.174487 24686 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:19:48.278928 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 24555
I20260807 04:19:48.301313 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 24697
Aug 07 04:19:48 dist-test-slave-qg60 krb5kdc[24443](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076385, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.194@KRBTEST.COM
I20260807 04:19:48.320537 24987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:48.302417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49278 (local address 127.7.200.194:38375)
0807 04:19:48.302642 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:48.302650 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:48.302672 (+ 22us) server_negotiation.cc:407] Connection header received
0807 04:19:48.302743 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:48.302748 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:48.302831 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:48.302953 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:48.304393 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:48.305654 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:48.307318 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:48.307959 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:48.308089 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:48.313050 (+ 4961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:48.313069 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:48.313087 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:48.313137 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:48.317240 (+ 4103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:48.318101 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:48.318113 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:48.318117 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:48.318277 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:48.318706 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:48.318711 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:48.318714 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:48.319240 (+ 526us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:48.319550 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:48.319927 (+ 377us) server_negotiation.cc:299] Negotiation successful
0807 04:19:48.320166 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 04:19:48.321372 24824 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:19:48.415050 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 24697
I20260807 04:19:48.435293 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 24835
Aug 07 04:19:48 dist-test-slave-qg60 krb5kdc[24443](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076385, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.195@KRBTEST.COM
I20260807 04:19:48.453716 24986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:19:48.436292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40546 (local address 127.7.200.195:39751)
0807 04:19:48.436487 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 04:19:48.436494 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:19:48.436518 (+ 24us) server_negotiation.cc:407] Connection header received
0807 04:19:48.436773 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:19:48.436783 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:19:48.436873 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:19:48.436984 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:19:48.438456 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:48.439321 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:48.440713 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:19:48.441324 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:19:48.441500 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:19:48.446740 (+ 5240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:19:48.446755 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:19:48.446772 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:19:48.446817 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:19:48.450137 (+ 3320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:48.451121 (+ 984us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:48.451131 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:48.451134 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:48.451359 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:19:48.451824 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:19:48.451827 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:19:48.451829 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:19:48.452206 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:19:48.452442 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0807 04:19:48.453101 (+ 659us) server_negotiation.cc:299] Negotiation successful
0807 04:19:48.453277 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 04:19:48.454463 24964 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:19:48.588950 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 24835
I20260807 04:19:48.612062 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 24456
I20260807 04:19:48.613714 24524 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:19:48.727614 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 24456
I20260807 04:20:08.758239 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:33243
--webserver_interface=127.7.200.254
--webserver_port=43423
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:44215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:33243
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:20:09.117063 25020 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:20:09.117359 25020 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:20:09.117551 25020 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:20:09.124948 25020 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 04:20:09.125062 25020 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 04:20:09.125136 25020 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 04:20:09.125214 25020 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:20:09.125308 25020 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:20:09.125432 25020 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:20:09.125514 25020 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:20:09.125598 25020 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:20:09.135939 25020 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:44215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:33243
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:33243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=43423
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:20:09.137431 25020 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:20:09.138804 25020 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:20:09.165314 25031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:09.165406 25028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:09.165398 25029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:20:09.170456 25020 server_base.cc:1034] running on GCE node
I20260807 04:20:09.171451 25020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:20:09.173282 25020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:20:09.174541 25020 hybrid_clock.cc:648] HybridClock initialized: now 1786076409174455 us; error 58 us; skew 500 ppm
I20260807 04:20:09.174940 25020 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:20:09 dist-test-slave-qg60 krb5kdc[24443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076409, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:20:09.183755 25020 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:20:09.185729 25020 webserver.cc:460] Webserver started at http://127.7.200.254:43423/ using document root <none> and password file <none>
I20260807 04:20:09.186599 25020 fs_manager.cc:359] Metadata directory not provided
I20260807 04:20:09.186757 25020 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:20:09.193266 25020 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 04:20:09.196339 25038 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:09.197990 25020 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:20:09.198203 25020 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "3319b95142dc425da470194be83b15d6"
format_stamp: "Formatted at 2026-08-07 04:19:45 on dist-test-slave-qg60"
server_key: "c57806b9c706ea7d21a867083593f456"
server_key_iv: "02844981e93a2ef35c9aba1cf1c34feb"
server_key_version: "encryptionkey@0"
I20260807 04:20:09.199308 25020 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:20:09.217221 25020 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:20:09.221995 25020 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:20:09.222357 25020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:20:09.243512 25020 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:33243
I20260807 04:20:09.243561 25092 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:33243 every 8 connection(s)
I20260807 04:20:09.245316 25020 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:20:09.251778 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 25020
I20260807 04:20:09.252942 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:37671
--local_ip_for_outbound_sockets=127.7.200.193
--tserver_master_addrs=127.7.200.254:33243
--webserver_port=38665
--webserver_interface=127.7.200.193
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:44215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 04:20:09.253834 25093 sys_catalog.cc:263] Verifying existing consensus state
I20260807 04:20:09.259303 25093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6: Bootstrap starting.
I20260807 04:20:09.281765 25093 log.cc:824] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6: Log is configured to *not* fsync() on all Append() calls
I20260807 04:20:09.294890 25093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 04:20:09.295495 25093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6: Bootstrap complete.
I20260807 04:20:09.305743 25093 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3319b95142dc425da470194be83b15d6" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 33243 } }
I20260807 04:20:09.306593 25093 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3319b95142dc425da470194be83b15d6, State: Initialized, Role: FOLLOWER
I20260807 04:20:09.307283 25093 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3319b95142dc425da470194be83b15d6" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 33243 } }
I20260807 04:20:09.307538 25093 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:20:09.307689 25093 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:20:09.307883 25093 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [term 1 FOLLOWER]: Advancing to term 2
I20260807 04:20:09.311913 25093 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3319b95142dc425da470194be83b15d6" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 33243 } }
I20260807 04:20:09.312479 25093 leader_election.cc:302] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3319b95142dc425da470194be83b15d6; no voters:
I20260807 04:20:09.313184 25093 leader_election.cc:288] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 04:20:09.313325 25097 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 04:20:09.314783 25097 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [term 2 LEADER]: Becoming Leader. State: Replica: 3319b95142dc425da470194be83b15d6, State: Running, Role: LEADER
I20260807 04:20:09.315430 25097 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3319b95142dc425da470194be83b15d6" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 33243 } }
I20260807 04:20:09.315675 25093 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:20:09.318372 25099 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3319b95142dc425da470194be83b15d6. Latest consensus state: current_term: 2 leader_uuid: "3319b95142dc425da470194be83b15d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3319b95142dc425da470194be83b15d6" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 33243 } } }
I20260807 04:20:09.318776 25099 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [sys.catalog]: This master's current role is: LEADER
I20260807 04:20:09.318501 25098 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "3319b95142dc425da470194be83b15d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3319b95142dc425da470194be83b15d6" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 33243 } } }
I20260807 04:20:09.318925 25098 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [sys.catalog]: This master's current role is: LEADER
I20260807 04:20:09.319862 25104 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:20:09.333303 25104 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:20:09.335640 25104 catalog_manager.cc:1259] Loaded cluster ID: 62fc90204ef344ea88c2afd9580e0a98
I20260807 04:20:09.335836 25104 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:20:09.340077 25104 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:20:09.341864 25104 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6: Loaded TSK: 0
I20260807 04:20:09.387414 25104 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6: Generated new TSK 1
I20260807 04:20:09.387857 25104 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 04:20:09.674306 25095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:20:09.674633 25095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:20:09.674803 25095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:20:09.682377 25095 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:20:09.682554 25095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:20:09.682740 25095 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:20:09.693300 25095 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:44215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:37671
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=38665
--tserver_master_addrs=127.7.200.254:33243
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:20:09.694761 25095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:20:09.696342 25095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:20:09.710157 25123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:09.710422 25121 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:09.710465 25125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:20:09.712020 25095 server_base.cc:1034] running on GCE node
I20260807 04:20:09.712770 25095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:20:09.713915 25095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:20:09.715167 25095 hybrid_clock.cc:648] HybridClock initialized: now 1786076409715097 us; error 51 us; skew 500 ppm
I20260807 04:20:09.715531 25095 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:20:09 dist-test-slave-qg60 krb5kdc[24443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076409, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:20:09.719703 25095 init.cc:377] Logged in from keytab as kudu/127.7.200.193@KRBTEST.COM (short username kudu)
I20260807 04:20:09.721487 25095 webserver.cc:460] Webserver started at http://127.7.200.193:38665/ using document root <none> and password file <none>
I20260807 04:20:09.722330 25095 fs_manager.cc:359] Metadata directory not provided
I20260807 04:20:09.722497 25095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:20:09.729727 25095 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.000s
I20260807 04:20:09.733209 25132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:09.734839 25095 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.005s
I20260807 04:20:09.735026 25095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "7c2a6448647747aca04385a2c27a6f23"
format_stamp: "Formatted at 2026-08-07 04:19:46 on dist-test-slave-qg60"
server_key: "1433c1e1e0a26d0b2e91b7c6ed70b54c"
server_key_iv: "8dec78025135586da77ac0fc7e4cc10c"
server_key_version: "encryptionkey@0"
I20260807 04:20:09.736027 25095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:20:09.766065 25095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:20:09.770773 25095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:20:09.771095 25095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:20:09.772209 25095 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:20:09.773612 25095 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:20:09.773699 25095 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:09.773859 25095 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:20:09.773963 25095 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:09.808074 25095 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:37671
I20260807 04:20:09.808218 25247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:37671 every 8 connection(s)
I20260807 04:20:09.809671 25095 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:20:09.813390 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 25095
I20260807 04:20:09.814136 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:38375
--local_ip_for_outbound_sockets=127.7.200.194
--tserver_master_addrs=127.7.200.254:33243
--webserver_port=39537
--webserver_interface=127.7.200.194
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:44215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 04:20:09 dist-test-slave-qg60 krb5kdc[24443](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076409, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:20:09.837374 25250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:09.812990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:42619 (local address 127.7.200.254:33243)
0807 04:20:09.813690 (+ 700us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:09.813707 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:09.814611 (+ 904us) server_negotiation.cc:407] Connection header received
0807 04:20:09.817218 (+ 2607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:09.817239 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:09.817743 (+ 504us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:09.818151 (+ 408us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:20:09.819772 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:09.821888 (+ 2116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:09.823532 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:09.824664 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:09.824918 (+ 254us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:09.828871 (+ 3953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:20:09.828893 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:20:09.828909 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:20:09.828957 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:20:09.832271 (+ 3314us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:09.833165 (+ 894us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:09.833173 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:09.833179 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:09.833343 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:09.833803 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:09.833809 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:09.833811 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:09.834413 (+ 602us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:20:09.834617 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:09.835548 (+ 931us) server_negotiation.cc:299] Negotiation successful
0807 04:20:09.835935 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":285,"threads_started":1}
I20260807 04:20:09.837371 25251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:09.813337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.193:42619)
0807 04:20:09.814400 (+ 1063us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:09.814452 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 04:20:09.816474 (+ 2022us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:20:09.818296 (+ 1822us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:20:09.818304 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:20:09.818847 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:20:09.819545 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:09.819567 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:09.822066 (+ 2499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:09.822070 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:09.823356 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:09.823369 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:09.824927 (+ 1558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:09.824932 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:09.825138 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:09.825885 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:20:09.825909 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:20:09.828486 (+ 2577us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:20:09.832437 (+ 3951us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:20:09.832447 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:20:09.832464 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:20:09.833012 (+ 548us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:20:09.833479 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:20:09.833485 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:20:09.833488 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:20:09.833682 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:20:09.834593 (+ 911us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:20:09.834601 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:20:09.834931 (+ 330us) client_negotiation.cc:769] Sending connection context
0807 04:20:09.835330 (+ 399us) client_negotiation.cc:240] Negotiation successful
0807 04:20:09.835917 (+ 587us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":734,"thread_start_us":470,"threads_started":1}
I20260807 04:20:09.841177 25248 heartbeater.cc:347] Connected to a master server at 127.7.200.254:33243
I20260807 04:20:09.841521 25248 heartbeater.cc:464] Registering TS with master...
I20260807 04:20:09.842262 25248 heartbeater.cc:511] Master 127.7.200.254:33243 requested a full tablet report, sending...
I20260807 04:20:09.844846 25055 ts_manager.cc:194] Registered new tserver with Master: 7c2a6448647747aca04385a2c27a6f23 (127.7.200.193:37671)
I20260807 04:20:09.847190 25055 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.193@KRBTEST.COM'} at 127.7.200.193:42619
W20260807 04:20:10.171021 25252 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:20:10.171330 25252 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:20:10.171437 25252 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:20:10.179050 25252 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:20:10.179188 25252 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:20:10.179319 25252 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:20:10.189503 25252 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:44215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:38375
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=39537
--tserver_master_addrs=127.7.200.254:33243
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:20:10.190811 25252 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:20:10.192184 25252 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:20:10.205729 25260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:10.205808 25257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:10.205786 25258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:20:10.207129 25252 server_base.cc:1034] running on GCE node
I20260807 04:20:10.207715 25252 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:20:10.208686 25252 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:20:10.209942 25252 hybrid_clock.cc:648] HybridClock initialized: now 1786076410209876 us; error 63 us; skew 500 ppm
I20260807 04:20:10.210281 25252 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:20:10 dist-test-slave-qg60 krb5kdc[24443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076410, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:20:10.213625 25252 init.cc:377] Logged in from keytab as kudu/127.7.200.194@KRBTEST.COM (short username kudu)
I20260807 04:20:10.215147 25252 webserver.cc:460] Webserver started at http://127.7.200.194:39537/ using document root <none> and password file <none>
I20260807 04:20:10.215907 25252 fs_manager.cc:359] Metadata directory not provided
I20260807 04:20:10.216076 25252 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:20:10.221740 25252 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260807 04:20:10.224558 25267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:10.225972 25252 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 04:20:10.226188 25252 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "d28d786ca0584e44be07550f5e15eeb4"
format_stamp: "Formatted at 2026-08-07 04:19:47 on dist-test-slave-qg60"
server_key: "c13774cf67abd51c61da3dbfba497db2"
server_key_iv: "a5c23015f7a979d59ac2b914bb849c91"
server_key_version: "encryptionkey@0"
I20260807 04:20:10.227195 25252 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:20:10.241238 25252 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:20:10.245724 25252 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:20:10.246025 25252 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:20:10.247040 25252 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:20:10.248468 25252 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:20:10.248603 25252 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:10.248773 25252 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:20:10.248867 25252 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260807 04:20:10.284634 25252 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:38375
I20260807 04:20:10.284793 25380 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:38375 every 8 connection(s)
I20260807 04:20:10.286155 25252 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:20:10.289075 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 25252
I20260807 04:20:10.289739 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:39751
--local_ip_for_outbound_sockets=127.7.200.195
--tserver_master_addrs=127.7.200.254:33243
--webserver_port=36123
--webserver_interface=127.7.200.195
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:44215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 04:20:10 dist-test-slave-qg60 krb5kdc[24443](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076410, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:20:10.308980 25250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:10.288953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:54749 (local address 127.7.200.254:33243)
0807 04:20:10.289206 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:10.289214 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:10.290451 (+ 1237us) server_negotiation.cc:407] Connection header received
0807 04:20:10.292408 (+ 1957us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:10.292416 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:10.292528 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:10.292656 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:20:10.294265 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:10.295412 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:10.297321 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:10.298052 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:10.298207 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:10.302521 (+ 4314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:20:10.302525 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:20:10.302529 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:20:10.302565 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:20:10.305500 (+ 2935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:10.306501 (+ 1001us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:10.306505 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:10.306507 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:10.306624 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:10.307158 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:10.307166 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:10.307170 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:10.307475 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:20:10.307638 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:10.308341 (+ 703us) server_negotiation.cc:299] Negotiation successful
0807 04:20:10.308578 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 04:20:10.310009 25383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:10.289436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.194:54749)
0807 04:20:10.290259 (+ 823us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:10.290318 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 04:20:10.292117 (+ 1799us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:20:10.292918 (+ 801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:20:10.292926 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:20:10.293486 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:20:10.294074 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:10.294092 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:10.295592 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:10.295596 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:10.297156 (+ 1560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:10.297180 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:10.298294 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:10.298299 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:10.298517 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:10.299257 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:20:10.299281 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:20:10.302240 (+ 2959us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:20:10.305653 (+ 3413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:20:10.305667 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:20:10.305690 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:20:10.306375 (+ 685us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:20:10.306765 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:20:10.306771 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:20:10.306792 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:20:10.307014 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:20:10.307620 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:20:10.307628 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:20:10.307977 (+ 349us) client_negotiation.cc:769] Sending connection context
0807 04:20:10.308248 (+ 271us) client_negotiation.cc:240] Negotiation successful
0807 04:20:10.308850 (+ 602us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":348,"threads_started":1}
I20260807 04:20:10.311619 25381 heartbeater.cc:347] Connected to a master server at 127.7.200.254:33243
I20260807 04:20:10.311929 25381 heartbeater.cc:464] Registering TS with master...
I20260807 04:20:10.312659 25381 heartbeater.cc:511] Master 127.7.200.254:33243 requested a full tablet report, sending...
I20260807 04:20:10.314239 25055 ts_manager.cc:194] Registered new tserver with Master: d28d786ca0584e44be07550f5e15eeb4 (127.7.200.194:38375)
I20260807 04:20:10.315052 25055 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.194@KRBTEST.COM'} at 127.7.200.194:54749
W20260807 04:20:10.661173 25384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:20:10.661548 25384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:20:10.661748 25384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:20:10.670120 25384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:20:10.670285 25384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:20:10.670465 25384 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:20:10.680855 25384 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:44215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:39751
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=36123
--tserver_master_addrs=127.7.200.254:33243
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:20:10.682235 25384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:20:10.683699 25384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:20:10.697255 25389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:10.697345 25392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:10.697361 25390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:20:10.698514 25384 server_base.cc:1034] running on GCE node
I20260807 04:20:10.699186 25384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:20:10.700137 25384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:20:10.701347 25384 hybrid_clock.cc:648] HybridClock initialized: now 1786076410701315 us; error 27 us; skew 500 ppm
I20260807 04:20:10.701713 25384 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:20:10 dist-test-slave-qg60 krb5kdc[24443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076410, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:20:10.705185 25384 init.cc:377] Logged in from keytab as kudu/127.7.200.195@KRBTEST.COM (short username kudu)
I20260807 04:20:10.706766 25384 webserver.cc:460] Webserver started at http://127.7.200.195:36123/ using document root <none> and password file <none>
I20260807 04:20:10.707480 25384 fs_manager.cc:359] Metadata directory not provided
I20260807 04:20:10.707650 25384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:20:10.713351 25384 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 04:20:10.716192 25399 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:10.717701 25384 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:20:10.717887 25384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "accb8bfbee134c56a80bee01a851008c"
format_stamp: "Formatted at 2026-08-07 04:19:47 on dist-test-slave-qg60"
server_key: "a53350da6539d9575730382ab4a1b01e"
server_key_iv: "1609b82d5159674639c9a80903a9a731"
server_key_version: "encryptionkey@0"
I20260807 04:20:10.718936 25384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:20:10.737536 25384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:20:10.742106 25384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:20:10.742477 25384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:20:10.744015 25384 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:20:10.746217 25384 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:20:10.746338 25384 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:10.746456 25384 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:20:10.746568 25384 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:10.783079 25384 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:39751
I20260807 04:20:10.783170 25514 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:39751 every 8 connection(s)
I20260807 04:20:10.784575 25384 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:20:10.785257 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 25384
Aug 07 04:20:10 dist-test-slave-qg60 krb5kdc[24443](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076410, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:20:10.801427 25250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:10.786502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32886 (local address 127.7.200.254:33243)
0807 04:20:10.786765 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:10.786774 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:10.787346 (+ 572us) server_negotiation.cc:407] Connection header received
0807 04:20:10.787566 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:10.787571 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:10.787656 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:10.787795 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:20:10.789565 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:10.790313 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:10.792005 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:10.792453 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:10.792602 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:10.795440 (+ 2838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:20:10.795445 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:20:10.795449 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:20:10.795484 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:20:10.798562 (+ 3078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:10.799294 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:10.799299 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:10.799302 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:10.799470 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:10.799906 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:10.799909 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:10.799911 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:10.800294 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:20:10.800574 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:10.800932 (+ 358us) server_negotiation.cc:299] Negotiation successful
0807 04:20:10.801104 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 04:20:10.806540 25518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:10.787351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:44253 (local address 127.7.200.254:33243)
0807 04:20:10.788952 (+ 1601us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:10.788959 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:10.789138 (+ 179us) server_negotiation.cc:407] Connection header received
0807 04:20:10.791002 (+ 1864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:10.791007 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:10.791083 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:10.791201 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:20:10.792647 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:10.793716 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:10.795278 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:10.795758 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:10.795891 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:10.799602 (+ 3711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:20:10.799609 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:20:10.799614 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:20:10.799653 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:20:10.803252 (+ 3599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:10.804260 (+ 1008us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:10.804269 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:10.804275 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:10.804459 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:10.804994 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:10.804998 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:10.805000 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:10.805297 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:20:10.805426 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:10.806075 (+ 649us) server_negotiation.cc:299] Negotiation successful
0807 04:20:10.806243 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1477,"thread_start_us":397,"threads_started":1}
I20260807 04:20:10.807677 25519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:10.788094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.195:44253)
0807 04:20:10.788966 (+ 872us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:10.789018 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 04:20:10.790756 (+ 1738us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:20:10.791398 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:20:10.791406 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:20:10.791919 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:20:10.792466 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:10.792482 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:10.793890 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:10.793896 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:10.795113 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:10.795125 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:10.795997 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:10.796006 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:10.796263 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:10.796880 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:20:10.796905 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:20:10.799337 (+ 2432us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:20:10.803418 (+ 4081us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:20:10.803429 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:20:10.803445 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:20:10.804100 (+ 655us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:20:10.804614 (+ 514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:20:10.804617 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:20:10.804620 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:20:10.804876 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:20:10.805412 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:20:10.805418 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:20:10.805733 (+ 315us) client_negotiation.cc:769] Sending connection context
0807 04:20:10.805953 (+ 220us) client_negotiation.cc:240] Negotiation successful
0807 04:20:10.806332 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":373,"threads_started":1}
I20260807 04:20:10.809187 25515 heartbeater.cc:347] Connected to a master server at 127.7.200.254:33243
I20260807 04:20:10.809499 25515 heartbeater.cc:464] Registering TS with master...
I20260807 04:20:10.810230 25515 heartbeater.cc:511] Master 127.7.200.254:33243 requested a full tablet report, sending...
I20260807 04:20:10.811805 25055 ts_manager.cc:194] Registered new tserver with Master: accb8bfbee134c56a80bee01a851008c (127.7.200.195:39751)
I20260807 04:20:10.812670 25055 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.195@KRBTEST.COM'} at 127.7.200.195:44253
I20260807 04:20:10.817085 7971 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 04:20:10.823665 25518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:10.818080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32902 (local address 127.7.200.254:33243)
0807 04:20:10.818248 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:10.818253 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:10.818714 (+ 461us) server_negotiation.cc:407] Connection header received
0807 04:20:10.818922 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:10.818925 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:10.819088 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:10.819216 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:20:10.819629 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:10.820352 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:10.821864 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:10.822283 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:10.822372 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:10.822860 (+ 488us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:20:10.823109 (+ 249us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0807 04:20:10.823436 (+ 327us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:32902: token expired
Metrics: {"server-negotiator.queue_time_us":52}
W20260807 04:20:10.823791 25518 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:32902: token expired
W20260807 04:20:10.824290 24975 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.7.200.254:33243)
I20260807 04:20:10.839201 25518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:10.824829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32918 (local address 127.7.200.254:33243)
0807 04:20:10.825090 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:10.825096 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:10.825116 (+ 20us) server_negotiation.cc:407] Connection header received
0807 04:20:10.825284 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:10.825288 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:10.825357 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:10.825482 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:20:10.827041 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:10.827834 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:10.829557 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:10.830125 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:10.830285 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:10.833445 (+ 3160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:20:10.833451 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:20:10.833454 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:20:10.833490 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:20:10.836235 (+ 2745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:10.837082 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:10.837087 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:10.837089 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:10.837213 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:10.837626 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:10.837636 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:10.837638 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:10.837943 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:20:10.838235 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:10.838570 (+ 335us) server_negotiation.cc:299] Negotiation successful
0807 04:20:10.838798 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124}
I20260807 04:20:10.842803 25055 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32918:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 04:20:10.850767 25248 heartbeater.cc:503] Master 127.7.200.254:33243 was elected leader, sending a full tablet report...
W20260807 04:20:10.851006 25055 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:20:10.875113 25526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:10.863649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32930 (local address 127.7.200.193:37671)
0807 04:20:10.866092 (+ 2443us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:10.866103 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:10.866134 (+ 31us) server_negotiation.cc:407] Connection header received
0807 04:20:10.866242 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:10.866250 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:10.866521 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:10.867487 (+ 966us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:20:10.867738 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:10.869409 (+ 1671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:10.872410 (+ 3001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:10.873893 (+ 1483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:10.874057 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:10.874313 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:10.874597 (+ 284us) server_negotiation.cc:299] Negotiation successful
0807 04:20:10.874759 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2262,"thread_start_us":2128,"threads_started":1}
I20260807 04:20:10.875171 25525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:10.863357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37671 (local address 127.0.0.1:32930)
0807 04:20:10.864503 (+ 1146us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:10.864562 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 04:20:10.864817 (+ 255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:20:10.866767 (+ 1950us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:20:10.866774 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:20:10.866813 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:20:10.867289 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:10.867307 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:10.869554 (+ 2247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:10.869561 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:10.872252 (+ 2691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:10.872267 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:10.874123 (+ 1856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:10.874130 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:10.874341 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:10.874400 (+ 59us) client_negotiation.cc:769] Sending connection context
0807 04:20:10.874551 (+ 151us) client_negotiation.cc:240] Negotiation successful
0807 04:20:10.874743 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":813,"mutex_wait_us":22,"thread_start_us":604,"threads_started":1}
I20260807 04:20:10.876695 25528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:10.864232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53700 (local address 127.7.200.194:38375)
0807 04:20:10.866079 (+ 1847us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:10.866093 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:10.866700 (+ 607us) server_negotiation.cc:407] Connection header received
0807 04:20:10.866799 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:10.866807 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:10.867033 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:10.867243 (+ 210us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:20:10.868158 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:10.869649 (+ 1491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:10.873792 (+ 4143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:10.875240 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:10.875378 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:10.875550 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:10.876200 (+ 650us) server_negotiation.cc:299] Negotiation successful
0807 04:20:10.876376 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1672,"thread_start_us":1575,"threads_started":1}
I20260807 04:20:10.876945 25527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:10.863613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:38375 (local address 127.0.0.1:53700)
0807 04:20:10.866422 (+ 2809us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:10.866440 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 04:20:10.866564 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:20:10.867474 (+ 910us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:20:10.867478 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:20:10.867501 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:20:10.867913 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:10.867927 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:10.869822 (+ 1895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:10.869830 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:10.873610 (+ 3780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:10.873628 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:10.875727 (+ 2099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:10.875733 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:10.875902 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:10.876029 (+ 127us) client_negotiation.cc:769] Sending connection context
0807 04:20:10.876138 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 04:20:10.876490 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2694,"mutex_wait_us":68,"thread_start_us":2552,"threads_started":1}
I20260807 04:20:10.879479 25182 tablet_service.cc:1467] Processing CreateTablet for tablet e67a6fa175284683960de7a37ba03362 (DEFAULT_TABLE table=test-table [id=88c905a2c28a4c93a89db823cf4a72a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:20:10.880771 25529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:10.866553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:39751 (local address 127.0.0.1:38376)
0807 04:20:10.871763 (+ 5210us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:10.871786 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 04:20:10.871970 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:20:10.872867 (+ 897us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:20:10.872872 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:20:10.872897 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:20:10.873277 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:10.873287 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:10.875587 (+ 2300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:10.875593 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:10.878050 (+ 2457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:10.878068 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:10.879881 (+ 1813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:10.879888 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:10.880060 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:10.880095 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 04:20:10.880265 (+ 170us) client_negotiation.cc:240] Negotiation successful
0807 04:20:10.880421 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5068,"thread_start_us":4916,"threads_started":1}
I20260807 04:20:10.880868 25530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:10.867014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38376 (local address 127.7.200.195:39751)
0807 04:20:10.871274 (+ 4260us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:10.871282 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:10.871869 (+ 587us) server_negotiation.cc:407] Connection header received
0807 04:20:10.872173 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:10.872182 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:10.872408 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:10.872540 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:20:10.873451 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:10.875030 (+ 1579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:10.878237 (+ 3207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:10.879637 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:10.879776 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:10.879990 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:10.880280 (+ 290us) server_negotiation.cc:299] Negotiation successful
0807 04:20:10.880445 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4077,"thread_start_us":3941,"threads_started":1}
I20260807 04:20:10.880302 25316 tablet_service.cc:1467] Processing CreateTablet for tablet e67a6fa175284683960de7a37ba03362 (DEFAULT_TABLE table=test-table [id=88c905a2c28a4c93a89db823cf4a72a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:20:10.881182 25182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e67a6fa175284683960de7a37ba03362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:20:10.882223 25316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e67a6fa175284683960de7a37ba03362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:20:10.884008 25448 tablet_service.cc:1467] Processing CreateTablet for tablet e67a6fa175284683960de7a37ba03362 (DEFAULT_TABLE table=test-table [id=88c905a2c28a4c93a89db823cf4a72a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:20:10.885160 25448 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e67a6fa175284683960de7a37ba03362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:20:10.897020 25531 tablet_bootstrap.cc:492] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c: Bootstrap starting.
I20260807 04:20:10.899164 25533 tablet_bootstrap.cc:492] T e67a6fa175284683960de7a37ba03362 P 7c2a6448647747aca04385a2c27a6f23: Bootstrap starting.
I20260807 04:20:10.900110 25532 tablet_bootstrap.cc:492] T e67a6fa175284683960de7a37ba03362 P d28d786ca0584e44be07550f5e15eeb4: Bootstrap starting.
I20260807 04:20:10.901098 25531 tablet_bootstrap.cc:654] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c: Neither blocks nor log segments found. Creating new log.
I20260807 04:20:10.902565 25531 log.cc:824] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c: Log is configured to *not* fsync() on all Append() calls
I20260807 04:20:10.903237 25532 tablet_bootstrap.cc:654] T e67a6fa175284683960de7a37ba03362 P d28d786ca0584e44be07550f5e15eeb4: Neither blocks nor log segments found. Creating new log.
I20260807 04:20:10.903442 25533 tablet_bootstrap.cc:654] T e67a6fa175284683960de7a37ba03362 P 7c2a6448647747aca04385a2c27a6f23: Neither blocks nor log segments found. Creating new log.
I20260807 04:20:10.904541 25532 log.cc:824] T e67a6fa175284683960de7a37ba03362 P d28d786ca0584e44be07550f5e15eeb4: Log is configured to *not* fsync() on all Append() calls
I20260807 04:20:10.904656 25533 log.cc:824] T e67a6fa175284683960de7a37ba03362 P 7c2a6448647747aca04385a2c27a6f23: Log is configured to *not* fsync() on all Append() calls
I20260807 04:20:10.907483 25531 tablet_bootstrap.cc:492] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c: No bootstrap required, opened a new log
I20260807 04:20:10.907852 25531 ts_tablet_manager.cc:1397] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.006s
I20260807 04:20:10.911283 25533 tablet_bootstrap.cc:492] T e67a6fa175284683960de7a37ba03362 P 7c2a6448647747aca04385a2c27a6f23: No bootstrap required, opened a new log
I20260807 04:20:10.911528 25532 tablet_bootstrap.cc:492] T e67a6fa175284683960de7a37ba03362 P d28d786ca0584e44be07550f5e15eeb4: No bootstrap required, opened a new log
I20260807 04:20:10.911579 25533 ts_tablet_manager.cc:1397] T e67a6fa175284683960de7a37ba03362 P 7c2a6448647747aca04385a2c27a6f23: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.003s
I20260807 04:20:10.911798 25532 ts_tablet_manager.cc:1397] T e67a6fa175284683960de7a37ba03362 P d28d786ca0584e44be07550f5e15eeb4: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.003s
I20260807 04:20:10.919370 25533 raft_consensus.cc:348] T e67a6fa175284683960de7a37ba03362 P 7c2a6448647747aca04385a2c27a6f23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c2a6448647747aca04385a2c27a6f23" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37671 } } peers { permanent_uuid: "d28d786ca0584e44be07550f5e15eeb4" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 38375 } } peers { permanent_uuid: "accb8bfbee134c56a80bee01a851008c" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39751 } }
I20260807 04:20:10.919338 25531 raft_consensus.cc:348] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c2a6448647747aca04385a2c27a6f23" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37671 } } peers { permanent_uuid: "d28d786ca0584e44be07550f5e15eeb4" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 38375 } } peers { permanent_uuid: "accb8bfbee134c56a80bee01a851008c" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39751 } }
I20260807 04:20:10.919768 25533 raft_consensus.cc:374] T e67a6fa175284683960de7a37ba03362 P 7c2a6448647747aca04385a2c27a6f23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:20:10.919796 25531 raft_consensus.cc:374] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:20:10.919862 25533 raft_consensus.cc:729] T e67a6fa175284683960de7a37ba03362 P 7c2a6448647747aca04385a2c27a6f23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c2a6448647747aca04385a2c27a6f23, State: Initialized, Role: FOLLOWER
I20260807 04:20:10.919886 25531 raft_consensus.cc:729] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: accb8bfbee134c56a80bee01a851008c, State: Initialized, Role: FOLLOWER
I20260807 04:20:10.920495 25533 consensus_queue.cc:260] T e67a6fa175284683960de7a37ba03362 P 7c2a6448647747aca04385a2c27a6f23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c2a6448647747aca04385a2c27a6f23" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37671 } } peers { permanent_uuid: "d28d786ca0584e44be07550f5e15eeb4" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 38375 } } peers { permanent_uuid: "accb8bfbee134c56a80bee01a851008c" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39751 } }
I20260807 04:20:10.920627 25531 consensus_queue.cc:260] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c2a6448647747aca04385a2c27a6f23" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37671 } } peers { permanent_uuid: "d28d786ca0584e44be07550f5e15eeb4" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 38375 } } peers { permanent_uuid: "accb8bfbee134c56a80bee01a851008c" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39751 } }
I20260807 04:20:10.922466 25533 ts_tablet_manager.cc:1428] T e67a6fa175284683960de7a37ba03362 P 7c2a6448647747aca04385a2c27a6f23: Time spent starting tablet: real 0.011s user 0.008s sys 0.004s
I20260807 04:20:10.923276 25532 raft_consensus.cc:348] T e67a6fa175284683960de7a37ba03362 P d28d786ca0584e44be07550f5e15eeb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c2a6448647747aca04385a2c27a6f23" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37671 } } peers { permanent_uuid: "d28d786ca0584e44be07550f5e15eeb4" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 38375 } } peers { permanent_uuid: "accb8bfbee134c56a80bee01a851008c" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39751 } }
I20260807 04:20:10.923624 25515 heartbeater.cc:503] Master 127.7.200.254:33243 was elected leader, sending a full tablet report...
I20260807 04:20:10.923830 25532 raft_consensus.cc:374] T e67a6fa175284683960de7a37ba03362 P d28d786ca0584e44be07550f5e15eeb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:20:10.923938 25532 raft_consensus.cc:729] T e67a6fa175284683960de7a37ba03362 P d28d786ca0584e44be07550f5e15eeb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d28d786ca0584e44be07550f5e15eeb4, State: Initialized, Role: FOLLOWER
I20260807 04:20:10.924331 25531 ts_tablet_manager.cc:1428] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c: Time spent starting tablet: real 0.016s user 0.017s sys 0.001s
I20260807 04:20:10.924678 25532 consensus_queue.cc:260] T e67a6fa175284683960de7a37ba03362 P d28d786ca0584e44be07550f5e15eeb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c2a6448647747aca04385a2c27a6f23" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37671 } } peers { permanent_uuid: "d28d786ca0584e44be07550f5e15eeb4" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 38375 } } peers { permanent_uuid: "accb8bfbee134c56a80bee01a851008c" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39751 } }
I20260807 04:20:10.925942 25381 heartbeater.cc:503] Master 127.7.200.254:33243 was elected leader, sending a full tablet report...
I20260807 04:20:10.926641 25532 ts_tablet_manager.cc:1428] T e67a6fa175284683960de7a37ba03362 P d28d786ca0584e44be07550f5e15eeb4: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
W20260807 04:20:11.036464 25516 tablet.cc:2369] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 04:20:11.038069 25382 tablet.cc:2369] T e67a6fa175284683960de7a37ba03362 P d28d786ca0584e44be07550f5e15eeb4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:20:11.042280 25538 raft_consensus.cc:482] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:20:11.042582 25538 raft_consensus.cc:504] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c2a6448647747aca04385a2c27a6f23" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37671 } } peers { permanent_uuid: "d28d786ca0584e44be07550f5e15eeb4" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 38375 } } peers { permanent_uuid: "accb8bfbee134c56a80bee01a851008c" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39751 } }
I20260807 04:20:11.044405 25538 leader_election.cc:288] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c2a6448647747aca04385a2c27a6f23 (127.7.200.193:37671), d28d786ca0584e44be07550f5e15eeb4 (127.7.200.194:38375)
I20260807 04:20:11.051254 25519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:11.044819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37671 (local address 127.7.200.195:44899)
0807 04:20:11.045060 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:11.045081 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 04:20:11.045216 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:20:11.045780 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:20:11.045783 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:20:11.045833 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:20:11.046118 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:11.046133 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:11.047485 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:11.047491 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:11.049096 (+ 1605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:11.049108 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:11.050497 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:11.050504 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:11.050709 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:11.050744 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 04:20:11.050834 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 04:20:11.050971 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88,"mutex_wait_us":66,"spinlock_wait_cycles":22784}
I20260807 04:20:11.051427 25526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:11.044826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:44899 (local address 127.7.200.193:37671)
0807 04:20:11.045100 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:11.045109 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:11.045143 (+ 34us) server_negotiation.cc:407] Connection header received
0807 04:20:11.045433 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:11.045442 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:11.045525 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:11.045632 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:20:11.046286 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:11.047338 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:11.049267 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:11.050333 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:11.050467 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:11.050524 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:11.050893 (+ 369us) server_negotiation.cc:299] Negotiation successful
0807 04:20:11.051116 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260807 04:20:11.051769 25528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:11.045348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:60295 (local address 127.7.200.194:38375)
0807 04:20:11.045579 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:11.045586 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:11.045843 (+ 257us) server_negotiation.cc:407] Connection header received
0807 04:20:11.045987 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:11.045993 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:11.046070 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:11.046179 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:20:11.046863 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:11.047639 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:11.049802 (+ 2163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:11.050736 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:11.050889 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:11.050955 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:11.051355 (+ 400us) server_negotiation.cc:299] Negotiation successful
0807 04:20:11.051502 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260807 04:20:11.052443 25540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:11.044846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:38375 (local address 127.7.200.195:60295)
0807 04:20:11.045730 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:11.045746 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 04:20:11.045867 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:20:11.046235 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:20:11.046240 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:20:11.046266 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:20:11.046700 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:11.046713 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:11.047788 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:11.047792 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:11.049641 (+ 1849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:11.049656 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:11.050967 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:11.050974 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:11.051163 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:11.051196 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 04:20:11.051309 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 04:20:11.052043 (+ 734us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":765,"thread_start_us":526,"threads_started":1}
I20260807 04:20:11.052597 25202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e67a6fa175284683960de7a37ba03362" candidate_uuid: "accb8bfbee134c56a80bee01a851008c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2a6448647747aca04385a2c27a6f23" is_pre_election: true
I20260807 04:20:11.053318 25202 raft_consensus.cc:2454] T e67a6fa175284683960de7a37ba03362 P 7c2a6448647747aca04385a2c27a6f23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate accb8bfbee134c56a80bee01a851008c in term 0.
I20260807 04:20:11.053562 25336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e67a6fa175284683960de7a37ba03362" candidate_uuid: "accb8bfbee134c56a80bee01a851008c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28d786ca0584e44be07550f5e15eeb4" is_pre_election: true
I20260807 04:20:11.054067 25336 raft_consensus.cc:2454] T e67a6fa175284683960de7a37ba03362 P d28d786ca0584e44be07550f5e15eeb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate accb8bfbee134c56a80bee01a851008c in term 0.
I20260807 04:20:11.054215 25400 leader_election.cc:302] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c2a6448647747aca04385a2c27a6f23, accb8bfbee134c56a80bee01a851008c; no voters:
I20260807 04:20:11.054684 25538 raft_consensus.cc:2781] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:20:11.054826 25538 raft_consensus.cc:482] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:20:11.054926 25538 raft_consensus.cc:3037] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:20:11.057637 25538 raft_consensus.cc:504] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c2a6448647747aca04385a2c27a6f23" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37671 } } peers { permanent_uuid: "d28d786ca0584e44be07550f5e15eeb4" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 38375 } } peers { permanent_uuid: "accb8bfbee134c56a80bee01a851008c" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39751 } }
I20260807 04:20:11.058243 25538 leader_election.cc:288] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c [CANDIDATE]: Term 1 election: Requested vote from peers 7c2a6448647747aca04385a2c27a6f23 (127.7.200.193:37671), d28d786ca0584e44be07550f5e15eeb4 (127.7.200.194:38375)
I20260807 04:20:11.058805 25336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e67a6fa175284683960de7a37ba03362" candidate_uuid: "accb8bfbee134c56a80bee01a851008c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d28d786ca0584e44be07550f5e15eeb4"
I20260807 04:20:11.058808 25202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e67a6fa175284683960de7a37ba03362" candidate_uuid: "accb8bfbee134c56a80bee01a851008c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c2a6448647747aca04385a2c27a6f23"
I20260807 04:20:11.059024 25336 raft_consensus.cc:3037] T e67a6fa175284683960de7a37ba03362 P d28d786ca0584e44be07550f5e15eeb4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:20:11.059023 25202 raft_consensus.cc:3037] T e67a6fa175284683960de7a37ba03362 P 7c2a6448647747aca04385a2c27a6f23 [term 0 FOLLOWER]: Advancing to term 1
W20260807 04:20:11.062055 25249 tablet.cc:2369] T e67a6fa175284683960de7a37ba03362 P 7c2a6448647747aca04385a2c27a6f23: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:20:11.062382 25336 raft_consensus.cc:2454] T e67a6fa175284683960de7a37ba03362 P d28d786ca0584e44be07550f5e15eeb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate accb8bfbee134c56a80bee01a851008c in term 1.
I20260807 04:20:11.062389 25202 raft_consensus.cc:2454] T e67a6fa175284683960de7a37ba03362 P 7c2a6448647747aca04385a2c27a6f23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate accb8bfbee134c56a80bee01a851008c in term 1.
I20260807 04:20:11.062903 25402 leader_election.cc:302] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: accb8bfbee134c56a80bee01a851008c, d28d786ca0584e44be07550f5e15eeb4; no voters:
I20260807 04:20:11.063266 25538 raft_consensus.cc:2781] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:20:11.063755 25538 raft_consensus.cc:686] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c [term 1 LEADER]: Becoming Leader. State: Replica: accb8bfbee134c56a80bee01a851008c, State: Running, Role: LEADER
I20260807 04:20:11.064232 25538 consensus_queue.cc:237] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c2a6448647747aca04385a2c27a6f23" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37671 } } peers { permanent_uuid: "d28d786ca0584e44be07550f5e15eeb4" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 38375 } } peers { permanent_uuid: "accb8bfbee134c56a80bee01a851008c" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39751 } }
I20260807 04:20:11.069211 25053 catalog_manager.cc:5495] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c reported cstate change: term changed from 0 to 1, leader changed from <none> to accb8bfbee134c56a80bee01a851008c (127.7.200.195). New cstate: current_term: 1 leader_uuid: "accb8bfbee134c56a80bee01a851008c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c2a6448647747aca04385a2c27a6f23" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d28d786ca0584e44be07550f5e15eeb4" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 38375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "accb8bfbee134c56a80bee01a851008c" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39751 } health_report { overall_health: HEALTHY } } }
I20260807 04:20:11.114290 25530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:11.109153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38390 (local address 127.7.200.195:39751)
0807 04:20:11.109348 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:11.109353 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:11.109371 (+ 18us) server_negotiation.cc:407] Connection header received
0807 04:20:11.109565 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:11.109568 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:11.109661 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:11.109792 (+ 131us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:20:11.110150 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:11.110849 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:11.112290 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:11.112690 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:11.112822 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:11.113301 (+ 479us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:20:11.113791 (+ 490us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:20:11.113899 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:11.114004 (+ 105us) server_negotiation.cc:299] Negotiation successful
0807 04:20:11.114072 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 04:20:11.122663 25202 raft_consensus.cc:1261] T e67a6fa175284683960de7a37ba03362 P 7c2a6448647747aca04385a2c27a6f23 [term 1 FOLLOWER]: Refusing update from remote peer accb8bfbee134c56a80bee01a851008c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:20:11.122763 25336 raft_consensus.cc:1261] T e67a6fa175284683960de7a37ba03362 P d28d786ca0584e44be07550f5e15eeb4 [term 1 FOLLOWER]: Refusing update from remote peer accb8bfbee134c56a80bee01a851008c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:20:11.123780 25541 consensus_queue.cc:1035] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d28d786ca0584e44be07550f5e15eeb4" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 38375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:20:11.124145 25538 consensus_queue.cc:1035] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c2a6448647747aca04385a2c27a6f23" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:20:11.136333 25543 mvcc.cc:205] Tried to move back new op lower bound from 7315768979947925504 to 7315768979723456512. Current Snapshot: MvccSnapshot[applied={T|T < 7315768979947925504}]
I20260807 04:20:11.140492 25545 mvcc.cc:205] Tried to move back new op lower bound from 7315768979947925504 to 7315768979723456512. Current Snapshot: MvccSnapshot[applied={T|T < 7315768979947925504}]
I20260807 04:20:11.150679 25055 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32918:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:20:11.151031 25055 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:32918:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:20:11.154708 25055 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6: Sending DeleteTablet for 3 replicas of tablet e67a6fa175284683960de7a37ba03362
I20260807 04:20:11.156195 25182 tablet_service.cc:1514] Processing DeleteTablet for tablet e67a6fa175284683960de7a37ba03362 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:20:11 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:32930
I20260807 04:20:11.156221 25448 tablet_service.cc:1514] Processing DeleteTablet for tablet e67a6fa175284683960de7a37ba03362 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:20:11 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:38376
I20260807 04:20:11.156677 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 25095
I20260807 04:20:11.157335 25316 tablet_service.cc:1514] Processing DeleteTablet for tablet e67a6fa175284683960de7a37ba03362 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:20:11 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:53700
I20260807 04:20:11.169055 25554 tablet_replica.cc:330] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c: stopping tablet replica
I20260807 04:20:11.169225 25555 tablet_replica.cc:330] T e67a6fa175284683960de7a37ba03362 P d28d786ca0584e44be07550f5e15eeb4: stopping tablet replica
I20260807 04:20:11.169624 25554 raft_consensus.cc:2229] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:20:11.169649 25555 raft_consensus.cc:2229] T e67a6fa175284683960de7a37ba03362 P d28d786ca0584e44be07550f5e15eeb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:20:11.170356 25555 raft_consensus.cc:2258] T e67a6fa175284683960de7a37ba03362 P d28d786ca0584e44be07550f5e15eeb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:20:11.170365 25554 raft_consensus.cc:2258] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:20:11.171100 25553 tablet_replica.cc:330] T e67a6fa175284683960de7a37ba03362 P 7c2a6448647747aca04385a2c27a6f23: stopping tablet replica
I20260807 04:20:11.171478 25553 raft_consensus.cc:2229] T e67a6fa175284683960de7a37ba03362 P 7c2a6448647747aca04385a2c27a6f23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:20:11.171953 25553 raft_consensus.cc:2258] T e67a6fa175284683960de7a37ba03362 P 7c2a6448647747aca04385a2c27a6f23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:20:11.174547 25554 ts_tablet_manager.cc:1905] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:20:11.175837 25553 ts_tablet_manager.cc:1905] T e67a6fa175284683960de7a37ba03362 P 7c2a6448647747aca04385a2c27a6f23: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:20:11.178421 25555 ts_tablet_manager.cc:1905] T e67a6fa175284683960de7a37ba03362 P d28d786ca0584e44be07550f5e15eeb4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:20:11.180083 25526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:11.158543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32942 (local address 127.7.200.193:37671)
0807 04:20:11.158782 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:11.158790 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:11.158813 (+ 23us) server_negotiation.cc:407] Connection header received
0807 04:20:11.158885 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:11.158893 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:11.158995 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:11.159120 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:20:11.162098 (+ 2978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:11.163674 (+ 1576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:11.166414 (+ 2740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:11.167425 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:11.167591 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:11.171977 (+ 4386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:20:11.171993 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:20:11.172010 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:20:11.172064 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:20:11.176276 (+ 4212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:11.177308 (+ 1032us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:11.177317 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:11.177321 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:11.177484 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:11.177942 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:11.177947 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:11.177950 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:11.178442 (+ 492us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:20:11.178883 (+ 441us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:11.179234 (+ 351us) server_negotiation.cc:299] Negotiation successful
0807 04:20:11.179489 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 04:20:11.181083 25243 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:20:11.182156 25554 ts_tablet_manager.cc:1918] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:20:11.182346 25554 log.cc:1196] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/wal/wals/e67a6fa175284683960de7a37ba03362
I20260807 04:20:11.182964 25554 ts_tablet_manager.cc:1939] T e67a6fa175284683960de7a37ba03362 P accb8bfbee134c56a80bee01a851008c: Deleting consensus metadata
I20260807 04:20:11.184973 25041 catalog_manager.cc:4841] TS accb8bfbee134c56a80bee01a851008c (127.7.200.195:39751): tablet e67a6fa175284683960de7a37ba03362 (table test-table [id=88c905a2c28a4c93a89db823cf4a72a5]) successfully deleted
I20260807 04:20:11.188275 25555 ts_tablet_manager.cc:1918] T e67a6fa175284683960de7a37ba03362 P d28d786ca0584e44be07550f5e15eeb4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:20:11.188493 25555 log.cc:1196] T e67a6fa175284683960de7a37ba03362 P d28d786ca0584e44be07550f5e15eeb4: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/wal/wals/e67a6fa175284683960de7a37ba03362
I20260807 04:20:11.189191 25555 ts_tablet_manager.cc:1939] T e67a6fa175284683960de7a37ba03362 P d28d786ca0584e44be07550f5e15eeb4: Deleting consensus metadata
I20260807 04:20:11.191464 25041 catalog_manager.cc:4841] TS d28d786ca0584e44be07550f5e15eeb4 (127.7.200.194:38375): tablet e67a6fa175284683960de7a37ba03362 (table test-table [id=88c905a2c28a4c93a89db823cf4a72a5]) successfully deleted
I20260807 04:20:11.289166 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 25095
I20260807 04:20:11.318626 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 25252
W20260807 04:20:11.318580 25039 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.200.193:37671 (error 108)
I20260807 04:20:11.321115 25529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:11.320537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37671 (local address 127.0.0.1:32948)
0807 04:20:11.320785 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:11.320927 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:37671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260807 04:20:11.321455 25039 catalog_manager.cc:4584] TS 7c2a6448647747aca04385a2c27a6f23 (127.7.200.193:37671): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e67a6fa175284683960de7a37ba03362: Network error: Client connection negotiation failed: client connection to 127.7.200.193:37671: connect: Connection refused (error 111)
I20260807 04:20:11.334734 25528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:11.319681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53714 (local address 127.7.200.194:38375)
0807 04:20:11.319893 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:11.319899 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:11.319921 (+ 22us) server_negotiation.cc:407] Connection header received
0807 04:20:11.320115 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:11.320121 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:11.320222 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:11.320342 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:20:11.322261 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:11.323146 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:11.324537 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:11.325036 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:11.325187 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:11.327860 (+ 2673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:20:11.327875 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:20:11.327890 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:20:11.327924 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:20:11.331589 (+ 3665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:11.332403 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:11.332412 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:11.332414 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:11.332538 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:11.333003 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:11.333009 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:11.333013 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:11.333405 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:20:11.333751 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:11.334104 (+ 353us) server_negotiation.cc:299] Negotiation successful
0807 04:20:11.334338 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260807 04:20:11.335570 25376 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:20:11.375259 25529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:11.374615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37671 (local address 127.0.0.1:32956)
0807 04:20:11.374882 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:11.375035 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:37671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260807 04:20:11.376652 25529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:11.376197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37671 (local address 127.0.0.1:32958)
0807 04:20:11.376379 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:11.376487 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:37671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260807 04:20:11.429095 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 25252
I20260807 04:20:11.437429 25529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:11.436948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37671 (local address 127.0.0.1:32970)
0807 04:20:11.437176 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:11.437264 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:37671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260807 04:20:11.438763 25529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:11.438332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37671 (local address 127.0.0.1:32974)
0807 04:20:11.438531 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:11.438620 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:37671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260807 04:20:11.455349 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 25384
I20260807 04:20:11.473547 25530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:11.456426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38398 (local address 127.7.200.195:39751)
0807 04:20:11.456662 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:11.456669 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:11.456692 (+ 23us) server_negotiation.cc:407] Connection header received
0807 04:20:11.456921 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:11.456927 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:11.457015 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:11.457142 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:20:11.458657 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:11.459940 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:11.461651 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:11.462329 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:11.462488 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:11.465574 (+ 3086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:20:11.465596 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:20:11.465622 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:20:11.465680 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:20:11.470003 (+ 4323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:11.470842 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:11.470853 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:11.470856 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:11.471068 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:11.471479 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:11.471483 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:11.471487 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:11.471952 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:20:11.472280 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:11.472551 (+ 271us) server_negotiation.cc:299] Negotiation successful
0807 04:20:11.473084 (+ 533us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 04:20:11.474522 25510 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:20:11.519788 25529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:11.519267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37671 (local address 127.0.0.1:32978)
0807 04:20:11.519490 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:11.519601 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:37671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260807 04:20:11.521013 25529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:11.520576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37671 (local address 127.0.0.1:32986)
0807 04:20:11.520830 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:11.520903 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:37671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260807 04:20:11.601823 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 25384
I20260807 04:20:11.625283 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 25020
I20260807 04:20:11.626682 25088 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:20:11.746066 25529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:11.745283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37671 (local address 127.0.0.1:33002)
0807 04:20:11.745485 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:11.745624 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:37671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 04:20:11.746398 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 25020
I20260807 04:20:31.772645 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:33243
--webserver_interface=127.7.200.254
--webserver_port=43423
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:44215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:33243
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:20:32.129741 25562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:20:32.130062 25562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:20:32.130244 25562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:20:32.137934 25562 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 04:20:32.138065 25562 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 04:20:32.138135 25562 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 04:20:32.138214 25562 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:20:32.138309 25562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:20:32.138412 25562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:20:32.138499 25562 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:20:32.138583 25562 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:20:32.149067 25562 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:44215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:33243
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:33243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=43423
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:20:32.150493 25562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:20:32.151986 25562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:20:32.165000 25567 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:32.165030 25568 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:32.164978 25570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:20:32.166072 25562 server_base.cc:1034] running on GCE node
I20260807 04:20:32.166958 25562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:20:32.168562 25562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:20:32.169831 25562 hybrid_clock.cc:648] HybridClock initialized: now 1786076432169762 us; error 61 us; skew 500 ppm
I20260807 04:20:32.170193 25562 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:20:32 dist-test-slave-qg60 krb5kdc[24443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076432, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:20:32.173744 25562 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:20:32.175531 25562 webserver.cc:460] Webserver started at http://127.7.200.254:43423/ using document root <none> and password file <none>
I20260807 04:20:32.176306 25562 fs_manager.cc:359] Metadata directory not provided
I20260807 04:20:32.176477 25562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:20:32.182520 25562 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 04:20:32.185791 25577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:32.187453 25562 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 04:20:32.187702 25562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "3319b95142dc425da470194be83b15d6"
format_stamp: "Formatted at 2026-08-07 04:19:45 on dist-test-slave-qg60"
server_key: "c57806b9c706ea7d21a867083593f456"
server_key_iv: "02844981e93a2ef35c9aba1cf1c34feb"
server_key_version: "encryptionkey@0"
I20260807 04:20:32.188992 25562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:20:32.205824 25562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:20:32.211078 25562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:20:32.211424 25562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:20:32.232983 25562 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:33243
I20260807 04:20:32.233006 25628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:33243 every 8 connection(s)
I20260807 04:20:32.234781 25562 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:20:32.236424 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 25562
I20260807 04:20:32.237618 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:37671
--local_ip_for_outbound_sockets=127.7.200.193
--tserver_master_addrs=127.7.200.254:33243
--webserver_port=38665
--webserver_interface=127.7.200.193
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:44215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 04:20:32.245513 25629 sys_catalog.cc:263] Verifying existing consensus state
I20260807 04:20:32.250972 25629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6: Bootstrap starting.
I20260807 04:20:32.272681 25629 log.cc:824] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6: Log is configured to *not* fsync() on all Append() calls
I20260807 04:20:32.289359 25629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 04:20:32.289986 25629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6: Bootstrap complete.
I20260807 04:20:32.299978 25629 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3319b95142dc425da470194be83b15d6" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 33243 } }
I20260807 04:20:32.301033 25629 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3319b95142dc425da470194be83b15d6, State: Initialized, Role: FOLLOWER
I20260807 04:20:32.301795 25629 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3319b95142dc425da470194be83b15d6" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 33243 } }
I20260807 04:20:32.302043 25629 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:20:32.302166 25629 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:20:32.302366 25629 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [term 2 FOLLOWER]: Advancing to term 3
I20260807 04:20:32.306555 25629 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3319b95142dc425da470194be83b15d6" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 33243 } }
I20260807 04:20:32.307093 25629 leader_election.cc:302] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3319b95142dc425da470194be83b15d6; no voters:
I20260807 04:20:32.307807 25629 leader_election.cc:288] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 04:20:32.307962 25633 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 04:20:32.309209 25633 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [term 3 LEADER]: Becoming Leader. State: Replica: 3319b95142dc425da470194be83b15d6, State: Running, Role: LEADER
I20260807 04:20:32.309813 25633 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3319b95142dc425da470194be83b15d6" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 33243 } }
I20260807 04:20:32.310197 25629 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:20:32.312958 25634 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "3319b95142dc425da470194be83b15d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3319b95142dc425da470194be83b15d6" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 33243 } } }
I20260807 04:20:32.313285 25634 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [sys.catalog]: This master's current role is: LEADER
I20260807 04:20:32.312561 25635 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3319b95142dc425da470194be83b15d6. Latest consensus state: current_term: 3 leader_uuid: "3319b95142dc425da470194be83b15d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3319b95142dc425da470194be83b15d6" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 33243 } } }
I20260807 04:20:32.313896 25635 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6 [sys.catalog]: This master's current role is: LEADER
I20260807 04:20:32.317363 25639 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:20:32.330379 25639 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:20:32.332490 25639 catalog_manager.cc:1259] Loaded cluster ID: 62fc90204ef344ea88c2afd9580e0a98
I20260807 04:20:32.332628 25639 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:20:32.338922 25639 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:20:32.340637 25650 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 04:20:32.341065 25639 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6: Loaded TSK: 0
I20260807 04:20:32.341357 25639 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3319b95142dc425da470194be83b15d6: Loaded TSK: 1
F20260807 04:20:32.342232 25639 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f2b409bc9ad google::LogMessage::Fail() at ??:0
@ 0x7f2b409bf88a google::LogMessage::SendToLog() at ??:0
@ 0x7f2b409bc4de google::LogMessage::Flush() at ??:0
@ 0x7f2b409bda19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f2b447207d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f2b4470f73e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f2b563ef1c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f2b563ee783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f2b5647a2a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f2b5647a0c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f2b564c45e9 std::function<>::operator()() at ??:0
@ 0x7f2b563f2cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f2b563f0c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f2b56478610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f2b56478439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f2b43608345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f2b4360b91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f2b4360b799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f2b435e6eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f2b468c06db start_thread at ??:0
@ 0x7f2b3f85661f clone at ??:0
W20260807 04:20:32.689108 25631 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:20:32.689416 25631 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:20:32.689519 25631 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:20:32.697290 25631 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:20:32.697407 25631 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:20:32.697523 25631 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:20:32.707816 25631 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:44215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:37671
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=38665
--tserver_master_addrs=127.7.200.254:33243
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:20:32.709246 25631 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:20:32.710602 25631 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:20:32.724177 25676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:32.724242 25677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:32.724213 25679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:20:32.725680 25631 server_base.cc:1034] running on GCE node
I20260807 04:20:32.726348 25631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:20:32.727283 25631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:20:32.728502 25631 hybrid_clock.cc:648] HybridClock initialized: now 1786076432728451 us; error 38 us; skew 500 ppm
I20260807 04:20:32.728855 25631 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:20:32 dist-test-slave-qg60 krb5kdc[24443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076432, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:20:32.732223 25631 init.cc:377] Logged in from keytab as kudu/127.7.200.193@KRBTEST.COM (short username kudu)
I20260807 04:20:32.733861 25631 webserver.cc:460] Webserver started at http://127.7.200.193:38665/ using document root <none> and password file <none>
I20260807 04:20:32.734557 25631 fs_manager.cc:359] Metadata directory not provided
I20260807 04:20:32.734746 25631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:20:32.740302 25631 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 04:20:32.748399 25686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:32.750762 25631 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.001s sys 0.006s
I20260807 04:20:32.750982 25631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "7c2a6448647747aca04385a2c27a6f23"
format_stamp: "Formatted at 2026-08-07 04:19:46 on dist-test-slave-qg60"
server_key: "1433c1e1e0a26d0b2e91b7c6ed70b54c"
server_key_iv: "8dec78025135586da77ac0fc7e4cc10c"
server_key_version: "encryptionkey@0"
I20260807 04:20:32.752645 25631 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:20:32.774323 25631 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:20:32.778646 25631 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:20:32.778944 25631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:20:32.779982 25631 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:20:32.782073 25693 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260807 04:20:32.787788 25693 ts_tablet_manager.cc:1852] T e67a6fa175284683960de7a37ba03362 P 7c2a6448647747aca04385a2c27a6f23: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260807 04:20:32.788924 25693 ts_tablet_manager.cc:1905] T e67a6fa175284683960de7a37ba03362 P 7c2a6448647747aca04385a2c27a6f23: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:20:32.796907 25693 ts_tablet_manager.cc:1918] T e67a6fa175284683960de7a37ba03362 P 7c2a6448647747aca04385a2c27a6f23: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:20:32.797153 25693 log.cc:1196] T e67a6fa175284683960de7a37ba03362 P 7c2a6448647747aca04385a2c27a6f23: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/wal/wals/e67a6fa175284683960de7a37ba03362
I20260807 04:20:32.797703 25693 ts_tablet_manager.cc:1939] T e67a6fa175284683960de7a37ba03362 P 7c2a6448647747aca04385a2c27a6f23: Deleting consensus metadata
I20260807 04:20:32.798139 25631 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260807 04:20:32.798291 25631 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.017s user 0.001s sys 0.000s
I20260807 04:20:32.798449 25631 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:20:32.798547 25631 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:32.835644 25631 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:37671
I20260807 04:20:32.835736 25802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:37671 every 8 connection(s)
I20260807 04:20:32.837102 25631 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:20:32.842468 25805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:32.840322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.193:36423)
0807 04:20:32.841187 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:32.841540 (+ 353us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":383,"threads_started":1}
W20260807 04:20:32.843322 25803 heartbeater.cc:644] Failed to heartbeat to 127.7.200.254:33243 (0 consecutive failures): Network error: Failed to ping master at 127.7.200.254:33243: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
I20260807 04:20:32.844273 25805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:32.843892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.193:58681)
0807 04:20:32.844083 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:32.844164 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260807 04:20:32.845168 25805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:32.844820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.193:54781)
0807 04:20:32.844963 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:32.845045 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 04:20:32.845372 25803 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 04:20:32.847697 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 25631
I20260807 04:20:32.848294 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:38375
--local_ip_for_outbound_sockets=127.7.200.194
--tserver_master_addrs=127.7.200.254:33243
--webserver_port=39537
--webserver_interface=127.7.200.194
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:44215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:20:33.203835 25806 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:20:33.204141 25806 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:20:33.204311 25806 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:20:33.211875 25806 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:20:33.211999 25806 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:20:33.212181 25806 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:20:33.222427 25806 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:44215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:38375
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=39537
--tserver_master_addrs=127.7.200.254:33243
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:20:33.223829 25806 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:20:33.225241 25806 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:20:33.239198 25812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:33.239274 25813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:33.239470 25815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:20:33.241310 25806 server_base.cc:1034] running on GCE node
I20260807 04:20:33.241964 25806 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:20:33.243036 25806 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:20:33.244258 25806 hybrid_clock.cc:648] HybridClock initialized: now 1786076433244212 us; error 34 us; skew 500 ppm
I20260807 04:20:33.244589 25806 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:20:33 dist-test-slave-qg60 krb5kdc[24443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076433, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:20:33.248049 25806 init.cc:377] Logged in from keytab as kudu/127.7.200.194@KRBTEST.COM (short username kudu)
I20260807 04:20:33.249725 25806 webserver.cc:460] Webserver started at http://127.7.200.194:39537/ using document root <none> and password file <none>
I20260807 04:20:33.250504 25806 fs_manager.cc:359] Metadata directory not provided
I20260807 04:20:33.250629 25806 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:20:33.256984 25806 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 04:20:33.260006 25822 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:33.261981 25806 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 04:20:33.262209 25806 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "d28d786ca0584e44be07550f5e15eeb4"
format_stamp: "Formatted at 2026-08-07 04:19:47 on dist-test-slave-qg60"
server_key: "c13774cf67abd51c61da3dbfba497db2"
server_key_iv: "a5c23015f7a979d59ac2b914bb849c91"
server_key_version: "encryptionkey@0"
I20260807 04:20:33.263407 25806 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:20:33.283468 25806 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:20:33.288322 25806 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:20:33.288605 25806 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:20:33.289767 25806 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:20:33.291220 25806 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:20:33.291320 25806 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:33.291412 25806 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:20:33.291487 25806 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:33.327680 25806 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:38375
I20260807 04:20:33.327874 25938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:38375 every 8 connection(s)
I20260807 04:20:33.329397 25806 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:20:33.332283 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 25806
I20260807 04:20:33.333130 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:39751
--local_ip_for_outbound_sockets=127.7.200.195
--tserver_master_addrs=127.7.200.254:33243
--webserver_port=36123
--webserver_interface=127.7.200.195
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:44215
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 04:20:33.335067 25941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:33.332452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.194:33255)
0807 04:20:33.333377 (+ 925us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:33.333749 (+ 372us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":389,"threads_started":1}
W20260807 04:20:33.335876 25939 heartbeater.cc:644] Failed to heartbeat to 127.7.200.254:33243 (0 consecutive failures): Network error: Failed to ping master at 127.7.200.254:33243: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
I20260807 04:20:33.336966 25941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:33.336573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.194:59327)
0807 04:20:33.336781 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:33.336855 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260807 04:20:33.337836 25941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:33.337486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.194:47543)
0807 04:20:33.337644 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:33.337727 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260807 04:20:33.338047 25939 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 04:20:33.685582 25942 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:20:33.685870 25942 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:20:33.686057 25942 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:20:33.693440 25942 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:20:33.693560 25942 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:20:33.693804 25942 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:20:33.703719 25942 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:44215
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:39751
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=36123
--tserver_master_addrs=127.7.200.254:33243
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:20:33.705209 25942 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:20:33.706579 25942 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:20:33.720135 25948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:33.720135 25950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:33.720793 25947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:20:33.721349 25942 server_base.cc:1034] running on GCE node
I20260807 04:20:33.721987 25942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:20:33.723042 25942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:20:33.724277 25942 hybrid_clock.cc:648] HybridClock initialized: now 1786076433724212 us; error 58 us; skew 500 ppm
I20260807 04:20:33.724602 25942 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:20:33 dist-test-slave-qg60 krb5kdc[24443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076433, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:20:33.727841 25942 init.cc:377] Logged in from keytab as kudu/127.7.200.195@KRBTEST.COM (short username kudu)
I20260807 04:20:33.729512 25942 webserver.cc:460] Webserver started at http://127.7.200.195:36123/ using document root <none> and password file <none>
I20260807 04:20:33.730237 25942 fs_manager.cc:359] Metadata directory not provided
I20260807 04:20:33.730393 25942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:20:33.736294 25942 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260807 04:20:33.739208 25957 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:33.740696 25942 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 04:20:33.740963 25942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "accb8bfbee134c56a80bee01a851008c"
format_stamp: "Formatted at 2026-08-07 04:19:47 on dist-test-slave-qg60"
server_key: "a53350da6539d9575730382ab4a1b01e"
server_key_iv: "1609b82d5159674639c9a80903a9a731"
server_key_version: "encryptionkey@0"
I20260807 04:20:33.741978 25942 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:20:33.769713 25942 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:20:33.774515 25942 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:20:33.774824 25942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:20:33.775906 25942 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:20:33.777344 25942 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:20:33.777470 25942 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:33.777602 25942 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:20:33.777690 25942 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:33.813208 25942 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:39751
I20260807 04:20:33.813298 26074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:39751 every 8 connection(s)
I20260807 04:20:33.814719 25942 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:20:33.818656 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 25942
I20260807 04:20:33.820314 26077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:33.817826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.195:42465)
0807 04:20:33.818754 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:33.819187 (+ 433us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":334,"threads_started":1}
W20260807 04:20:33.821113 26075 heartbeater.cc:644] Failed to heartbeat to 127.7.200.254:33243 (0 consecutive failures): Network error: Failed to ping master at 127.7.200.254:33243: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
I20260807 04:20:33.821973 26077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:33.821637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.195:59989)
0807 04:20:33.821791 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:33.821863 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260807 04:20:33.822901 26077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:33.822583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.195:45343)
0807 04:20:33.822716 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:33.822792 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 04:20:33.823223 26075 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 04:20:33.847020 26079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:33.845987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.193:51635)
0807 04:20:33.846634 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:33.846750 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":361,"threads_started":1}
I20260807 04:20:34.339542 26080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:34.338675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.194:42501)
0807 04:20:34.339165 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:34.339281 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":229,"threads_started":1}
I20260807 04:20:34.824816 26081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:34.823890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.195:44033)
0807 04:20:34.824396 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:34.824494 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":259,"threads_started":1}
I20260807 04:20:34.848971 26082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:34.848050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.193:52987)
0807 04:20:34.848653 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:34.848796 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":390,"threads_started":1}
I20260807 04:20:35.341387 26083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:35.340602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.194:35807)
0807 04:20:35.341137 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:35.341221 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":285,"threads_started":1}
I20260807 04:20:35.826655 26084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:35.825857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.195:56947)
0807 04:20:35.826354 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:35.826477 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":253,"threads_started":1}
I20260807 04:20:35.850952 26085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:35.849975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.193:47677)
0807 04:20:35.850596 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:35.850744 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":335,"threads_started":1}
I20260807 04:20:36.343230 26086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:36.342367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.194:50269)
0807 04:20:36.342939 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:36.343024 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":313,"threads_started":1}
I20260807 04:20:36.828545 26087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:36.827675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.195:59983)
0807 04:20:36.828248 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:36.828342 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":343,"threads_started":1}
I20260807 04:20:36.852977 26088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:36.852105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.193:53259)
0807 04:20:36.852635 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:36.852782 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":282,"threads_started":1}
I20260807 04:20:37.345014 26089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:37.344183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.194:44281)
0807 04:20:37.344651 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:37.344814 (+ 163us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":236,"threads_started":1}
I20260807 04:20:37.830507 26090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:37.829711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.195:35865)
0807 04:20:37.830229 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:37.830320 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":283,"threads_started":1}
I20260807 04:20:37.854944 26091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:37.854010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.193:33775)
0807 04:20:37.854632 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:37.854759 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":314,"threads_started":1}
I20260807 04:20:38.347064 26092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:38.346103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.194:36899)
0807 04:20:38.346734 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:38.346832 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":383,"threads_started":1}
I20260807 04:20:38.832532 26093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:38.831649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.195:58373)
0807 04:20:38.832267 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:38.832359 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":299,"threads_started":1}
I20260807 04:20:38.857129 26094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:38.856019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.193:57597)
0807 04:20:38.856695 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:38.856864 (+ 169us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":353,"threads_started":1}
I20260807 04:20:39.348994 26095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:39.348110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.194:41855)
0807 04:20:39.348645 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:39.348796 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":301,"threads_started":1}
I20260807 04:20:39.834482 26096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:39.833607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.195:52225)
0807 04:20:39.834186 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:39.834296 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":287,"threads_started":1}
I20260807 04:20:39.858995 26097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:39.858041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.193:35017)
0807 04:20:39.858632 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:39.858776 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":233,"threads_started":1}
I20260807 04:20:40.350894 26098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:40.350034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.194:51443)
0807 04:20:40.350584 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:40.350675 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":228,"threads_started":1}
I20260807 04:20:40.836613 26100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:40.835617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.195:60399)
0807 04:20:40.836211 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:40.836332 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":254,"threads_started":1}
I20260807 04:20:40.860843 26101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:40.859966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.193:60231)
0807 04:20:40.860513 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:40.860607 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":318,"threads_started":1}
I20260807 04:20:41.352661 26102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:41.351925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.194:57273)
0807 04:20:41.352385 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:41.352469 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":242,"threads_started":1}
I20260807 04:20:41.838465 26103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:41.837673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.195:38493)
0807 04:20:41.838210 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:41.838307 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":304,"threads_started":1}
I20260807 04:20:41.862584 26104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:41.861797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.193:48869)
0807 04:20:41.862309 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:41.862409 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":267,"threads_started":1}
I20260807 04:20:42.354511 26105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:42.353613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.194:45117)
0807 04:20:42.354215 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:42.354304 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":281,"threads_started":1}
I20260807 04:20:42.840253 26106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:42.839412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.195:52585)
0807 04:20:42.839991 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:42.840083 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":345,"threads_started":1}
I20260807 04:20:42.864265 26107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:42.863540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.193:39717)
0807 04:20:42.864000 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:42.864085 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":229,"threads_started":1}
I20260807 04:20:43.356166 26108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:43.355437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.194:58059)
0807 04:20:43.355908 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:43.355995 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":254,"threads_started":1}
I20260807 04:20:43.842017 26109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:43.841272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.195:43389)
0807 04:20:43.841755 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:43.841845 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":266,"threads_started":1}
I20260807 04:20:43.866065 26110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:43.865262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.193:49883)
0807 04:20:43.865776 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:43.865862 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":297,"threads_started":1}
I20260807 04:20:44.358081 26111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:44.357272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.194:48503)
0807 04:20:44.357754 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:44.357892 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":266,"threads_started":1}
I20260807 04:20:44.844125 26112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:44.843176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.195:42249)
0807 04:20:44.843828 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:44.843938 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":419,"threads_started":1}
I20260807 04:20:44.867772 26113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:44.866980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.193:46039)
0807 04:20:44.867520 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:44.867612 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":322,"threads_started":1}
I20260807 04:20:45.359988 26114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:45.359088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.194:39623)
0807 04:20:45.359620 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:45.359704 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":291,"threads_started":1}
I20260807 04:20:45.845876 26115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:45.845136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.195:41629)
0807 04:20:45.845639 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:45.845721 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":284,"threads_started":1}
I20260807 04:20:45.869673 26116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:45.868794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.193:41645)
0807 04:20:45.869376 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:45.869478 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":330,"threads_started":1}
I20260807 04:20:46.361860 26117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:46.361041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.194:56073)
0807 04:20:46.361550 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:46.361658 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":260,"threads_started":1}
I20260807 04:20:46.848023 26118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:46.847042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.195:38219)
0807 04:20:46.847642 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:46.847768 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":292,"threads_started":1}
I20260807 04:20:46.871531 26119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:46.870719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.193:56595)
0807 04:20:46.871231 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:46.871317 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":271,"threads_started":1}
I20260807 04:20:47.363751 26120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:47.362888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.194:37639)
0807 04:20:47.363473 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:47.363557 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":339,"threads_started":1}
I20260807 04:20:47.849956 26121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:47.849058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.195:37933)
0807 04:20:47.849660 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:47.849758 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":336,"threads_started":1}
I20260807 04:20:47.873644 26122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:47.872708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.193:58773)
0807 04:20:47.873353 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:47.873446 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":341,"threads_started":1}
I20260807 04:20:48.365737 26123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:48.364984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.194:42699)
0807 04:20:48.365445 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:48.365547 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":238,"threads_started":1}
I20260807 04:20:48.822293 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 25631
I20260807 04:20:48.842664 26124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:48.823656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39716 (local address 127.7.200.193:37671)
0807 04:20:48.824428 (+ 772us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:48.824443 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:48.824486 (+ 43us) server_negotiation.cc:407] Connection header received
0807 04:20:48.826438 (+ 1952us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:48.826451 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:48.826947 (+ 496us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:48.827291 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:20:48.828996 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:48.830397 (+ 1401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:48.831756 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:48.832566 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:48.832721 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:48.835614 (+ 2893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:20:48.835622 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:20:48.835639 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:20:48.835680 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:20:48.839312 (+ 3632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:48.840050 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:48.840057 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:48.840064 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:48.840244 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:48.840667 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:48.840671 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:48.840673 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:48.841325 (+ 652us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:20:48.841581 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:48.842001 (+ 420us) server_negotiation.cc:299] Negotiation successful
0807 04:20:48.842357 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":440,"threads_started":1}
I20260807 04:20:48.844278 25798 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:20:48.852063 26126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:48.851097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:33243 (local address 127.7.200.195:43013)
0807 04:20:48.851663 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:48.851815 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.254:33243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":288,"threads_started":1}
I20260807 04:20:48.935992 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 25631
I20260807 04:20:48.956848 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 25806
I20260807 04:20:48.975817 26128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:48.957966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52002 (local address 127.7.200.194:38375)
0807 04:20:48.958537 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:48.958552 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:48.958597 (+ 45us) server_negotiation.cc:407] Connection header received
0807 04:20:48.960202 (+ 1605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:48.960212 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:48.960647 (+ 435us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:48.961089 (+ 442us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:20:48.962669 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:48.963939 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:48.965368 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:48.966070 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:48.966275 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:48.969384 (+ 3109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:20:48.969392 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:20:48.969419 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:20:48.969464 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:20:48.972494 (+ 3030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:48.973411 (+ 917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:48.973418 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:48.973425 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:48.973613 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:48.973976 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:48.973979 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:48.973982 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:48.974518 (+ 536us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:20:48.974757 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:48.975192 (+ 435us) server_negotiation.cc:299] Negotiation successful
0807 04:20:48.975527 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":271,"threads_started":1}
I20260807 04:20:48.977298 25934 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:20:49.062242 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 25806
I20260807 04:20:49.082302 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 25942
I20260807 04:20:49.101293 26130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:49.083315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45600 (local address 127.7.200.195:39751)
0807 04:20:49.083878 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:49.083893 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:49.083935 (+ 42us) server_negotiation.cc:407] Connection header received
0807 04:20:49.085833 (+ 1898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:49.085843 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:49.086327 (+ 484us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:49.086707 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:20:49.088199 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:49.089515 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:49.090836 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:49.091507 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:49.091726 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:49.094530 (+ 2804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:20:49.094538 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:20:49.094555 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:20:49.094599 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:20:49.097710 (+ 3111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:49.098531 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:49.098538 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:49.098545 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:49.098726 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:49.099154 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:49.099160 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:49.099168 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:49.099712 (+ 544us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:20:49.100038 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:49.100508 (+ 470us) server_negotiation.cc:299] Negotiation successful
0807 04:20:49.100977 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":254,"threads_started":1}
I20260807 04:20:49.102681 26070 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:20:49.188547 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 25942
2026-08-07T04:20:49Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (65280 ms)
[----------] 30 tests from SecurityITest (311881 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:20:49 dist-test-slave-qg60 krb5kdc[26134](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:20:49 dist-test-slave-qg60 krb5kdc[26134](info): set up 2 sockets
Aug 07 04:20:49 dist-test-slave-qg60 krb5kdc[26134](info): commencing operation
krb5kdc: starting...
W20260807 04:20:50.374176 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.142s user 0.003s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:20:50 dist-test-slave-qg60 krb5kdc[26134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076450, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:20:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:20:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
I20260807 04:20:50.719784 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:39511
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:40217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:39511
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:20:51.071796 26148 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:20:51.072156 26148 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:20:51.072322 26148 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:20:51.080297 26148 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:20:51.080452 26148 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:20:51.080549 26148 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:20:51.080647 26148 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:20:51.080720 26148 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:20:51.090906 26148 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:40217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:39511
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:39511
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:20:51.092341 26148 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:20:51.093773 26148 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:20:51.106125 26153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:51.106168 26154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:51.106091 26156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:20:51.107112 26148 server_base.cc:1034] running on GCE node
I20260807 04:20:51.107955 26148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:20:51.109500 26148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:20:51.110739 26148 hybrid_clock.cc:648] HybridClock initialized: now 1786076451110687 us; error 58 us; skew 500 ppm
I20260807 04:20:51.111111 26148 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:20:51 dist-test-slave-qg60 krb5kdc[26134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076451, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:20:51.118908 26148 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:20:51.120507 26148 webserver.cc:460] Webserver started at http://127.7.200.254:43071/ using document root <none> and password file <none>
I20260807 04:20:51.121333 26148 fs_manager.cc:359] Metadata directory not provided
I20260807 04:20:51.121481 26148 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:20:51.121795 26148 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:20:51.124963 26148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "32a0226080e341038d8823830eff11d9"
format_stamp: "Formatted at 2026-08-07 04:20:51 on dist-test-slave-qg60"
server_key: "ccee8d29248733f9374ebaed1740ed68"
server_key_iv: "e817cf1ed011f8a61295c3f2a615dd49"
server_key_version: "encryptionkey@0"
I20260807 04:20:51.125774 26148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "32a0226080e341038d8823830eff11d9"
format_stamp: "Formatted at 2026-08-07 04:20:51 on dist-test-slave-qg60"
server_key: "ccee8d29248733f9374ebaed1740ed68"
server_key_iv: "e817cf1ed011f8a61295c3f2a615dd49"
server_key_version: "encryptionkey@0"
I20260807 04:20:51.131160 26148 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 04:20:51.134740 26163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:51.136047 26148 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260807 04:20:51.136261 26148 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "32a0226080e341038d8823830eff11d9"
format_stamp: "Formatted at 2026-08-07 04:20:51 on dist-test-slave-qg60"
server_key: "ccee8d29248733f9374ebaed1740ed68"
server_key_iv: "e817cf1ed011f8a61295c3f2a615dd49"
server_key_version: "encryptionkey@0"
I20260807 04:20:51.136461 26148 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:20:51.153900 26148 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:20:51.158219 26148 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:20:51.158533 26148 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:20:51.177945 26148 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:39511
I20260807 04:20:51.177966 26216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:39511 every 8 connection(s)
I20260807 04:20:51.179418 26148 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:20:51.181916 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 26148
I20260807 04:20:51.182157 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:20:51.182842 7971 external_mini_cluster.cc:1428] Setting key e6c4a7030ead19d31d6490c73d6ac742
I20260807 04:20:51.183470 26217 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:20:51.198827 26217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32a0226080e341038d8823830eff11d9: Bootstrap starting.
Aug 07 04:20:51 dist-test-slave-qg60 krb5kdc[26134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076450, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:20:51.202469 26217 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 32a0226080e341038d8823830eff11d9: Neither blocks nor log segments found. Creating new log.
I20260807 04:20:51.203616 26217 log.cc:824] T 00000000000000000000000000000000 P 32a0226080e341038d8823830eff11d9: Log is configured to *not* fsync() on all Append() calls
I20260807 04:20:51.206790 26217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32a0226080e341038d8823830eff11d9: No bootstrap required, opened a new log
I20260807 04:20:51.208249 26220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:51.184921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47938 (local address 127.7.200.254:39511)
0807 04:20:51.185801 (+ 880us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:51.185816 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:51.185866 (+ 50us) server_negotiation.cc:407] Connection header received
0807 04:20:51.188337 (+ 2471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:51.188362 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:51.188857 (+ 495us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:51.189255 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:20:51.191301 (+ 2046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:51.192613 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:51.194620 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:51.195399 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:51.195547 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:51.200688 (+ 5141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:20:51.200698 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:20:51.200713 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:20:51.200808 (+ 95us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:20:51.204066 (+ 3258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:51.204839 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:51.204850 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:51.204856 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:51.205053 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:51.205484 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:51.205489 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:51.205496 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:51.206026 (+ 530us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:20:51.206360 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:51.206815 (+ 455us) server_negotiation.cc:299] Negotiation successful
0807 04:20:51.207258 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":367,"threads_started":1}
I20260807 04:20:51.214960 26217 raft_consensus.cc:348] T 00000000000000000000000000000000 P 32a0226080e341038d8823830eff11d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32a0226080e341038d8823830eff11d9" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 39511 } }
I20260807 04:20:51.215356 26217 raft_consensus.cc:374] T 00000000000000000000000000000000 P 32a0226080e341038d8823830eff11d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:20:51.215472 26217 raft_consensus.cc:729] T 00000000000000000000000000000000 P 32a0226080e341038d8823830eff11d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32a0226080e341038d8823830eff11d9, State: Initialized, Role: FOLLOWER
I20260807 04:20:51.216078 26217 consensus_queue.cc:260] T 00000000000000000000000000000000 P 32a0226080e341038d8823830eff11d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32a0226080e341038d8823830eff11d9" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 39511 } }
I20260807 04:20:51.216316 26217 raft_consensus.cc:388] T 00000000000000000000000000000000 P 32a0226080e341038d8823830eff11d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:20:51.216455 26217 raft_consensus.cc:482] T 00000000000000000000000000000000 P 32a0226080e341038d8823830eff11d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:20:51.216646 26217 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 32a0226080e341038d8823830eff11d9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:20:51.219173 26217 raft_consensus.cc:504] T 00000000000000000000000000000000 P 32a0226080e341038d8823830eff11d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32a0226080e341038d8823830eff11d9" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 39511 } }
I20260807 04:20:51.219640 26217 leader_election.cc:302] T 00000000000000000000000000000000 P 32a0226080e341038d8823830eff11d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 32a0226080e341038d8823830eff11d9; no voters:
I20260807 04:20:51.220216 26217 leader_election.cc:288] T 00000000000000000000000000000000 P 32a0226080e341038d8823830eff11d9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:20:51.220350 26222 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 32a0226080e341038d8823830eff11d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:20:51.222083 26222 raft_consensus.cc:686] T 00000000000000000000000000000000 P 32a0226080e341038d8823830eff11d9 [term 1 LEADER]: Becoming Leader. State: Replica: 32a0226080e341038d8823830eff11d9, State: Running, Role: LEADER
I20260807 04:20:51.222594 26222 consensus_queue.cc:237] T 00000000000000000000000000000000 P 32a0226080e341038d8823830eff11d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32a0226080e341038d8823830eff11d9" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 39511 } }
I20260807 04:20:51.222895 26217 sys_catalog.cc:564] T 00000000000000000000000000000000 P 32a0226080e341038d8823830eff11d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:20:51.225467 26224 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32a0226080e341038d8823830eff11d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 32a0226080e341038d8823830eff11d9. Latest consensus state: current_term: 1 leader_uuid: "32a0226080e341038d8823830eff11d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32a0226080e341038d8823830eff11d9" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 39511 } } }
I20260807 04:20:51.225811 26224 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32a0226080e341038d8823830eff11d9 [sys.catalog]: This master's current role is: LEADER
I20260807 04:20:51.226305 26223 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32a0226080e341038d8823830eff11d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "32a0226080e341038d8823830eff11d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32a0226080e341038d8823830eff11d9" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 39511 } } }
I20260807 04:20:51.226627 26223 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32a0226080e341038d8823830eff11d9 [sys.catalog]: This master's current role is: LEADER
I20260807 04:20:51.226827 26230 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:20:51.232553 26230 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:20:51.241813 26230 catalog_manager.cc:1347] Generated new cluster ID: 0c06d8a4cee84f688a3f38efe5b565af
I20260807 04:20:51.241940 26230 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:20:51.258862 26230 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:20:51.260296 26230 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:20:51.274623 26230 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 32a0226080e341038d8823830eff11d9: Generated new TSK 0
I20260807 04:20:51.275665 26230 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.200.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
I20260807 04:20:51.358145 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:0
--local_ip_for_outbound_sockets=127.7.200.193
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:39511
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:40217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:20:51.710167 26243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:20:51.710506 26243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:20:51.710669 26243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:20:51.718240 26243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:20:51.718384 26243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:20:51.718550 26243 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:20:51.728799 26243 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:40217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:39511
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:20:51.730127 26243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:20:51.731492 26243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:20:51.745115 26248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:51.745162 26249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:51.745323 26251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:20:51.746335 26243 server_base.cc:1034] running on GCE node
I20260807 04:20:51.747008 26243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:20:51.748005 26243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:20:51.749239 26243 hybrid_clock.cc:648] HybridClock initialized: now 1786076451749187 us; error 45 us; skew 500 ppm
I20260807 04:20:51.749574 26243 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:20:51 dist-test-slave-qg60 krb5kdc[26134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076451, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:20:51.753396 26243 init.cc:377] Logged in from keytab as kudu/127.7.200.193@KRBTEST.COM (short username kudu)
I20260807 04:20:51.754894 26243 webserver.cc:460] Webserver started at http://127.7.200.193:42545/ using document root <none> and password file <none>
I20260807 04:20:51.755575 26243 fs_manager.cc:359] Metadata directory not provided
I20260807 04:20:51.755682 26243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:20:51.756011 26243 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:20:51.759136 26243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-0/data/instance:
uuid: "b0712311185a43e497f447d8d2aad27d"
format_stamp: "Formatted at 2026-08-07 04:20:51 on dist-test-slave-qg60"
server_key: "3db7ce12355f0934d27b05cdd270f59a"
server_key_iv: "6d19f6cca5768e05ef9c7c315b986138"
server_key_version: "encryptionkey@0"
I20260807 04:20:51.759932 26243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance:
uuid: "b0712311185a43e497f447d8d2aad27d"
format_stamp: "Formatted at 2026-08-07 04:20:51 on dist-test-slave-qg60"
server_key: "3db7ce12355f0934d27b05cdd270f59a"
server_key_iv: "6d19f6cca5768e05ef9c7c315b986138"
server_key_version: "encryptionkey@0"
I20260807 04:20:51.765409 26243 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260807 04:20:51.768863 26258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:51.770211 26243 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:20:51.770383 26243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "b0712311185a43e497f447d8d2aad27d"
format_stamp: "Formatted at 2026-08-07 04:20:51 on dist-test-slave-qg60"
server_key: "3db7ce12355f0934d27b05cdd270f59a"
server_key_iv: "6d19f6cca5768e05ef9c7c315b986138"
server_key_version: "encryptionkey@0"
I20260807 04:20:51.770599 26243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:20:51.788834 26243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:20:51.793141 26243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:20:51.793429 26243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:20:51.794417 26243 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:20:51.795809 26243 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:20:51.795909 26243 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:51.796064 26243 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:20:51.796136 26243 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:51.831466 26243 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:46827
I20260807 04:20:51.831514 26373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:46827 every 8 connection(s)
I20260807 04:20:51.832861 26243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:20:51.842788 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 26243
I20260807 04:20:51.843053 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance
I20260807 04:20:51.843776 7971 external_mini_cluster.cc:1428] Setting key 179de4381f75231ef8512fe7f85adfb0
Aug 07 04:20:51 dist-test-slave-qg60 krb5kdc[26134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076451, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:20:51.856797 26376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:51.835619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:58299 (local address 127.7.200.254:39511)
0807 04:20:51.836103 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:51.836109 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:51.837203 (+ 1094us) server_negotiation.cc:407] Connection header received
0807 04:20:51.839524 (+ 2321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:51.839531 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:51.839633 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:51.839783 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:20:51.841562 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:51.842499 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:51.844339 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:51.844977 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:51.845107 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:51.848995 (+ 3888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:20:51.849005 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:20:51.849013 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:20:51.849064 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:20:51.853096 (+ 4032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:51.853898 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:51.853908 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:51.853915 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:51.854092 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:51.854546 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:51.854555 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:51.854561 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:51.854993 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:20:51.855172 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:51.855914 (+ 742us) server_negotiation.cc:299] Negotiation successful
0807 04:20:51.856215 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":249,"threads_started":1}
I20260807 04:20:51.857522 26377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:51.836173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:39511 (local address 127.7.200.193:58299)
0807 04:20:51.837026 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:51.837073 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 04:20:51.839164 (+ 2091us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:20:51.840055 (+ 891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:20:51.840064 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:20:51.840707 (+ 643us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:20:51.841369 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:51.841388 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:51.842685 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:51.842689 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:51.844184 (+ 1495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:51.844197 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:51.845238 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:51.845245 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:51.845572 (+ 327us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:51.846414 (+ 842us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:20:51.846442 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:20:51.848681 (+ 2239us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:20:51.853259 (+ 4578us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:20:51.853267 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:20:51.853282 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:20:51.853751 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:20:51.854222 (+ 471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:20:51.854225 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:20:51.854227 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:20:51.854419 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:20:51.855132 (+ 713us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:20:51.855137 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:20:51.855482 (+ 345us) client_negotiation.cc:769] Sending connection context
0807 04:20:51.855724 (+ 242us) client_negotiation.cc:240] Negotiation successful
0807 04:20:51.856182 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":308,"threads_started":1}
I20260807 04:20:51.859650 26374 heartbeater.cc:347] Connected to a master server at 127.7.200.254:39511
I20260807 04:20:51.860024 26374 heartbeater.cc:464] Registering TS with master...
I20260807 04:20:51.861129 26374 heartbeater.cc:511] Master 127.7.200.254:39511 requested a full tablet report, sending...
I20260807 04:20:51.863768 26181 ts_manager.cc:194] Registered new tserver with Master: b0712311185a43e497f447d8d2aad27d (127.7.200.193:46827)
I20260807 04:20:51.866124 26181 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.193@KRBTEST.COM'} at 127.7.200.193:58299
WARNING: no policy specified for kudu/127.7.200.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
I20260807 04:20:51.918556 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:0
--local_ip_for_outbound_sockets=127.7.200.194
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:39511
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:40217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:20:52.261984 26380 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:20:52.262290 26380 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:20:52.262387 26380 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:20:52.269682 26380 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:20:52.269794 26380 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:20:52.269906 26380 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:20:52.280478 26380 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:40217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:39511
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:20:52.282351 26380 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:20:52.283792 26380 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:20:52.297701 26386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:52.297650 26388 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:52.298204 26385 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:20:52.298576 26380 server_base.cc:1034] running on GCE node
I20260807 04:20:52.299307 26380 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:20:52.300261 26380 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:20:52.301487 26380 hybrid_clock.cc:648] HybridClock initialized: now 1786076452301438 us; error 51 us; skew 500 ppm
I20260807 04:20:52.301810 26380 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:20:52 dist-test-slave-qg60 krb5kdc[26134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076452, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:20:52.305119 26380 init.cc:377] Logged in from keytab as kudu/127.7.200.194@KRBTEST.COM (short username kudu)
I20260807 04:20:52.306689 26380 webserver.cc:460] Webserver started at http://127.7.200.194:41423/ using document root <none> and password file <none>
I20260807 04:20:52.307397 26380 fs_manager.cc:359] Metadata directory not provided
I20260807 04:20:52.307544 26380 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:20:52.307865 26380 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:20:52.310943 26380 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-1/data/instance:
uuid: "cb7cd7d0c9074601af163136b6c093c3"
format_stamp: "Formatted at 2026-08-07 04:20:52 on dist-test-slave-qg60"
server_key: "9800d4064eaf02b144baee5d4d74dd77"
server_key_iv: "f61f6fa5abe7c8c06e1c806835436ff5"
server_key_version: "encryptionkey@0"
I20260807 04:20:52.311741 26380 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance:
uuid: "cb7cd7d0c9074601af163136b6c093c3"
format_stamp: "Formatted at 2026-08-07 04:20:52 on dist-test-slave-qg60"
server_key: "9800d4064eaf02b144baee5d4d74dd77"
server_key_iv: "f61f6fa5abe7c8c06e1c806835436ff5"
server_key_version: "encryptionkey@0"
I20260807 04:20:52.316980 26380 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.003s
I20260807 04:20:52.320469 26395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:52.321885 26380 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:20:52.322050 26380 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "cb7cd7d0c9074601af163136b6c093c3"
format_stamp: "Formatted at 2026-08-07 04:20:52 on dist-test-slave-qg60"
server_key: "9800d4064eaf02b144baee5d4d74dd77"
server_key_iv: "f61f6fa5abe7c8c06e1c806835436ff5"
server_key_version: "encryptionkey@0"
I20260807 04:20:52.322263 26380 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:20:52.357366 26380 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:20:52.361557 26380 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:20:52.361851 26380 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:20:52.362812 26380 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:20:52.364173 26380 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:20:52.364274 26380 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:52.364421 26380 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:20:52.364491 26380 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:52.398351 26380 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:45123
I20260807 04:20:52.398437 26511 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:45123 every 8 connection(s)
I20260807 04:20:52.399698 26380 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:20:52.401078 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 26380
I20260807 04:20:52.401286 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance
I20260807 04:20:52.401913 7971 external_mini_cluster.cc:1428] Setting key b22afe2c6485289b6e90c477675ef75d
Aug 07 04:20:52 dist-test-slave-qg60 krb5kdc[26134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076452, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:20:52.420444 26514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:52.402603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:40613 (local address 127.7.200.254:39511)
0807 04:20:52.403079 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:52.403085 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:52.404377 (+ 1292us) server_negotiation.cc:407] Connection header received
0807 04:20:52.406125 (+ 1748us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:52.406131 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:52.406223 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:52.406332 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:20:52.407839 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:52.408551 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:52.410138 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:52.410582 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:52.410713 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:52.414338 (+ 3625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:20:52.414349 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:20:52.414353 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:20:52.414385 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:20:52.417173 (+ 2788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:52.418137 (+ 964us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:52.418141 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:52.418143 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:52.418284 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:52.418773 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:52.418776 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:52.418778 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:52.419029 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:20:52.419144 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:52.419999 (+ 855us) server_negotiation.cc:299] Negotiation successful
0807 04:20:52.420170 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":241,"threads_started":1}
I20260807 04:20:52.422092 26515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:52.403133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:39511 (local address 127.7.200.194:40613)
0807 04:20:52.403912 (+ 779us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:52.403970 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 04:20:52.405849 (+ 1879us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:20:52.406604 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:20:52.406612 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:20:52.407114 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:20:52.407670 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:52.407687 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:52.408706 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:52.408711 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:52.409986 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:52.409998 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:52.410812 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:52.410819 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:52.411050 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:52.411720 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:20:52.411747 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:20:52.414111 (+ 2364us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:20:52.417319 (+ 3208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:20:52.417327 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:20:52.417343 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:20:52.417968 (+ 625us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:20:52.418395 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:20:52.418403 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:20:52.418410 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:20:52.418660 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:20:52.419153 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:20:52.419164 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:20:52.419617 (+ 453us) client_negotiation.cc:769] Sending connection context
0807 04:20:52.419925 (+ 308us) client_negotiation.cc:240] Negotiation successful
0807 04:20:52.420554 (+ 629us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":315,"threads_started":1}
I20260807 04:20:52.423625 26512 heartbeater.cc:347] Connected to a master server at 127.7.200.254:39511
I20260807 04:20:52.423990 26512 heartbeater.cc:464] Registering TS with master...
I20260807 04:20:52.424916 26512 heartbeater.cc:511] Master 127.7.200.254:39511 requested a full tablet report, sending...
I20260807 04:20:52.426671 26181 ts_manager.cc:194] Registered new tserver with Master: cb7cd7d0c9074601af163136b6c093c3 (127.7.200.194:45123)
I20260807 04:20:52.427981 26181 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.194@KRBTEST.COM'} at 127.7.200.194:40613
WARNING: no policy specified for kudu/127.7.200.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
I20260807 04:20:52.474129 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:0
--local_ip_for_outbound_sockets=127.7.200.195
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:39511
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:40217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:20:52.835753 26518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:20:52.836032 26518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:20:52.836221 26518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:20:52.843784 26518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:20:52.843945 26518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:20:52.844132 26518 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:20:52.854835 26518 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:40217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:39511
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:20:52.856336 26518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:20:52.857846 26518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 04:20:52.869649 26374 heartbeater.cc:503] Master 127.7.200.254:39511 was elected leader, sending a full tablet report...
W20260807 04:20:52.871778 26523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:52.872318 26527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:52.872359 26524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:20:52.873759 26518 server_base.cc:1034] running on GCE node
I20260807 04:20:52.874449 26518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:20:52.875627 26518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:20:52.876833 26518 hybrid_clock.cc:648] HybridClock initialized: now 1786076452876764 us; error 63 us; skew 500 ppm
I20260807 04:20:52.877175 26518 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:20:52 dist-test-slave-qg60 krb5kdc[26134](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076452, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:20:52.880573 26518 init.cc:377] Logged in from keytab as kudu/127.7.200.195@KRBTEST.COM (short username kudu)
I20260807 04:20:52.882175 26518 webserver.cc:460] Webserver started at http://127.7.200.195:33187/ using document root <none> and password file <none>
I20260807 04:20:52.882917 26518 fs_manager.cc:359] Metadata directory not provided
I20260807 04:20:52.883066 26518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:20:52.883388 26518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:20:52.886392 26518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-2/data/instance:
uuid: "73cf996d83874aa8977d8b7070c60e04"
format_stamp: "Formatted at 2026-08-07 04:20:52 on dist-test-slave-qg60"
server_key: "7e0217cde680500a6d70cbddfc70283a"
server_key_iv: "9d1329bc47f38ae5f228f71fb4197192"
server_key_version: "encryptionkey@0"
I20260807 04:20:52.887181 26518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance:
uuid: "73cf996d83874aa8977d8b7070c60e04"
format_stamp: "Formatted at 2026-08-07 04:20:52 on dist-test-slave-qg60"
server_key: "7e0217cde680500a6d70cbddfc70283a"
server_key_iv: "9d1329bc47f38ae5f228f71fb4197192"
server_key_version: "encryptionkey@0"
I20260807 04:20:52.892503 26518 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 04:20:52.896030 26534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:52.897464 26518 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:20:52.897648 26518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "73cf996d83874aa8977d8b7070c60e04"
format_stamp: "Formatted at 2026-08-07 04:20:52 on dist-test-slave-qg60"
server_key: "7e0217cde680500a6d70cbddfc70283a"
server_key_iv: "9d1329bc47f38ae5f228f71fb4197192"
server_key_version: "encryptionkey@0"
I20260807 04:20:52.897850 26518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:20:52.914373 26518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:20:52.920133 26518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:20:52.920469 26518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:20:52.921837 26518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:20:52.923463 26518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:20:52.923542 26518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:52.923640 26518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:20:52.923682 26518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:52.967188 26518 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:45737
I20260807 04:20:52.967233 26652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:45737 every 8 connection(s)
I20260807 04:20:52.968489 26518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:20:52.977612 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 26518
I20260807 04:20:52.977845 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance
I20260807 04:20:52.978350 7971 external_mini_cluster.cc:1428] Setting key 54283de7ccaa7a20475ae1f7d65a0210
Aug 07 04:20:52 dist-test-slave-qg60 krb5kdc[26134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076452, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:20:52.989678 26655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:52.971238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:33981 (local address 127.7.200.254:39511)
0807 04:20:52.971745 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:52.971750 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:52.972620 (+ 870us) server_negotiation.cc:407] Connection header received
0807 04:20:52.974838 (+ 2218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:52.974843 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:52.974930 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:52.975088 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:20:52.976620 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:52.977570 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:52.979389 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:52.979997 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:52.980100 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:52.984080 (+ 3980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:20:52.984085 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:20:52.984088 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:20:52.984120 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:20:52.986745 (+ 2625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:52.987473 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:52.987477 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:52.987480 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:52.987603 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:52.988014 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:52.988018 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:52.988020 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:52.988287 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:20:52.988412 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:52.989215 (+ 803us) server_negotiation.cc:299] Negotiation successful
0807 04:20:52.989386 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":247,"threads_started":1}
I20260807 04:20:52.990692 26656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:52.971709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:39511 (local address 127.7.200.195:33981)
0807 04:20:52.972450 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:52.972493 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 04:20:52.974497 (+ 2004us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:20:52.975289 (+ 792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:20:52.975297 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:20:52.975833 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:20:52.976452 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:52.976469 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:52.977739 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:52.977750 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:52.979206 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:52.979223 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:52.980242 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:52.980251 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:52.980557 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:52.981406 (+ 849us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:20:52.981443 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:20:52.983837 (+ 2394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:20:52.986882 (+ 3045us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:20:52.986889 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:20:52.986901 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:20:52.987345 (+ 444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:20:52.987702 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:20:52.987705 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:20:52.987708 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:20:52.987894 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:20:52.988400 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:20:52.988407 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:20:52.988810 (+ 403us) client_negotiation.cc:769] Sending connection context
0807 04:20:52.989088 (+ 278us) client_negotiation.cc:240] Negotiation successful
0807 04:20:52.989486 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":306,"threads_started":1}
I20260807 04:20:52.992081 26653 heartbeater.cc:347] Connected to a master server at 127.7.200.254:39511
I20260807 04:20:52.992429 26653 heartbeater.cc:464] Registering TS with master...
I20260807 04:20:52.993430 26653 heartbeater.cc:511] Master 127.7.200.254:39511 requested a full tablet report, sending...
I20260807 04:20:52.994890 26181 ts_manager.cc:194] Registered new tserver with Master: 73cf996d83874aa8977d8b7070c60e04 (127.7.200.195:45737)
I20260807 04:20:52.995688 26181 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.195@KRBTEST.COM'} at 127.7.200.195:33981
I20260807 04:20:53.007128 7971 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 04:20:53.026122 26655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:53.012115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47946 (local address 127.7.200.254:39511)
0807 04:20:53.012299 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:53.012303 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:53.012847 (+ 544us) server_negotiation.cc:407] Connection header received
0807 04:20:53.013117 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:53.013123 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:53.013202 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:53.013313 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:20:53.014962 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:53.015712 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:53.017177 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:53.017687 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:53.017826 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:53.020449 (+ 2623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:20:53.020454 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:20:53.020457 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:20:53.020491 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:20:53.023181 (+ 2690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:53.023920 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:53.023927 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:53.023930 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:53.024061 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:53.024465 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:53.024471 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:53.024475 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:53.024889 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:20:53.025165 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:53.025522 (+ 357us) server_negotiation.cc:299] Negotiation successful
0807 04:20:53.025794 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 04:20:53.030587 26181 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47946:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:20:53.037918 26181 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:20:53.064054 26667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:53.051315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:46827 (local address 127.0.0.1:35878)
0807 04:20:53.052013 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:53.052049 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 04:20:53.052222 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:20:53.053265 (+ 1043us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:20:53.053271 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:20:53.053302 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:20:53.053732 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:53.053748 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:53.056398 (+ 2650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:53.056407 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:53.059583 (+ 3176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:53.059607 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:53.062619 (+ 3012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:53.062629 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:53.062955 (+ 326us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:53.063034 (+ 79us) client_negotiation.cc:769] Sending connection context
0807 04:20:53.063202 (+ 168us) client_negotiation.cc:240] Negotiation successful
0807 04:20:53.063479 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":329,"threads_started":1}
I20260807 04:20:53.065423 26668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:53.051536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35878 (local address 127.7.200.193:46827)
0807 04:20:53.052192 (+ 656us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:53.052198 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:53.052223 (+ 25us) server_negotiation.cc:407] Connection header received
0807 04:20:53.052436 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:53.052444 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:53.052731 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:53.052968 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:20:53.053961 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:53.056181 (+ 2220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:53.059832 (+ 3651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:53.061909 (+ 2077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:53.062102 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:53.062431 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:53.064681 (+ 2250us) server_negotiation.cc:299] Negotiation successful
0807 04:20:53.064965 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":332,"threads_started":1}
I20260807 04:20:53.071406 26306 tablet_service.cc:1467] Processing CreateTablet for tablet 6107e4cd76ec444aa563c5023b5f96d1 (DEFAULT_TABLE table=test-table [id=79d574500fb44b55ad66715e0415f21f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:20:53.073027 26306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6107e4cd76ec444aa563c5023b5f96d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:20:53.074971 26669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:53.052440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:45123 (local address 127.0.0.1:35730)
0807 04:20:53.053016 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:53.053035 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 04:20:53.053148 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:20:53.068420 (+ 15272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:20:53.068427 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:20:53.068458 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:20:53.068851 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:53.068860 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:53.070564 (+ 1704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:53.070570 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:53.072552 (+ 1982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:53.072563 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:53.074096 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:53.074102 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:53.074354 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:53.074383 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 04:20:53.074450 (+ 67us) client_negotiation.cc:240] Negotiation successful
0807 04:20:53.074569 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"mutex_wait_us":24,"thread_start_us":315,"threads_started":1}
I20260807 04:20:53.075026 26667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:53.053137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:45737 (local address 127.0.0.1:42198)
0807 04:20:53.065946 (+ 12809us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:53.065972 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 04:20:53.066126 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:20:53.067718 (+ 1592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:20:53.067723 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:20:53.067753 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:20:53.067939 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:53.067950 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:53.070037 (+ 2087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:53.070043 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:53.072062 (+ 2019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:53.072077 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:53.073863 (+ 1786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:53.073869 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:53.074103 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:53.074191 (+ 88us) client_negotiation.cc:769] Sending connection context
0807 04:20:53.074281 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 04:20:53.074438 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12666,"mutex_wait_us":25,"thread_start_us":13682,"threads_started":1}
I20260807 04:20:53.075908 26670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:53.052828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35730 (local address 127.7.200.194:45123)
0807 04:20:53.067829 (+ 15001us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:53.067840 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:53.067869 (+ 29us) server_negotiation.cc:407] Connection header received
0807 04:20:53.067980 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:53.067988 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:53.068198 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:53.069051 (+ 853us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:20:53.069222 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:53.070394 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:53.072711 (+ 2317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:53.073829 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:53.075131 (+ 1302us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:53.075324 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:53.075413 (+ 89us) server_negotiation.cc:299] Negotiation successful
0807 04:20:53.075598 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14373,"thread_start_us":14232,"threads_started":1}
I20260807 04:20:53.076046 26672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:53.053758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42198 (local address 127.7.200.195:45737)
0807 04:20:53.067051 (+ 13293us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:53.067062 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:53.067104 (+ 42us) server_negotiation.cc:407] Connection header received
0807 04:20:53.067210 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:53.067218 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:53.067490 (+ 272us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:53.067712 (+ 222us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:20:53.068145 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:53.069854 (+ 1709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:53.072237 (+ 2383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:53.073681 (+ 1444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:53.073817 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:53.075427 (+ 1610us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:53.075510 (+ 83us) server_negotiation.cc:299] Negotiation successful
0807 04:20:53.075679 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13094,"thread_start_us":12933,"threads_started":1}
I20260807 04:20:53.079814 26444 tablet_service.cc:1467] Processing CreateTablet for tablet 6107e4cd76ec444aa563c5023b5f96d1 (DEFAULT_TABLE table=test-table [id=79d574500fb44b55ad66715e0415f21f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:20:53.079851 26585 tablet_service.cc:1467] Processing CreateTablet for tablet 6107e4cd76ec444aa563c5023b5f96d1 (DEFAULT_TABLE table=test-table [id=79d574500fb44b55ad66715e0415f21f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:20:53.081185 26444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6107e4cd76ec444aa563c5023b5f96d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:20:53.081324 26585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6107e4cd76ec444aa563c5023b5f96d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:20:53.088722 26673 tablet_bootstrap.cc:492] T 6107e4cd76ec444aa563c5023b5f96d1 P b0712311185a43e497f447d8d2aad27d: Bootstrap starting.
I20260807 04:20:53.093068 26673 tablet_bootstrap.cc:654] T 6107e4cd76ec444aa563c5023b5f96d1 P b0712311185a43e497f447d8d2aad27d: Neither blocks nor log segments found. Creating new log.
I20260807 04:20:53.094439 26674 tablet_bootstrap.cc:492] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3: Bootstrap starting.
I20260807 04:20:53.094440 26673 log.cc:824] T 6107e4cd76ec444aa563c5023b5f96d1 P b0712311185a43e497f447d8d2aad27d: Log is configured to *not* fsync() on all Append() calls
I20260807 04:20:53.095904 26675 tablet_bootstrap.cc:492] T 6107e4cd76ec444aa563c5023b5f96d1 P 73cf996d83874aa8977d8b7070c60e04: Bootstrap starting.
I20260807 04:20:53.098824 26674 tablet_bootstrap.cc:654] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3: Neither blocks nor log segments found. Creating new log.
I20260807 04:20:53.099715 26675 tablet_bootstrap.cc:654] T 6107e4cd76ec444aa563c5023b5f96d1 P 73cf996d83874aa8977d8b7070c60e04: Neither blocks nor log segments found. Creating new log.
I20260807 04:20:53.099973 26674 log.cc:824] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3: Log is configured to *not* fsync() on all Append() calls
I20260807 04:20:53.100095 26673 tablet_bootstrap.cc:492] T 6107e4cd76ec444aa563c5023b5f96d1 P b0712311185a43e497f447d8d2aad27d: No bootstrap required, opened a new log
I20260807 04:20:53.100390 26673 ts_tablet_manager.cc:1397] T 6107e4cd76ec444aa563c5023b5f96d1 P b0712311185a43e497f447d8d2aad27d: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.003s
I20260807 04:20:53.101060 26675 log.cc:824] T 6107e4cd76ec444aa563c5023b5f96d1 P 73cf996d83874aa8977d8b7070c60e04: Log is configured to *not* fsync() on all Append() calls
I20260807 04:20:53.103156 26674 tablet_bootstrap.cc:492] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3: No bootstrap required, opened a new log
I20260807 04:20:53.103441 26674 ts_tablet_manager.cc:1397] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260807 04:20:53.104154 26675 tablet_bootstrap.cc:492] T 6107e4cd76ec444aa563c5023b5f96d1 P 73cf996d83874aa8977d8b7070c60e04: No bootstrap required, opened a new log
I20260807 04:20:53.104437 26675 ts_tablet_manager.cc:1397] T 6107e4cd76ec444aa563c5023b5f96d1 P 73cf996d83874aa8977d8b7070c60e04: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260807 04:20:53.112272 26673 raft_consensus.cc:348] T 6107e4cd76ec444aa563c5023b5f96d1 P b0712311185a43e497f447d8d2aad27d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0712311185a43e497f447d8d2aad27d" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 46827 } } peers { permanent_uuid: "cb7cd7d0c9074601af163136b6c093c3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45123 } } peers { permanent_uuid: "73cf996d83874aa8977d8b7070c60e04" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 45737 } }
I20260807 04:20:53.112807 26673 raft_consensus.cc:374] T 6107e4cd76ec444aa563c5023b5f96d1 P b0712311185a43e497f447d8d2aad27d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:20:53.112947 26673 raft_consensus.cc:729] T 6107e4cd76ec444aa563c5023b5f96d1 P b0712311185a43e497f447d8d2aad27d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0712311185a43e497f447d8d2aad27d, State: Initialized, Role: FOLLOWER
I20260807 04:20:53.113659 26673 consensus_queue.cc:260] T 6107e4cd76ec444aa563c5023b5f96d1 P b0712311185a43e497f447d8d2aad27d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0712311185a43e497f447d8d2aad27d" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 46827 } } peers { permanent_uuid: "cb7cd7d0c9074601af163136b6c093c3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45123 } } peers { permanent_uuid: "73cf996d83874aa8977d8b7070c60e04" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 45737 } }
I20260807 04:20:53.115355 26675 raft_consensus.cc:348] T 6107e4cd76ec444aa563c5023b5f96d1 P 73cf996d83874aa8977d8b7070c60e04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0712311185a43e497f447d8d2aad27d" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 46827 } } peers { permanent_uuid: "cb7cd7d0c9074601af163136b6c093c3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45123 } } peers { permanent_uuid: "73cf996d83874aa8977d8b7070c60e04" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 45737 } }
I20260807 04:20:53.115715 26673 ts_tablet_manager.cc:1428] T 6107e4cd76ec444aa563c5023b5f96d1 P b0712311185a43e497f447d8d2aad27d: Time spent starting tablet: real 0.015s user 0.013s sys 0.000s
I20260807 04:20:53.115883 26675 raft_consensus.cc:374] T 6107e4cd76ec444aa563c5023b5f96d1 P 73cf996d83874aa8977d8b7070c60e04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:20:53.116025 26675 raft_consensus.cc:729] T 6107e4cd76ec444aa563c5023b5f96d1 P 73cf996d83874aa8977d8b7070c60e04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73cf996d83874aa8977d8b7070c60e04, State: Initialized, Role: FOLLOWER
I20260807 04:20:53.116710 26675 consensus_queue.cc:260] T 6107e4cd76ec444aa563c5023b5f96d1 P 73cf996d83874aa8977d8b7070c60e04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0712311185a43e497f447d8d2aad27d" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 46827 } } peers { permanent_uuid: "cb7cd7d0c9074601af163136b6c093c3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45123 } } peers { permanent_uuid: "73cf996d83874aa8977d8b7070c60e04" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 45737 } }
I20260807 04:20:53.117949 26653 heartbeater.cc:503] Master 127.7.200.254:39511 was elected leader, sending a full tablet report...
I20260807 04:20:53.118608 26675 ts_tablet_manager.cc:1428] T 6107e4cd76ec444aa563c5023b5f96d1 P 73cf996d83874aa8977d8b7070c60e04: Time spent starting tablet: real 0.014s user 0.002s sys 0.011s
I20260807 04:20:53.119095 26674 raft_consensus.cc:348] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0712311185a43e497f447d8d2aad27d" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 46827 } } peers { permanent_uuid: "cb7cd7d0c9074601af163136b6c093c3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45123 } } peers { permanent_uuid: "73cf996d83874aa8977d8b7070c60e04" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 45737 } }
I20260807 04:20:53.119598 26674 raft_consensus.cc:374] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:20:53.119760 26674 raft_consensus.cc:729] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb7cd7d0c9074601af163136b6c093c3, State: Initialized, Role: FOLLOWER
I20260807 04:20:53.120548 26674 consensus_queue.cc:260] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0712311185a43e497f447d8d2aad27d" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 46827 } } peers { permanent_uuid: "cb7cd7d0c9074601af163136b6c093c3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45123 } } peers { permanent_uuid: "73cf996d83874aa8977d8b7070c60e04" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 45737 } }
I20260807 04:20:53.123900 26512 heartbeater.cc:503] Master 127.7.200.254:39511 was elected leader, sending a full tablet report...
I20260807 04:20:53.123896 26681 raft_consensus.cc:482] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:20:53.124619 26674 ts_tablet_manager.cc:1428] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3: Time spent starting tablet: real 0.021s user 0.013s sys 0.005s
I20260807 04:20:53.124774 26681 raft_consensus.cc:504] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0712311185a43e497f447d8d2aad27d" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 46827 } } peers { permanent_uuid: "cb7cd7d0c9074601af163136b6c093c3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45123 } } peers { permanent_uuid: "73cf996d83874aa8977d8b7070c60e04" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 45737 } }
I20260807 04:20:53.126904 26681 leader_election.cc:288] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0712311185a43e497f447d8d2aad27d (127.7.200.193:46827), 73cf996d83874aa8977d8b7070c60e04 (127.7.200.195:45737)
I20260807 04:20:53.137497 26668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:53.128055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:41923 (local address 127.7.200.193:46827)
0807 04:20:53.129648 (+ 1593us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:53.129656 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:53.129679 (+ 23us) server_negotiation.cc:407] Connection header received
0807 04:20:53.129757 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:53.129764 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:53.129853 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:53.129952 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:20:53.130900 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:53.132127 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:53.135078 (+ 2951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:53.136344 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:53.136526 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:53.136610 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:53.137022 (+ 412us) server_negotiation.cc:299] Negotiation successful
0807 04:20:53.137194 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1415}
I20260807 04:20:53.138303 26683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:53.127537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:46827 (local address 127.7.200.194:41923)
0807 04:20:53.128278 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:53.128306 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0807 04:20:53.128456 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:20:53.130172 (+ 1716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:20:53.130179 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:20:53.130211 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:20:53.130692 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:53.130707 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:53.132832 (+ 2125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:53.132839 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:53.134882 (+ 2043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:53.134897 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:53.136585 (+ 1688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:53.136592 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:53.136804 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:53.136839 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 04:20:53.137721 (+ 882us) client_negotiation.cc:240] Negotiation successful
0807 04:20:53.137888 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":554,"threads_started":1}
I20260807 04:20:53.139384 26327 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6107e4cd76ec444aa563c5023b5f96d1" candidate_uuid: "cb7cd7d0c9074601af163136b6c093c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0712311185a43e497f447d8d2aad27d" is_pre_election: true
I20260807 04:20:53.140055 26327 raft_consensus.cc:2454] T 6107e4cd76ec444aa563c5023b5f96d1 P b0712311185a43e497f447d8d2aad27d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb7cd7d0c9074601af163136b6c093c3 in term 0.
I20260807 04:20:53.140898 26398 leader_election.cc:302] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0712311185a43e497f447d8d2aad27d, cb7cd7d0c9074601af163136b6c093c3; no voters:
I20260807 04:20:53.141428 26681 raft_consensus.cc:2781] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:20:53.141983 26672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:53.129569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:34223 (local address 127.7.200.195:45737)
0807 04:20:53.129897 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:53.129906 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:53.134724 (+ 4818us) server_negotiation.cc:407] Connection header received
0807 04:20:53.134938 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:53.134946 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:53.135037 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:53.135137 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:20:53.135728 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:53.136980 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:53.139337 (+ 2357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:53.140663 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:53.140886 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:53.140977 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:53.141590 (+ 613us) server_negotiation.cc:299] Negotiation successful
0807 04:20:53.141726 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128}
I20260807 04:20:53.141973 26681 raft_consensus.cc:482] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:20:53.142089 26684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:53.128609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:45737 (local address 127.7.200.194:34223)
0807 04:20:53.134602 (+ 5993us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:53.134621 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 04:20:53.134780 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:20:53.135150 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:20:53.135154 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:20:53.135185 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:20:53.135562 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:53.135574 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:53.137148 (+ 1574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:53.137152 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:53.139167 (+ 2015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:53.139180 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:53.141200 (+ 2020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:53.141206 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:53.141410 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:53.141439 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 04:20:53.141558 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 04:20:53.141707 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5852,"thread_start_us":5703,"threads_started":1}
I20260807 04:20:53.142129 26681 raft_consensus.cc:3037] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:20:53.143095 26606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6107e4cd76ec444aa563c5023b5f96d1" candidate_uuid: "cb7cd7d0c9074601af163136b6c093c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73cf996d83874aa8977d8b7070c60e04" is_pre_election: true
I20260807 04:20:53.143656 26606 raft_consensus.cc:2454] T 6107e4cd76ec444aa563c5023b5f96d1 P 73cf996d83874aa8977d8b7070c60e04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb7cd7d0c9074601af163136b6c093c3 in term 0.
I20260807 04:20:53.145221 26681 raft_consensus.cc:504] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0712311185a43e497f447d8d2aad27d" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 46827 } } peers { permanent_uuid: "cb7cd7d0c9074601af163136b6c093c3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45123 } } peers { permanent_uuid: "73cf996d83874aa8977d8b7070c60e04" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 45737 } }
I20260807 04:20:53.145982 26681 leader_election.cc:288] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3 [CANDIDATE]: Term 1 election: Requested vote from peers b0712311185a43e497f447d8d2aad27d (127.7.200.193:46827), 73cf996d83874aa8977d8b7070c60e04 (127.7.200.195:45737)
I20260807 04:20:53.146559 26327 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6107e4cd76ec444aa563c5023b5f96d1" candidate_uuid: "cb7cd7d0c9074601af163136b6c093c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0712311185a43e497f447d8d2aad27d"
I20260807 04:20:53.146797 26327 raft_consensus.cc:3037] T 6107e4cd76ec444aa563c5023b5f96d1 P b0712311185a43e497f447d8d2aad27d [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:20:53.146947 26606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6107e4cd76ec444aa563c5023b5f96d1" candidate_uuid: "cb7cd7d0c9074601af163136b6c093c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73cf996d83874aa8977d8b7070c60e04"
I20260807 04:20:53.147172 26606 raft_consensus.cc:3037] T 6107e4cd76ec444aa563c5023b5f96d1 P 73cf996d83874aa8977d8b7070c60e04 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:20:53.149511 26327 raft_consensus.cc:2454] T 6107e4cd76ec444aa563c5023b5f96d1 P b0712311185a43e497f447d8d2aad27d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb7cd7d0c9074601af163136b6c093c3 in term 1.
I20260807 04:20:53.149948 26398 leader_election.cc:302] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0712311185a43e497f447d8d2aad27d, cb7cd7d0c9074601af163136b6c093c3; no voters:
I20260807 04:20:53.150040 26606 raft_consensus.cc:2454] T 6107e4cd76ec444aa563c5023b5f96d1 P 73cf996d83874aa8977d8b7070c60e04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb7cd7d0c9074601af163136b6c093c3 in term 1.
I20260807 04:20:53.150295 26681 raft_consensus.cc:2781] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:20:53.150503 26681 raft_consensus.cc:686] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3 [term 1 LEADER]: Becoming Leader. State: Replica: cb7cd7d0c9074601af163136b6c093c3, State: Running, Role: LEADER
I20260807 04:20:53.151026 26681 consensus_queue.cc:237] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0712311185a43e497f447d8d2aad27d" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 46827 } } peers { permanent_uuid: "cb7cd7d0c9074601af163136b6c093c3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45123 } } peers { permanent_uuid: "73cf996d83874aa8977d8b7070c60e04" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 45737 } }
W20260807 04:20:53.151834 26513 tablet.cc:2369] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:20:53.155723 26180 catalog_manager.cc:5495] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb7cd7d0c9074601af163136b6c093c3 (127.7.200.194). New cstate: current_term: 1 leader_uuid: "cb7cd7d0c9074601af163136b6c093c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0712311185a43e497f447d8d2aad27d" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 46827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb7cd7d0c9074601af163136b6c093c3" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 45123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73cf996d83874aa8977d8b7070c60e04" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 45737 } health_report { overall_health: UNKNOWN } } }
I20260807 04:20:53.183514 26670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:53.177133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35736 (local address 127.7.200.194:45123)
0807 04:20:53.177330 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:53.177336 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:53.177416 (+ 80us) server_negotiation.cc:407] Connection header received
0807 04:20:53.177677 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:53.177683 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:53.177803 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:53.177996 (+ 193us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:20:53.178342 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:53.179478 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:53.180960 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:53.181658 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:53.181787 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:53.182234 (+ 447us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:20:53.182920 (+ 686us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:20:53.183084 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:53.183131 (+ 47us) server_negotiation.cc:299] Negotiation successful
0807 04:20:53.183220 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 04:20:53.193403 26606 raft_consensus.cc:1261] T 6107e4cd76ec444aa563c5023b5f96d1 P 73cf996d83874aa8977d8b7070c60e04 [term 1 FOLLOWER]: Refusing update from remote peer cb7cd7d0c9074601af163136b6c093c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:20:53.193403 26327 raft_consensus.cc:1261] T 6107e4cd76ec444aa563c5023b5f96d1 P b0712311185a43e497f447d8d2aad27d [term 1 FOLLOWER]: Refusing update from remote peer cb7cd7d0c9074601af163136b6c093c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:20:53.194450 26681 consensus_queue.cc:1035] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0712311185a43e497f447d8d2aad27d" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 46827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:20:53.194804 26682 consensus_queue.cc:1035] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73cf996d83874aa8977d8b7070c60e04" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 45737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:20:53.208853 26689 mvcc.cc:205] Tried to move back new op lower bound from 7315769152268443648 to 7315769152111394816. Current Snapshot: MvccSnapshot[applied={T|T < 7315769152268443648}]
I20260807 04:20:53.223281 26181 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47946:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:20:53.223580 26181 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47946:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:20:53.227756 26181 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 32a0226080e341038d8823830eff11d9: Sending DeleteTablet for 3 replicas of tablet 6107e4cd76ec444aa563c5023b5f96d1
I20260807 04:20:53.229313 26444 tablet_service.cc:1514] Processing DeleteTablet for tablet 6107e4cd76ec444aa563c5023b5f96d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:20:53 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:35730
I20260807 04:20:53.229444 26585 tablet_service.cc:1514] Processing DeleteTablet for tablet 6107e4cd76ec444aa563c5023b5f96d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:20:53 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:42198
I20260807 04:20:53.229451 26306 tablet_service.cc:1514] Processing DeleteTablet for tablet 6107e4cd76ec444aa563c5023b5f96d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:20:53 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:35878
I20260807 04:20:53.231328 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 26243
I20260807 04:20:53.241878 26697 tablet_replica.cc:330] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3: stopping tablet replica
I20260807 04:20:53.241870 26698 tablet_replica.cc:330] T 6107e4cd76ec444aa563c5023b5f96d1 P 73cf996d83874aa8977d8b7070c60e04: stopping tablet replica
I20260807 04:20:53.242504 26698 raft_consensus.cc:2229] T 6107e4cd76ec444aa563c5023b5f96d1 P 73cf996d83874aa8977d8b7070c60e04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:20:53.243263 26699 tablet_replica.cc:330] T 6107e4cd76ec444aa563c5023b5f96d1 P b0712311185a43e497f447d8d2aad27d: stopping tablet replica
I20260807 04:20:53.243221 26697 raft_consensus.cc:2229] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3 [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:20:53.243876 26699 raft_consensus.cc:2229] T 6107e4cd76ec444aa563c5023b5f96d1 P b0712311185a43e497f447d8d2aad27d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:20:53.243971 26697 raft_consensus.cc:2258] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:20:53.245061 26698 raft_consensus.cc:2258] T 6107e4cd76ec444aa563c5023b5f96d1 P 73cf996d83874aa8977d8b7070c60e04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:20:53.245460 26699 raft_consensus.cc:2258] T 6107e4cd76ec444aa563c5023b5f96d1 P b0712311185a43e497f447d8d2aad27d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:20:53.247083 26697 ts_tablet_manager.cc:1905] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:20:53.247470 26699 ts_tablet_manager.cc:1905] T 6107e4cd76ec444aa563c5023b5f96d1 P b0712311185a43e497f447d8d2aad27d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:20:53.249262 26698 ts_tablet_manager.cc:1905] T 6107e4cd76ec444aa563c5023b5f96d1 P 73cf996d83874aa8977d8b7070c60e04: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:20:53.255335 26697 ts_tablet_manager.cc:1918] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:20:53.255662 26697 log.cc:1196] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-1/wal/wals/6107e4cd76ec444aa563c5023b5f96d1
I20260807 04:20:53.256384 26697 ts_tablet_manager.cc:1939] T 6107e4cd76ec444aa563c5023b5f96d1 P cb7cd7d0c9074601af163136b6c093c3: Deleting consensus metadata
I20260807 04:20:53.256938 26699 ts_tablet_manager.cc:1918] T 6107e4cd76ec444aa563c5023b5f96d1 P b0712311185a43e497f447d8d2aad27d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:20:53.258620 26166 catalog_manager.cc:4841] TS cb7cd7d0c9074601af163136b6c093c3 (127.7.200.194:45123): tablet 6107e4cd76ec444aa563c5023b5f96d1 (table test-table [id=79d574500fb44b55ad66715e0415f21f]) successfully deleted
Aug 07 04:20:53 dist-test-slave-qg60 krb5kdc[26134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076450, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.193@KRBTEST.COM
I20260807 04:20:53.260654 26699 log.cc:1196] T 6107e4cd76ec444aa563c5023b5f96d1 P b0712311185a43e497f447d8d2aad27d: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-0/wal/wals/6107e4cd76ec444aa563c5023b5f96d1
I20260807 04:20:53.261508 26699 ts_tablet_manager.cc:1939] T 6107e4cd76ec444aa563c5023b5f96d1 P b0712311185a43e497f447d8d2aad27d: Deleting consensus metadata
I20260807 04:20:53.263962 26698 ts_tablet_manager.cc:1918] T 6107e4cd76ec444aa563c5023b5f96d1 P 73cf996d83874aa8977d8b7070c60e04: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:20:53.264194 26698 log.cc:1196] T 6107e4cd76ec444aa563c5023b5f96d1 P 73cf996d83874aa8977d8b7070c60e04: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786076137270840-7971-0/minicluster-data/ts-2/wal/wals/6107e4cd76ec444aa563c5023b5f96d1
I20260807 04:20:53.264545 26166 catalog_manager.cc:4841] TS b0712311185a43e497f447d8d2aad27d (127.7.200.193:46827): tablet 6107e4cd76ec444aa563c5023b5f96d1 (table test-table [id=79d574500fb44b55ad66715e0415f21f]) successfully deleted
I20260807 04:20:53.264858 26698 ts_tablet_manager.cc:1939] T 6107e4cd76ec444aa563c5023b5f96d1 P 73cf996d83874aa8977d8b7070c60e04: Deleting consensus metadata
I20260807 04:20:53.266417 26166 catalog_manager.cc:4841] TS 73cf996d83874aa8977d8b7070c60e04 (127.7.200.195:45737): tablet 6107e4cd76ec444aa563c5023b5f96d1 (table test-table [id=79d574500fb44b55ad66715e0415f21f]) successfully deleted
I20260807 04:20:53.268862 26668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:53.234614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35882 (local address 127.7.200.193:46827)
0807 04:20:53.234815 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:53.234823 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:53.247374 (+ 12551us) server_negotiation.cc:407] Connection header received
0807 04:20:53.247906 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:53.247913 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:53.248022 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:53.248103 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:20:53.250158 (+ 2055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:53.251342 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:53.253466 (+ 2124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:53.254208 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:53.254328 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:53.260652 (+ 6324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:20:53.260672 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:20:53.260691 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:20:53.260790 (+ 99us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:20:53.265167 (+ 4377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:53.266161 (+ 994us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:53.266310 (+ 149us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:53.266315 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:53.266515 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:53.267035 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:53.267041 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:53.267044 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:53.267460 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:20:53.267791 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:53.268222 (+ 431us) server_negotiation.cc:299] Negotiation successful
0807 04:20:53.268455 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 04:20:53.269651 26369 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:20:53.373530 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 26243
I20260807 04:20:53.394971 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 26380
Aug 07 04:20:53 dist-test-slave-qg60 krb5kdc[26134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076450, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.194@KRBTEST.COM
I20260807 04:20:53.417002 26670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:53.395902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38666 (local address 127.7.200.194:45123)
0807 04:20:53.396194 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:53.396198 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:53.396217 (+ 19us) server_negotiation.cc:407] Connection header received
0807 04:20:53.396326 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:53.396330 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:53.396397 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:53.396536 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:20:53.398361 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:53.399641 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:53.401834 (+ 2193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:53.402648 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:53.402775 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:53.408606 (+ 5831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:20:53.408621 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:20:53.408639 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:20:53.408690 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:20:53.413428 (+ 4738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:53.414346 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:53.414356 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:53.414360 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:53.414566 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:53.415128 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:53.415133 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:53.415137 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:53.415607 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:20:53.415975 (+ 368us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:53.416291 (+ 316us) server_negotiation.cc:299] Negotiation successful
0807 04:20:53.416553 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169}
I20260807 04:20:53.417760 26507 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:20:53.535588 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 26380
I20260807 04:20:53.557659 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 26518
Aug 07 04:20:53 dist-test-slave-qg60 krb5kdc[26134](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076450, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.195@KRBTEST.COM
I20260807 04:20:53.574048 26672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:53.558538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51472 (local address 127.7.200.195:45737)
0807 04:20:53.558732 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:53.558736 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:53.558757 (+ 21us) server_negotiation.cc:407] Connection header received
0807 04:20:53.558887 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:53.558891 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:53.558964 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:53.559270 (+ 306us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:20:53.560828 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:53.561582 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:53.562931 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:53.563323 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:53.563418 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:53.568153 (+ 4735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:20:53.568168 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:20:53.568183 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:20:53.568217 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:20:53.571199 (+ 2982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:53.571878 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:53.571886 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:53.571888 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:53.572080 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:53.572447 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:53.572450 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:53.572452 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:53.572910 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:20:53.573201 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:53.573540 (+ 339us) server_negotiation.cc:299] Negotiation successful
0807 04:20:53.573726 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 04:20:53.574749 26648 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:20:53.666261 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 26518
I20260807 04:20:53.685993 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 26148
I20260807 04:20:53.687215 26212 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:20:53.800981 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 26148
2026-08-07T04:20:53Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4620 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-07T04:20:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:20:53Z Disabled control of system clock
I20260807 04:20:53.901894 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:46561
--webserver_interface=127.7.200.254
--webserver_port=0
--builtin_ntp_servers=127.7.200.212:33069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:46561
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 04:20:54.258034 26709 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:20:54.258373 26709 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:20:54.258457 26709 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:20:54.266104 26709 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:20:54.266232 26709 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:20:54.266269 26709 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:20:54.266322 26709 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:20:54.266368 26709 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:20:54.276084 26709 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:33069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:46561
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:46561
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:20:54.277496 26709 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:20:54.279353 26709 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:20:54.292245 26714 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:54.292255 26715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:54.292255 26717 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:20:54.293185 26709 server_base.cc:1034] running on GCE node
I20260807 04:20:54.294165 26709 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:20:54.295718 26709 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:20:54.296969 26709 hybrid_clock.cc:648] HybridClock initialized: now 1786076454296916 us; error 57 us; skew 500 ppm
I20260807 04:20:54.297372 26709 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 04:20:54.299757 26709 webserver.cc:460] Webserver started at http://127.7.200.254:35549/ using document root <none> and password file <none>
I20260807 04:20:54.300480 26709 fs_manager.cc:359] Metadata directory not provided
I20260807 04:20:54.300650 26709 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:20:54.301047 26709 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:20:54.304212 26709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "55be7373c3c44d5facd00d5be147263f"
format_stamp: "Formatted at 2026-08-07 04:20:54 on dist-test-slave-qg60"
server_key: "bda45a340c4dfea60c8fade1be14bee6"
server_key_iv: "d967c44f71ba943e24598b562d5e4f6e"
server_key_version: "encryptionkey@0"
I20260807 04:20:54.305171 26709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "55be7373c3c44d5facd00d5be147263f"
format_stamp: "Formatted at 2026-08-07 04:20:54 on dist-test-slave-qg60"
server_key: "bda45a340c4dfea60c8fade1be14bee6"
server_key_iv: "d967c44f71ba943e24598b562d5e4f6e"
server_key_version: "encryptionkey@0"
I20260807 04:20:54.310909 26709 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 04:20:54.315187 26723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:54.316668 26709 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 04:20:54.316954 26709 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "55be7373c3c44d5facd00d5be147263f"
format_stamp: "Formatted at 2026-08-07 04:20:54 on dist-test-slave-qg60"
server_key: "bda45a340c4dfea60c8fade1be14bee6"
server_key_iv: "d967c44f71ba943e24598b562d5e4f6e"
server_key_version: "encryptionkey@0"
I20260807 04:20:54.317281 26709 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:20:54.332219 26709 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:20:54.333207 26709 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:20:54.333462 26709 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:20:54.353318 26709 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:46561
I20260807 04:20:54.353340 26778 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:46561 every 8 connection(s)
I20260807 04:20:54.354892 26709 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:20:54.359243 26779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:20:54.365048 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 26709
I20260807 04:20:54.365262 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:20:54.365800 7971 external_mini_cluster.cc:1428] Setting key 978e701e2667d48c26a587cb943e94cc
I20260807 04:20:54.372097 26779 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55be7373c3c44d5facd00d5be147263f: Bootstrap starting.
I20260807 04:20:54.376482 26779 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 55be7373c3c44d5facd00d5be147263f: Neither blocks nor log segments found. Creating new log.
I20260807 04:20:54.377977 26779 log.cc:824] T 00000000000000000000000000000000 P 55be7373c3c44d5facd00d5be147263f: Log is configured to *not* fsync() on all Append() calls
I20260807 04:20:54.381980 26782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:54.367982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56122 (local address 127.7.200.254:46561)
0807 04:20:54.369198 (+ 1216us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:54.369210 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:54.369253 (+ 43us) server_negotiation.cc:407] Connection header received
0807 04:20:54.371341 (+ 2088us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:54.371365 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:54.371882 (+ 517us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:54.372292 (+ 410us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:20:54.373054 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:54.374426 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:54.376863 (+ 2437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:54.377652 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:54.377817 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:54.379306 (+ 1489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:20:54.379322 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:20:54.379346 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:20:54.380095 (+ 749us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:20:54.380181 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:20:54.380204 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:20:54.380304 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:54.380580 (+ 276us) server_negotiation.cc:299] Negotiation successful
0807 04:20:54.381007 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":746,"thread_start_us":497,"threads_started":1}
I20260807 04:20:54.382220 26779 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55be7373c3c44d5facd00d5be147263f: No bootstrap required, opened a new log
I20260807 04:20:54.390116 26779 raft_consensus.cc:348] T 00000000000000000000000000000000 P 55be7373c3c44d5facd00d5be147263f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55be7373c3c44d5facd00d5be147263f" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 46561 } }
I20260807 04:20:54.390726 26779 raft_consensus.cc:374] T 00000000000000000000000000000000 P 55be7373c3c44d5facd00d5be147263f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:20:54.390936 26779 raft_consensus.cc:729] T 00000000000000000000000000000000 P 55be7373c3c44d5facd00d5be147263f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55be7373c3c44d5facd00d5be147263f, State: Initialized, Role: FOLLOWER
I20260807 04:20:54.391611 26779 consensus_queue.cc:260] T 00000000000000000000000000000000 P 55be7373c3c44d5facd00d5be147263f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55be7373c3c44d5facd00d5be147263f" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 46561 } }
I20260807 04:20:54.391914 26779 raft_consensus.cc:388] T 00000000000000000000000000000000 P 55be7373c3c44d5facd00d5be147263f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:20:54.392148 26779 raft_consensus.cc:482] T 00000000000000000000000000000000 P 55be7373c3c44d5facd00d5be147263f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:20:54.392365 26779 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 55be7373c3c44d5facd00d5be147263f [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:20:54.395100 26779 raft_consensus.cc:504] T 00000000000000000000000000000000 P 55be7373c3c44d5facd00d5be147263f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55be7373c3c44d5facd00d5be147263f" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 46561 } }
I20260807 04:20:54.395715 26779 leader_election.cc:302] T 00000000000000000000000000000000 P 55be7373c3c44d5facd00d5be147263f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 55be7373c3c44d5facd00d5be147263f; no voters:
I20260807 04:20:54.396551 26779 leader_election.cc:288] T 00000000000000000000000000000000 P 55be7373c3c44d5facd00d5be147263f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:20:54.396672 26784 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 55be7373c3c44d5facd00d5be147263f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:20:54.397519 26784 raft_consensus.cc:686] T 00000000000000000000000000000000 P 55be7373c3c44d5facd00d5be147263f [term 1 LEADER]: Becoming Leader. State: Replica: 55be7373c3c44d5facd00d5be147263f, State: Running, Role: LEADER
I20260807 04:20:54.398072 26784 consensus_queue.cc:237] T 00000000000000000000000000000000 P 55be7373c3c44d5facd00d5be147263f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55be7373c3c44d5facd00d5be147263f" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 46561 } }
I20260807 04:20:54.398949 26779 sys_catalog.cc:564] T 00000000000000000000000000000000 P 55be7373c3c44d5facd00d5be147263f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:20:54.401224 26786 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55be7373c3c44d5facd00d5be147263f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 55be7373c3c44d5facd00d5be147263f. Latest consensus state: current_term: 1 leader_uuid: "55be7373c3c44d5facd00d5be147263f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55be7373c3c44d5facd00d5be147263f" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 46561 } } }
I20260807 04:20:54.401813 26786 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55be7373c3c44d5facd00d5be147263f [sys.catalog]: This master's current role is: LEADER
I20260807 04:20:54.402328 26785 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55be7373c3c44d5facd00d5be147263f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "55be7373c3c44d5facd00d5be147263f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55be7373c3c44d5facd00d5be147263f" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 46561 } } }
I20260807 04:20:54.409329 26785 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55be7373c3c44d5facd00d5be147263f [sys.catalog]: This master's current role is: LEADER
I20260807 04:20:54.410755 26793 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:20:54.416508 26793 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:20:54.426193 26793 catalog_manager.cc:1347] Generated new cluster ID: 072f365f700b45baaf456e2656f2558d
I20260807 04:20:54.426321 26793 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:20:54.435920 26793 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:20:54.437985 26793 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:20:54.447994 26793 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 55be7373c3c44d5facd00d5be147263f: Generated new TSK 0
I20260807 04:20:54.449064 26793 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:20:54.453773 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:0
--local_ip_for_outbound_sockets=127.7.200.193
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:46561
--builtin_ntp_servers=127.7.200.212:33069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 04:20:54.827067 26803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:20:54.827440 26803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:20:54.827600 26803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:20:54.835160 26803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:20:54.835321 26803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:20:54.835520 26803 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:20:54.845152 26803 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:33069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:46561
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:20:54.846534 26803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:20:54.848383 26803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:20:54.862479 26812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:54.862447 26809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:54.862425 26810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:20:54.863561 26803 server_base.cc:1034] running on GCE node
I20260807 04:20:54.864190 26803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:20:54.865288 26803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:20:54.866539 26803 hybrid_clock.cc:648] HybridClock initialized: now 1786076454866476 us; error 41 us; skew 500 ppm
I20260807 04:20:54.866914 26803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 04:20:54.869606 26803 webserver.cc:460] Webserver started at http://127.7.200.193:46809/ using document root <none> and password file <none>
I20260807 04:20:54.870339 26803 fs_manager.cc:359] Metadata directory not provided
I20260807 04:20:54.870436 26803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:20:54.870823 26803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:20:54.873894 26803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-0/data/instance:
uuid: "b096ec656d0a44bcae4d879218884632"
format_stamp: "Formatted at 2026-08-07 04:20:54 on dist-test-slave-qg60"
server_key: "69f737499c68392b72e2e7280f0482c1"
server_key_iv: "5c996b4f0f23b2f7c56ad618d9e65a09"
server_key_version: "encryptionkey@0"
I20260807 04:20:54.874754 26803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance:
uuid: "b096ec656d0a44bcae4d879218884632"
format_stamp: "Formatted at 2026-08-07 04:20:54 on dist-test-slave-qg60"
server_key: "69f737499c68392b72e2e7280f0482c1"
server_key_iv: "5c996b4f0f23b2f7c56ad618d9e65a09"
server_key_version: "encryptionkey@0"
I20260807 04:20:54.880195 26803 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 04:20:54.883931 26818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:54.885433 26803 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:20:54.885653 26803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "b096ec656d0a44bcae4d879218884632"
format_stamp: "Formatted at 2026-08-07 04:20:54 on dist-test-slave-qg60"
server_key: "69f737499c68392b72e2e7280f0482c1"
server_key_iv: "5c996b4f0f23b2f7c56ad618d9e65a09"
server_key_version: "encryptionkey@0"
I20260807 04:20:54.885900 26803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:20:54.912820 26803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:20:54.913740 26803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:20:54.914080 26803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:20:54.915225 26803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:20:54.916859 26803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:20:54.916982 26803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:54.917121 26803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:20:54.917219 26803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:54.952654 26803 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:37515
I20260807 04:20:54.952813 26936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:37515 every 8 connection(s)
I20260807 04:20:54.954027 26803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:20:54.960210 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 26803
I20260807 04:20:54.960438 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance
I20260807 04:20:54.961051 7971 external_mini_cluster.cc:1428] Setting key 43dd1d63b642130158c8cd02252ea8eb
I20260807 04:20:54.963994 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:0
--local_ip_for_outbound_sockets=127.7.200.194
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:46561
--builtin_ntp_servers=127.7.200.212:33069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 04:20:54.967808 26939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:54.956645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:43547 (local address 127.7.200.254:46561)
0807 04:20:54.957161 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:54.957166 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:54.958357 (+ 1191us) server_negotiation.cc:407] Connection header received
0807 04:20:54.960258 (+ 1901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:54.960265 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:54.960387 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:54.960521 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:20:54.961851 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:54.962749 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:54.964547 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:54.965273 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:54.965422 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:54.966766 (+ 1344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:20:54.966774 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:20:54.966781 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:20:54.966806 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:20:54.966858 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:20:54.966875 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:20:54.966971 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:54.967208 (+ 237us) server_negotiation.cc:299] Negotiation successful
0807 04:20:54.967319 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":306,"threads_started":1}
I20260807 04:20:54.968534 26940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:54.957218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:46561 (local address 127.7.200.193:43547)
0807 04:20:54.958187 (+ 969us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:54.958231 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 04:20:54.959960 (+ 1729us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:20:54.960829 (+ 869us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:20:54.960838 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:20:54.960936 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:20:54.961614 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:54.961641 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:54.962932 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:54.962937 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:54.964386 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:54.964399 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:54.965491 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:54.965496 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:54.965697 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:54.966426 (+ 729us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 04:20:54.966429 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:20:54.966469 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 04:20:54.966553 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:20:54.966976 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:20:54.966985 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:20:54.966990 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 04:20:54.967158 (+ 168us) client_negotiation.cc:240] Negotiation successful
0807 04:20:54.967453 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":320,"threads_started":1}
I20260807 04:20:54.970177 26937 heartbeater.cc:347] Connected to a master server at 127.7.200.254:46561
I20260807 04:20:54.970479 26937 heartbeater.cc:464] Registering TS with master...
I20260807 04:20:54.971233 26937 heartbeater.cc:511] Master 127.7.200.254:46561 requested a full tablet report, sending...
I20260807 04:20:54.973349 26741 ts_manager.cc:194] Registered new tserver with Master: b096ec656d0a44bcae4d879218884632 (127.7.200.193:37515)
I20260807 04:20:54.974812 26741 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.200.193:43547
W20260807 04:20:55.310830 26942 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:20:55.311112 26942 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:20:55.311255 26942 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:20:55.318684 26942 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:20:55.318787 26942 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:20:55.318974 26942 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:20:55.329258 26942 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:33069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:46561
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:20:55.330673 26942 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:20:55.332846 26942 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:20:55.347575 26947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:55.347618 26950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:55.347698 26948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:20:55.348834 26942 server_base.cc:1034] running on GCE node
I20260807 04:20:55.349556 26942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:20:55.350638 26942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:20:55.351980 26942 hybrid_clock.cc:648] HybridClock initialized: now 1786076455351843 us; error 107 us; skew 500 ppm
I20260807 04:20:55.352448 26942 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 04:20:55.355515 26942 webserver.cc:460] Webserver started at http://127.7.200.194:36509/ using document root <none> and password file <none>
I20260807 04:20:55.356398 26942 fs_manager.cc:359] Metadata directory not provided
I20260807 04:20:55.356518 26942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:20:55.356932 26942 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:20:55.361287 26942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-1/data/instance:
uuid: "332973ac00384033a6da96df5d66ecce"
format_stamp: "Formatted at 2026-08-07 04:20:55 on dist-test-slave-qg60"
server_key: "caa850d311ab9fbd225cc3b6e8e44802"
server_key_iv: "c5990bad601d3cbf3c3cb894b57e2bcd"
server_key_version: "encryptionkey@0"
I20260807 04:20:55.362460 26942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance:
uuid: "332973ac00384033a6da96df5d66ecce"
format_stamp: "Formatted at 2026-08-07 04:20:55 on dist-test-slave-qg60"
server_key: "caa850d311ab9fbd225cc3b6e8e44802"
server_key_iv: "c5990bad601d3cbf3c3cb894b57e2bcd"
server_key_version: "encryptionkey@0"
I20260807 04:20:55.369834 26942 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260807 04:20:55.374722 26957 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:55.376505 26942 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 04:20:55.376704 26942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "332973ac00384033a6da96df5d66ecce"
format_stamp: "Formatted at 2026-08-07 04:20:55 on dist-test-slave-qg60"
server_key: "caa850d311ab9fbd225cc3b6e8e44802"
server_key_iv: "c5990bad601d3cbf3c3cb894b57e2bcd"
server_key_version: "encryptionkey@0"
I20260807 04:20:55.377019 26942 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:20:55.398698 26942 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:20:55.399551 26942 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:20:55.399904 26942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:20:55.400998 26942 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:20:55.402629 26942 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:20:55.402755 26942 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:55.402946 26942 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:20:55.403051 26942 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:55.440954 26942 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:46787
I20260807 04:20:55.441000 27076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:46787 every 8 connection(s)
I20260807 04:20:55.442356 26942 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:20:55.448704 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 26942
I20260807 04:20:55.448940 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance
I20260807 04:20:55.449525 7971 external_mini_cluster.cc:1428] Setting key e0827af93b81b5970876e99cc2ce6228
I20260807 04:20:55.452960 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:0
--local_ip_for_outbound_sockets=127.7.200.195
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:46561
--builtin_ntp_servers=127.7.200.212:33069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 04:20:55.457044 26939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:55.445052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:42815 (local address 127.7.200.254:46561)
0807 04:20:55.445240 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:55.445250 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:55.446817 (+ 1567us) server_negotiation.cc:407] Connection header received
0807 04:20:55.448911 (+ 2094us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:55.448925 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:55.449044 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:55.449148 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:20:55.450489 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:55.451544 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:55.453945 (+ 2401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:55.454376 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:55.454490 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:55.456144 (+ 1654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:20:55.456149 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:20:55.456152 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:20:55.456170 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:20:55.456201 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:20:55.456213 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:20:55.456290 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:55.456542 (+ 252us) server_negotiation.cc:299] Negotiation successful
0807 04:20:55.456618 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 04:20:55.458346 27079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:55.445765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:46561 (local address 127.7.200.194:42815)
0807 04:20:55.446653 (+ 888us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:55.446695 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 04:20:55.448505 (+ 1810us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:20:55.449411 (+ 906us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:20:55.449423 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:20:55.449534 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:20:55.450311 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:55.450331 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:55.451720 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:55.451725 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:55.453782 (+ 2057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:55.453801 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:55.454624 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:55.454634 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:55.454972 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:55.455785 (+ 813us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 04:20:55.455791 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:20:55.455841 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 04:20:55.455942 (+ 101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:20:55.456317 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:20:55.456330 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:20:55.456340 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 04:20:55.456522 (+ 182us) client_negotiation.cc:240] Negotiation successful
0807 04:20:55.456991 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":298,"threads_started":1}
I20260807 04:20:55.459832 27077 heartbeater.cc:347] Connected to a master server at 127.7.200.254:46561
I20260807 04:20:55.460170 27077 heartbeater.cc:464] Registering TS with master...
I20260807 04:20:55.461019 27077 heartbeater.cc:511] Master 127.7.200.254:46561 requested a full tablet report, sending...
I20260807 04:20:55.462459 26741 ts_manager.cc:194] Registered new tserver with Master: 332973ac00384033a6da96df5d66ecce (127.7.200.194:46787)
I20260807 04:20:55.463275 26741 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.200.194:42815
W20260807 04:20:55.801023 27080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:20:55.801307 27080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:20:55.801470 27080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:20:55.809046 27080 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:20:55.809162 27080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:20:55.809352 27080 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:20:55.819012 27080 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:33069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:46561
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:20:55.820406 27080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:20:55.822598 27080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:20:55.837308 27085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:55.837276 27086 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:55.837522 27088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:20:55.838332 27080 server_base.cc:1034] running on GCE node
I20260807 04:20:55.839087 27080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:20:55.840109 27080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:20:55.841377 27080 hybrid_clock.cc:648] HybridClock initialized: now 1786076455841305 us; error 53 us; skew 500 ppm
I20260807 04:20:55.841719 27080 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 04:20:55.844017 27080 webserver.cc:460] Webserver started at http://127.7.200.195:36347/ using document root <none> and password file <none>
I20260807 04:20:55.844786 27080 fs_manager.cc:359] Metadata directory not provided
I20260807 04:20:55.844929 27080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:20:55.845283 27080 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:20:55.848213 27080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-2/data/instance:
uuid: "f79e2f1da76b4471b5e75e4aedc996ff"
format_stamp: "Formatted at 2026-08-07 04:20:55 on dist-test-slave-qg60"
server_key: "5e18c1f9b84c5a8296db5f1c31caa5f0"
server_key_iv: "22e8c9208cb827b410e01d1527beeb34"
server_key_version: "encryptionkey@0"
I20260807 04:20:55.849109 27080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance:
uuid: "f79e2f1da76b4471b5e75e4aedc996ff"
format_stamp: "Formatted at 2026-08-07 04:20:55 on dist-test-slave-qg60"
server_key: "5e18c1f9b84c5a8296db5f1c31caa5f0"
server_key_iv: "22e8c9208cb827b410e01d1527beeb34"
server_key_version: "encryptionkey@0"
I20260807 04:20:55.854368 27080 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 04:20:55.858083 27094 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:55.859474 27080 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260807 04:20:55.859658 27080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "f79e2f1da76b4471b5e75e4aedc996ff"
format_stamp: "Formatted at 2026-08-07 04:20:55 on dist-test-slave-qg60"
server_key: "5e18c1f9b84c5a8296db5f1c31caa5f0"
server_key_iv: "22e8c9208cb827b410e01d1527beeb34"
server_key_version: "encryptionkey@0"
I20260807 04:20:55.859894 27080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:20:55.877156 27080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:20:55.878120 27080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:20:55.878485 27080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:20:55.879560 27080 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:20:55.881283 27080 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:20:55.881421 27080 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:55.881582 27080 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:20:55.881697 27080 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:55.917200 27080 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:45261
I20260807 04:20:55.917260 27213 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:45261 every 8 connection(s)
I20260807 04:20:55.918690 27080 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:20:55.926959 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 27080
I20260807 04:20:55.927145 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance
I20260807 04:20:55.927702 7971 external_mini_cluster.cc:1428] Setting key 7432ebd3926670a8bcf175361be08fda
I20260807 04:20:55.932554 26939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:55.921555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:49467 (local address 127.7.200.254:46561)
0807 04:20:55.921785 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:55.921792 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:55.923311 (+ 1519us) server_negotiation.cc:407] Connection header received
0807 04:20:55.925254 (+ 1943us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:55.925258 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:55.925329 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:55.925425 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:20:55.926461 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:55.927664 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:55.929701 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:55.930219 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:55.930319 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:55.931855 (+ 1536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:20:55.931860 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:20:55.931863 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:20:55.931880 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:20:55.931913 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:20:55.931925 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:20:55.932013 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:55.932230 (+ 217us) server_negotiation.cc:299] Negotiation successful
0807 04:20:55.932306 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 04:20:55.933594 27216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:55.922204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:46561 (local address 127.7.200.195:49467)
0807 04:20:55.923164 (+ 960us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:55.923199 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 04:20:55.924911 (+ 1712us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:20:55.925611 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:20:55.925619 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:20:55.925698 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:20:55.926301 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:55.926317 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:55.927859 (+ 1542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:55.927868 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:55.929531 (+ 1663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:55.929547 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:55.930455 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:55.930463 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:55.930812 (+ 349us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:55.931535 (+ 723us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 04:20:55.931538 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:20:55.931578 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 04:20:55.931661 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:20:55.932017 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:20:55.932025 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:20:55.932031 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 04:20:55.932199 (+ 168us) client_negotiation.cc:240] Negotiation successful
0807 04:20:55.932492 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":294,"threads_started":1}
I20260807 04:20:55.934937 27214 heartbeater.cc:347] Connected to a master server at 127.7.200.254:46561
I20260807 04:20:55.935242 27214 heartbeater.cc:464] Registering TS with master...
I20260807 04:20:55.935987 27214 heartbeater.cc:511] Master 127.7.200.254:46561 requested a full tablet report, sending...
I20260807 04:20:55.937426 26741 ts_manager.cc:194] Registered new tserver with Master: f79e2f1da76b4471b5e75e4aedc996ff (127.7.200.195:45261)
I20260807 04:20:55.938174 26741 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.200.195:49467
I20260807 04:20:55.943342 7971 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 04:20:55.954157 26939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:55.947823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56130 (local address 127.7.200.254:46561)
0807 04:20:55.948046 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:55.948051 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:55.948495 (+ 444us) server_negotiation.cc:407] Connection header received
0807 04:20:55.948680 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:55.948684 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:55.948814 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:55.948915 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:20:55.949443 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:55.950160 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:55.951579 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:55.951990 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:55.952092 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:55.953395 (+ 1303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:20:55.953400 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:20:55.953403 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:20:55.953421 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:20:55.953453 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:20:55.953464 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:20:55.953535 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:55.953721 (+ 186us) server_negotiation.cc:299] Negotiation successful
0807 04:20:55.953799 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 04:20:55.958349 26741 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56130:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:20:55.965376 26741 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:20:55.978391 26937 heartbeater.cc:503] Master 127.7.200.254:46561 was elected leader, sending a full tablet report...
I20260807 04:20:56.006582 27230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:55.978916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50288 (local address 127.7.200.193:37515)
0807 04:20:55.994561 (+ 15645us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:55.994588 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:55.996040 (+ 1452us) server_negotiation.cc:407] Connection header received
0807 04:20:55.996416 (+ 376us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:55.996426 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:55.996842 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:55.997105 (+ 263us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:20:55.998475 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.000142 (+ 1667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.003104 (+ 2962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.004766 (+ 1662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.004896 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:56.005204 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:56.005992 (+ 788us) server_negotiation.cc:299] Negotiation successful
0807 04:20:56.006191 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15385,"thread_start_us":15207,"threads_started":1}
I20260807 04:20:56.006589 27226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:55.977896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:46787 (local address 127.0.0.1:44472)
0807 04:20:55.991086 (+ 13190us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:55.991162 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0807 04:20:55.991440 (+ 278us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:20:55.999107 (+ 7667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:20:55.999111 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:20:55.999139 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:20:55.999589 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:55.999602 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.001589 (+ 1987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.001595 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:56.003630 (+ 2035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:56.003642 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.005412 (+ 1770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.005419 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:56.005704 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:56.005772 (+ 68us) client_negotiation.cc:769] Sending connection context
0807 04:20:56.005925 (+ 153us) client_negotiation.cc:240] Negotiation successful
0807 04:20:56.006153 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12745,"mutex_wait_us":68,"thread_start_us":13835,"threads_started":1}
I20260807 04:20:56.006763 27228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:55.978340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:45261 (local address 127.0.0.1:60422)
0807 04:20:55.998081 (+ 19741us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:55.998106 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 04:20:55.998332 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:20:55.999385 (+ 1053us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:20:55.999389 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:20:55.999418 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:20:56.000140 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:56.000155 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.001995 (+ 1840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.002001 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:56.003997 (+ 1996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:56.004021 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.005977 (+ 1956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.005983 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:56.006163 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:56.006195 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 04:20:56.006287 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 04:20:56.006401 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19560,"mutex_wait_us":48,"thread_start_us":17166,"threads_started":1}
I20260807 04:20:56.006913 27231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:55.978912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60422 (local address 127.7.200.195:45261)
0807 04:20:55.995280 (+ 16368us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:55.995300 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:55.998214 (+ 2914us) server_negotiation.cc:407] Connection header received
0807 04:20:55.998637 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:55.998645 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:55.998887 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:55.999100 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:20:56.000387 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.001848 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.004244 (+ 2396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.005749 (+ 1505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.005895 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:56.006179 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:56.006328 (+ 149us) server_negotiation.cc:299] Negotiation successful
0807 04:20:56.006497 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16138,"thread_start_us":15936,"threads_started":1}
I20260807 04:20:56.007639 27227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:55.978061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44472 (local address 127.7.200.194:46787)
0807 04:20:55.998399 (+ 20338us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:55.998408 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:55.998438 (+ 30us) server_negotiation.cc:407] Connection header received
0807 04:20:55.998612 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:55.998645 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:55.998887 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:55.999100 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:20:55.999779 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.001419 (+ 1640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.003836 (+ 2417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.005171 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.005576 (+ 405us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:56.005829 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:56.007129 (+ 1300us) server_negotiation.cc:299] Negotiation successful
0807 04:20:56.007328 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20131,"thread_start_us":20002,"threads_started":1}
I20260807 04:20:56.007794 27229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:55.978209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37515 (local address 127.0.0.1:50288)
0807 04:20:55.995895 (+ 17686us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:55.995926 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0807 04:20:55.996185 (+ 259us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:20:55.997716 (+ 1531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:20:55.997724 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:20:55.997761 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:20:55.998243 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:55.998258 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.000303 (+ 2045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.000308 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:56.002870 (+ 2562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:56.002887 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.005348 (+ 2461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.005354 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:56.005699 (+ 345us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:56.005764 (+ 65us) client_negotiation.cc:769] Sending connection context
0807 04:20:56.007335 (+ 1571us) client_negotiation.cc:240] Negotiation successful
0807 04:20:56.007472 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17479,"mutex_wait_us":92,"thread_start_us":19474,"threads_started":1}
I20260807 04:20:56.011327 27007 tablet_service.cc:1467] Processing CreateTablet for tablet 05180538ab984e198f2c33bc8b6edd15 (DEFAULT_TABLE table=test-table [id=6e84f0cffbf249cc97d5c3a409d9bdc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:20:56.011317 27143 tablet_service.cc:1467] Processing CreateTablet for tablet 05180538ab984e198f2c33bc8b6edd15 (DEFAULT_TABLE table=test-table [id=6e84f0cffbf249cc97d5c3a409d9bdc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:20:56.012639 27143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05180538ab984e198f2c33bc8b6edd15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:20:56.012642 27007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05180538ab984e198f2c33bc8b6edd15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:20:56.019264 26867 tablet_service.cc:1467] Processing CreateTablet for tablet 05180538ab984e198f2c33bc8b6edd15 (DEFAULT_TABLE table=test-table [id=6e84f0cffbf249cc97d5c3a409d9bdc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:20:56.020593 26867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05180538ab984e198f2c33bc8b6edd15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:20:56.026098 27232 tablet_bootstrap.cc:492] T 05180538ab984e198f2c33bc8b6edd15 P f79e2f1da76b4471b5e75e4aedc996ff: Bootstrap starting.
I20260807 04:20:56.029744 27233 tablet_bootstrap.cc:492] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce: Bootstrap starting.
I20260807 04:20:56.030149 27232 tablet_bootstrap.cc:654] T 05180538ab984e198f2c33bc8b6edd15 P f79e2f1da76b4471b5e75e4aedc996ff: Neither blocks nor log segments found. Creating new log.
I20260807 04:20:56.031633 27232 log.cc:824] T 05180538ab984e198f2c33bc8b6edd15 P f79e2f1da76b4471b5e75e4aedc996ff: Log is configured to *not* fsync() on all Append() calls
I20260807 04:20:56.033674 27233 tablet_bootstrap.cc:654] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce: Neither blocks nor log segments found. Creating new log.
I20260807 04:20:56.034868 27233 log.cc:824] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce: Log is configured to *not* fsync() on all Append() calls
I20260807 04:20:56.035812 27235 tablet_bootstrap.cc:492] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632: Bootstrap starting.
I20260807 04:20:56.036499 27232 tablet_bootstrap.cc:492] T 05180538ab984e198f2c33bc8b6edd15 P f79e2f1da76b4471b5e75e4aedc996ff: No bootstrap required, opened a new log
I20260807 04:20:56.036849 27232 ts_tablet_manager.cc:1397] T 05180538ab984e198f2c33bc8b6edd15 P f79e2f1da76b4471b5e75e4aedc996ff: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260807 04:20:56.039299 27233 tablet_bootstrap.cc:492] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce: No bootstrap required, opened a new log
I20260807 04:20:56.039600 27233 ts_tablet_manager.cc:1397] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260807 04:20:56.039728 27235 tablet_bootstrap.cc:654] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632: Neither blocks nor log segments found. Creating new log.
I20260807 04:20:56.041059 27235 log.cc:824] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632: Log is configured to *not* fsync() on all Append() calls
I20260807 04:20:56.044287 27235 tablet_bootstrap.cc:492] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632: No bootstrap required, opened a new log
I20260807 04:20:56.044595 27235 ts_tablet_manager.cc:1397] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260807 04:20:56.045742 27232 raft_consensus.cc:348] T 05180538ab984e198f2c33bc8b6edd15 P f79e2f1da76b4471b5e75e4aedc996ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "332973ac00384033a6da96df5d66ecce" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 46787 } } peers { permanent_uuid: "b096ec656d0a44bcae4d879218884632" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37515 } } peers { permanent_uuid: "f79e2f1da76b4471b5e75e4aedc996ff" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 45261 } }
I20260807 04:20:56.046133 27232 raft_consensus.cc:374] T 05180538ab984e198f2c33bc8b6edd15 P f79e2f1da76b4471b5e75e4aedc996ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:20:56.046233 27232 raft_consensus.cc:729] T 05180538ab984e198f2c33bc8b6edd15 P f79e2f1da76b4471b5e75e4aedc996ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f79e2f1da76b4471b5e75e4aedc996ff, State: Initialized, Role: FOLLOWER
I20260807 04:20:56.046877 27232 consensus_queue.cc:260] T 05180538ab984e198f2c33bc8b6edd15 P f79e2f1da76b4471b5e75e4aedc996ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "332973ac00384033a6da96df5d66ecce" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 46787 } } peers { permanent_uuid: "b096ec656d0a44bcae4d879218884632" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37515 } } peers { permanent_uuid: "f79e2f1da76b4471b5e75e4aedc996ff" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 45261 } }
I20260807 04:20:56.048061 27214 heartbeater.cc:503] Master 127.7.200.254:46561 was elected leader, sending a full tablet report...
I20260807 04:20:56.048594 27232 ts_tablet_manager.cc:1428] T 05180538ab984e198f2c33bc8b6edd15 P f79e2f1da76b4471b5e75e4aedc996ff: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260807 04:20:56.050209 27233 raft_consensus.cc:348] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "332973ac00384033a6da96df5d66ecce" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 46787 } } peers { permanent_uuid: "b096ec656d0a44bcae4d879218884632" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37515 } } peers { permanent_uuid: "f79e2f1da76b4471b5e75e4aedc996ff" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 45261 } }
I20260807 04:20:56.050611 27233 raft_consensus.cc:374] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:20:56.050742 27233 raft_consensus.cc:729] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 332973ac00384033a6da96df5d66ecce, State: Initialized, Role: FOLLOWER
I20260807 04:20:56.051401 27233 consensus_queue.cc:260] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "332973ac00384033a6da96df5d66ecce" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 46787 } } peers { permanent_uuid: "b096ec656d0a44bcae4d879218884632" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37515 } } peers { permanent_uuid: "f79e2f1da76b4471b5e75e4aedc996ff" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 45261 } }
I20260807 04:20:56.052589 27077 heartbeater.cc:503] Master 127.7.200.254:46561 was elected leader, sending a full tablet report...
I20260807 04:20:56.053390 27233 ts_tablet_manager.cc:1428] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce: Time spent starting tablet: real 0.014s user 0.002s sys 0.013s
I20260807 04:20:56.055615 27235 raft_consensus.cc:348] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "332973ac00384033a6da96df5d66ecce" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 46787 } } peers { permanent_uuid: "b096ec656d0a44bcae4d879218884632" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37515 } } peers { permanent_uuid: "f79e2f1da76b4471b5e75e4aedc996ff" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 45261 } }
I20260807 04:20:56.056015 27235 raft_consensus.cc:374] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:20:56.056141 27235 raft_consensus.cc:729] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b096ec656d0a44bcae4d879218884632, State: Initialized, Role: FOLLOWER
I20260807 04:20:56.056912 27235 consensus_queue.cc:260] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "332973ac00384033a6da96df5d66ecce" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 46787 } } peers { permanent_uuid: "b096ec656d0a44bcae4d879218884632" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37515 } } peers { permanent_uuid: "f79e2f1da76b4471b5e75e4aedc996ff" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 45261 } }
I20260807 04:20:56.058873 27235 ts_tablet_manager.cc:1428] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
W20260807 04:20:56.170683 27215 tablet.cc:2369] T 05180538ab984e198f2c33bc8b6edd15 P f79e2f1da76b4471b5e75e4aedc996ff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:20:56.172402 27240 raft_consensus.cc:482] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:20:56.172765 27240 raft_consensus.cc:504] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "332973ac00384033a6da96df5d66ecce" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 46787 } } peers { permanent_uuid: "b096ec656d0a44bcae4d879218884632" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37515 } } peers { permanent_uuid: "f79e2f1da76b4471b5e75e4aedc996ff" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 45261 } }
I20260807 04:20:56.174650 27240 leader_election.cc:288] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 332973ac00384033a6da96df5d66ecce (127.7.200.194:46787), f79e2f1da76b4471b5e75e4aedc996ff (127.7.200.195:45261)
I20260807 04:20:56.175987 27239 raft_consensus.cc:482] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:20:56.176344 27239 raft_consensus.cc:504] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "332973ac00384033a6da96df5d66ecce" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 46787 } } peers { permanent_uuid: "b096ec656d0a44bcae4d879218884632" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37515 } } peers { permanent_uuid: "f79e2f1da76b4471b5e75e4aedc996ff" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 45261 } }
I20260807 04:20:56.179598 27239 leader_election.cc:288] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b096ec656d0a44bcae4d879218884632 (127.7.200.193:37515), f79e2f1da76b4471b5e75e4aedc996ff (127.7.200.195:45261)
I20260807 04:20:56.183534 27231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:56.175225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:42813 (local address 127.7.200.195:45261)
0807 04:20:56.175402 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:56.175407 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:56.176345 (+ 938us) server_negotiation.cc:407] Connection header received
0807 04:20:56.176699 (+ 354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:56.176705 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:56.176821 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:56.176922 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:20:56.177466 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.178323 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.181085 (+ 2762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.182377 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.182508 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:56.182584 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:56.183135 (+ 551us) server_negotiation.cc:299] Negotiation successful
0807 04:20:56.183280 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 04:20:56.184425 27241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:56.175088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:45261 (local address 127.7.200.193:42813)
0807 04:20:56.176211 (+ 1123us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:56.176230 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 04:20:56.176489 (+ 259us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:20:56.176962 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:20:56.176967 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:20:56.176994 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:20:56.177308 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:56.177318 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.178496 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.178502 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:56.180865 (+ 2363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:56.180881 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.182760 (+ 1879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.182767 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:56.182934 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:56.182974 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 04:20:56.183899 (+ 925us) client_negotiation.cc:240] Negotiation successful
0807 04:20:56.184047 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":921,"mutex_wait_us":1,"thread_start_us":698,"threads_started":1}
I20260807 04:20:56.184777 27227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:56.175196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:41901 (local address 127.7.200.194:46787)
0807 04:20:56.175420 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:56.175424 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:56.176797 (+ 1373us) server_negotiation.cc:407] Connection header received
0807 04:20:56.177090 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:56.177095 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:56.177194 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:56.177260 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:20:56.178098 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.179254 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.182122 (+ 2868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.183392 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.183511 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:56.183591 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:56.184317 (+ 726us) server_negotiation.cc:299] Negotiation successful
0807 04:20:56.184470 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260807 04:20:56.185659 27242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:56.175857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:46787 (local address 127.7.200.193:41901)
0807 04:20:56.176663 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:56.176684 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 04:20:56.176912 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:20:56.177486 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:20:56.177493 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:20:56.177524 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:20:56.177890 (+ 366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:56.177904 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.179429 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.179438 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:56.181895 (+ 2457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:56.181912 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.183946 (+ 2034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.183953 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:56.184127 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:56.184158 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 04:20:56.185138 (+ 980us) client_negotiation.cc:240] Negotiation successful
0807 04:20:56.185305 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"mutex_wait_us":268,"thread_start_us":429,"threads_started":1}
I20260807 04:20:56.185690 27165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05180538ab984e198f2c33bc8b6edd15" candidate_uuid: "b096ec656d0a44bcae4d879218884632" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79e2f1da76b4471b5e75e4aedc996ff" is_pre_election: true
I20260807 04:20:56.186465 27165 raft_consensus.cc:2454] T 05180538ab984e198f2c33bc8b6edd15 P f79e2f1da76b4471b5e75e4aedc996ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b096ec656d0a44bcae4d879218884632 in term 0.
I20260807 04:20:56.187469 26820 leader_election.cc:302] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b096ec656d0a44bcae4d879218884632, f79e2f1da76b4471b5e75e4aedc996ff; no voters:
I20260807 04:20:56.188256 27240 raft_consensus.cc:2781] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:20:56.188431 27240 raft_consensus.cc:482] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:20:56.188570 27240 raft_consensus.cc:3037] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:20:56.190637 27030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05180538ab984e198f2c33bc8b6edd15" candidate_uuid: "b096ec656d0a44bcae4d879218884632" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "332973ac00384033a6da96df5d66ecce" is_pre_election: true
I20260807 04:20:56.191293 27030 raft_consensus.cc:2454] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b096ec656d0a44bcae4d879218884632 in term 0.
I20260807 04:20:56.194281 27231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:56.179283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:37473 (local address 127.7.200.195:45261)
0807 04:20:56.183794 (+ 4511us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:56.183802 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:56.186467 (+ 2665us) server_negotiation.cc:407] Connection header received
0807 04:20:56.186728 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:56.186733 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:56.186805 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:56.186874 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:20:56.187730 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.188851 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.191872 (+ 3021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.193248 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.193418 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:56.193490 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:56.193848 (+ 358us) server_negotiation.cc:299] Negotiation successful
0807 04:20:56.193988 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4413,"thread_start_us":13832,"threads_started":1}
I20260807 04:20:56.194489 27230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:56.179061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:36029 (local address 127.7.200.193:37515)
0807 04:20:56.179708 (+ 647us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:56.179716 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:56.185760 (+ 6044us) server_negotiation.cc:407] Connection header received
0807 04:20:56.186358 (+ 598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:56.186364 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:56.186464 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:56.186525 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:20:56.187445 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.188562 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.192144 (+ 3582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.193584 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.193782 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:56.193847 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:56.194139 (+ 292us) server_negotiation.cc:299] Negotiation successful
0807 04:20:56.194261 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":446}
W20260807 04:20:56.194595 27078 tablet.cc:2369] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:20:56.195082 27244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:56.178706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:45261 (local address 127.7.200.194:37473)
0807 04:20:56.186384 (+ 7678us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:56.186401 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 04:20:56.186557 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:20:56.187059 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:20:56.187069 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:20:56.187095 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:20:56.187526 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:56.187550 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.189085 (+ 1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.189091 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:56.191642 (+ 2551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:56.191658 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.193442 (+ 1784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.193448 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:56.193640 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:56.193673 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 04:20:56.194495 (+ 822us) client_negotiation.cc:240] Negotiation successful
0807 04:20:56.194655 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7563,"mutex_wait_us":43,"thread_start_us":10799,"threads_started":1}
I20260807 04:20:56.195091 27240 raft_consensus.cc:504] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "332973ac00384033a6da96df5d66ecce" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 46787 } } peers { permanent_uuid: "b096ec656d0a44bcae4d879218884632" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37515 } } peers { permanent_uuid: "f79e2f1da76b4471b5e75e4aedc996ff" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 45261 } }
I20260807 04:20:56.195627 27243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:56.178665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37515 (local address 127.7.200.194:36029)
0807 04:20:56.185652 (+ 6987us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:56.185684 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0807 04:20:56.186174 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:20:56.186792 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:20:56.186797 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:20:56.186821 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:20:56.187246 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:56.187263 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.188870 (+ 1607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.188877 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:56.191934 (+ 3057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:56.191947 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.193783 (+ 1836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.193790 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:56.193966 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:56.193989 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 04:20:56.194104 (+ 115us) client_negotiation.cc:240] Negotiation successful
0807 04:20:56.194238 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6831,"mutex_wait_us":590,"thread_start_us":6672,"threads_started":1}
I20260807 04:20:56.196110 27240 leader_election.cc:288] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632 [CANDIDATE]: Term 1 election: Requested vote from peers 332973ac00384033a6da96df5d66ecce (127.7.200.194:46787), f79e2f1da76b4471b5e75e4aedc996ff (127.7.200.195:45261)
I20260807 04:20:56.196123 27165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05180538ab984e198f2c33bc8b6edd15" candidate_uuid: "332973ac00384033a6da96df5d66ecce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79e2f1da76b4471b5e75e4aedc996ff" is_pre_election: true
I20260807 04:20:56.196401 27165 raft_consensus.cc:2454] T 05180538ab984e198f2c33bc8b6edd15 P f79e2f1da76b4471b5e75e4aedc996ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 332973ac00384033a6da96df5d66ecce in term 0.
I20260807 04:20:56.196439 27164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05180538ab984e198f2c33bc8b6edd15" candidate_uuid: "b096ec656d0a44bcae4d879218884632" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79e2f1da76b4471b5e75e4aedc996ff"
I20260807 04:20:56.196805 27164 raft_consensus.cc:3037] T 05180538ab984e198f2c33bc8b6edd15 P f79e2f1da76b4471b5e75e4aedc996ff [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:20:56.196687 26889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05180538ab984e198f2c33bc8b6edd15" candidate_uuid: "332973ac00384033a6da96df5d66ecce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b096ec656d0a44bcae4d879218884632" is_pre_election: true
I20260807 04:20:56.197206 26889 raft_consensus.cc:2379] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 332973ac00384033a6da96df5d66ecce in current term 1: Already voted for candidate b096ec656d0a44bcae4d879218884632 in this term.
I20260807 04:20:56.197081 26959 leader_election.cc:302] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 332973ac00384033a6da96df5d66ecce, f79e2f1da76b4471b5e75e4aedc996ff; no voters:
I20260807 04:20:56.197557 27239 raft_consensus.cc:2781] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:20:56.197727 27239 raft_consensus.cc:482] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:20:56.197898 27239 raft_consensus.cc:3037] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:20:56.198055 27030 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05180538ab984e198f2c33bc8b6edd15" candidate_uuid: "b096ec656d0a44bcae4d879218884632" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "332973ac00384033a6da96df5d66ecce"
I20260807 04:20:56.199874 27164 raft_consensus.cc:2454] T 05180538ab984e198f2c33bc8b6edd15 P f79e2f1da76b4471b5e75e4aedc996ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b096ec656d0a44bcae4d879218884632 in term 1.
I20260807 04:20:56.200323 26820 leader_election.cc:302] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b096ec656d0a44bcae4d879218884632, f79e2f1da76b4471b5e75e4aedc996ff; no voters:
I20260807 04:20:56.200628 27240 raft_consensus.cc:2781] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:20:56.200539 27239 raft_consensus.cc:504] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "332973ac00384033a6da96df5d66ecce" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 46787 } } peers { permanent_uuid: "b096ec656d0a44bcae4d879218884632" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37515 } } peers { permanent_uuid: "f79e2f1da76b4471b5e75e4aedc996ff" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 45261 } }
I20260807 04:20:56.201004 27030 raft_consensus.cc:2379] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b096ec656d0a44bcae4d879218884632 in current term 1: Already voted for candidate 332973ac00384033a6da96df5d66ecce in this term.
I20260807 04:20:56.201257 27240 raft_consensus.cc:686] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632 [term 1 LEADER]: Becoming Leader. State: Replica: b096ec656d0a44bcae4d879218884632, State: Running, Role: LEADER
I20260807 04:20:56.201399 27239 leader_election.cc:288] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce [CANDIDATE]: Term 1 election: Requested vote from peers b096ec656d0a44bcae4d879218884632 (127.7.200.193:37515), f79e2f1da76b4471b5e75e4aedc996ff (127.7.200.195:45261)
I20260807 04:20:56.201862 26889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05180538ab984e198f2c33bc8b6edd15" candidate_uuid: "332973ac00384033a6da96df5d66ecce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b096ec656d0a44bcae4d879218884632"
I20260807 04:20:56.201979 27240 consensus_queue.cc:237] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "332973ac00384033a6da96df5d66ecce" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 46787 } } peers { permanent_uuid: "b096ec656d0a44bcae4d879218884632" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37515 } } peers { permanent_uuid: "f79e2f1da76b4471b5e75e4aedc996ff" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 45261 } }
I20260807 04:20:56.202514 27164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05180538ab984e198f2c33bc8b6edd15" candidate_uuid: "332973ac00384033a6da96df5d66ecce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f79e2f1da76b4471b5e75e4aedc996ff"
I20260807 04:20:56.202816 27164 raft_consensus.cc:2379] T 05180538ab984e198f2c33bc8b6edd15 P f79e2f1da76b4471b5e75e4aedc996ff [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 332973ac00384033a6da96df5d66ecce in current term 1: Already voted for candidate b096ec656d0a44bcae4d879218884632 in this term.
I20260807 04:20:56.203516 26959 leader_election.cc:302] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 332973ac00384033a6da96df5d66ecce; no voters: b096ec656d0a44bcae4d879218884632, f79e2f1da76b4471b5e75e4aedc996ff
I20260807 04:20:56.203856 27239 raft_consensus.cc:2726] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260807 04:20:56.206619 26938 tablet.cc:2369] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:20:56.207558 26740 catalog_manager.cc:5495] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632 reported cstate change: term changed from 0 to 1, leader changed from <none> to b096ec656d0a44bcae4d879218884632 (127.7.200.193). New cstate: current_term: 1 leader_uuid: "b096ec656d0a44bcae4d879218884632" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "332973ac00384033a6da96df5d66ecce" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 46787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b096ec656d0a44bcae4d879218884632" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f79e2f1da76b4471b5e75e4aedc996ff" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 45261 } health_report { overall_health: UNKNOWN } } }
I20260807 04:20:56.246757 27230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:56.240926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50298 (local address 127.7.200.193:37515)
0807 04:20:56.241140 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:56.241147 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:56.241168 (+ 21us) server_negotiation.cc:407] Connection header received
0807 04:20:56.241313 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:56.241318 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:56.241407 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:56.241584 (+ 177us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:20:56.241997 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.242798 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.244211 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.244828 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.244972 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:56.245523 (+ 551us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:20:56.246105 (+ 582us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:20:56.246278 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:56.246364 (+ 86us) server_negotiation.cc:299] Negotiation successful
0807 04:20:56.246451 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 04:20:56.255498 27164 raft_consensus.cc:1261] T 05180538ab984e198f2c33bc8b6edd15 P f79e2f1da76b4471b5e75e4aedc996ff [term 1 FOLLOWER]: Refusing update from remote peer b096ec656d0a44bcae4d879218884632: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:20:56.255563 27030 raft_consensus.cc:1261] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce [term 1 FOLLOWER]: Refusing update from remote peer b096ec656d0a44bcae4d879218884632: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:20:56.256460 27246 consensus_queue.cc:1035] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632 [LEADER]: Connected to new peer: Peer: permanent_uuid: "332973ac00384033a6da96df5d66ecce" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 46787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:20:56.256922 27240 consensus_queue.cc:1035] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f79e2f1da76b4471b5e75e4aedc996ff" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 45261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:20:56.271013 27249 mvcc.cc:205] Tried to move back new op lower bound from 7315769164812574720 to 7315769164608200704. Current Snapshot: MvccSnapshot[applied={T|T < 7315769164812574720}]
I20260807 04:20:56.285979 26741 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:20:56.286340 26741 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:20:56.290632 26741 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 55be7373c3c44d5facd00d5be147263f: Sending DeleteTablet for 3 replicas of tablet 05180538ab984e198f2c33bc8b6edd15
I20260807 04:20:56.291919 27007 tablet_service.cc:1514] Processing DeleteTablet for tablet 05180538ab984e198f2c33bc8b6edd15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:20:56 UTC) from {username='slave'} at 127.0.0.1:44472
I20260807 04:20:56.291955 26867 tablet_service.cc:1514] Processing DeleteTablet for tablet 05180538ab984e198f2c33bc8b6edd15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:20:56 UTC) from {username='slave'} at 127.0.0.1:50288
I20260807 04:20:56.292045 27143 tablet_service.cc:1514] Processing DeleteTablet for tablet 05180538ab984e198f2c33bc8b6edd15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:20:56 UTC) from {username='slave'} at 127.0.0.1:60422
I20260807 04:20:56.293694 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 26803
I20260807 04:20:56.304488 27261 tablet_replica.cc:330] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce: stopping tablet replica
I20260807 04:20:56.305016 27261 raft_consensus.cc:2229] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:20:56.305593 27261 raft_consensus.cc:2258] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:20:56.310074 27261 ts_tablet_manager.cc:1905] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:20:56.312673 27262 tablet_replica.cc:330] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632: stopping tablet replica
I20260807 04:20:56.313117 27262 raft_consensus.cc:2229] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632 [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:20:56.313725 27262 raft_consensus.cc:2258] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:20:56.314203 27260 tablet_replica.cc:330] T 05180538ab984e198f2c33bc8b6edd15 P f79e2f1da76b4471b5e75e4aedc996ff: stopping tablet replica
I20260807 04:20:56.314669 27260 raft_consensus.cc:2229] T 05180538ab984e198f2c33bc8b6edd15 P f79e2f1da76b4471b5e75e4aedc996ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:20:56.315232 27260 raft_consensus.cc:2258] T 05180538ab984e198f2c33bc8b6edd15 P f79e2f1da76b4471b5e75e4aedc996ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:20:56.317651 27262 ts_tablet_manager.cc:1905] T 05180538ab984e198f2c33bc8b6edd15 P b096ec656d0a44bcae4d879218884632: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:20:56.317643 27260 ts_tablet_manager.cc:1905] T 05180538ab984e198f2c33bc8b6edd15 P f79e2f1da76b4471b5e75e4aedc996ff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:20:56.321463 27261 ts_tablet_manager.cc:1918] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:20:56.321734 27261 log.cc:1196] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-1/wal/wals/05180538ab984e198f2c33bc8b6edd15
I20260807 04:20:56.322623 27261 ts_tablet_manager.cc:1939] T 05180538ab984e198f2c33bc8b6edd15 P 332973ac00384033a6da96df5d66ecce: Deleting consensus metadata
I20260807 04:20:56.323757 27230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:56.295540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50306 (local address 127.7.200.193:37515)
0807 04:20:56.295766 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:56.295800 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:56.305903 (+ 10103us) server_negotiation.cc:407] Connection header received
0807 04:20:56.306756 (+ 853us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:56.306765 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:56.306936 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:56.307040 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:20:56.307896 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.309491 (+ 1595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.314163 (+ 4672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.314714 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.314791 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:56.321319 (+ 6528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:20:56.321330 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:20:56.321354 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:20:56.322303 (+ 949us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:20:56.322392 (+ 89us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:20:56.322419 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:20:56.322532 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:56.323264 (+ 732us) server_negotiation.cc:299] Negotiation successful
0807 04:20:56.323387 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 04:20:56.324582 26932 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:20:56.324811 26727 catalog_manager.cc:4841] TS 332973ac00384033a6da96df5d66ecce (127.7.200.194:46787): tablet 05180538ab984e198f2c33bc8b6edd15 (table test-table [id=6e84f0cffbf249cc97d5c3a409d9bdc6]) successfully deleted
I20260807 04:20:56.325663 27260 ts_tablet_manager.cc:1918] T 05180538ab984e198f2c33bc8b6edd15 P f79e2f1da76b4471b5e75e4aedc996ff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:20:56.325863 27260 log.cc:1196] T 05180538ab984e198f2c33bc8b6edd15 P f79e2f1da76b4471b5e75e4aedc996ff: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786076137270840-7971-0/minicluster-data/ts-2/wal/wals/05180538ab984e198f2c33bc8b6edd15
I20260807 04:20:56.326426 27260 ts_tablet_manager.cc:1939] T 05180538ab984e198f2c33bc8b6edd15 P f79e2f1da76b4471b5e75e4aedc996ff: Deleting consensus metadata
I20260807 04:20:56.328342 26725 catalog_manager.cc:4841] TS f79e2f1da76b4471b5e75e4aedc996ff (127.7.200.195:45261): tablet 05180538ab984e198f2c33bc8b6edd15 (table test-table [id=6e84f0cffbf249cc97d5c3a409d9bdc6]) successfully deleted
I20260807 04:20:56.429091 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 26803
I20260807 04:20:56.450500 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 26942
W20260807 04:20:56.450628 26726 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.200.193:37515 (error 108)
I20260807 04:20:56.452600 27229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:56.452056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37515 (local address 127.0.0.1:50308)
0807 04:20:56.452254 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:56.452386 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:37515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
W20260807 04:20:56.452831 26726 catalog_manager.cc:4584] TS b096ec656d0a44bcae4d879218884632 (127.7.200.193:37515): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 05180538ab984e198f2c33bc8b6edd15: Network error: Client connection negotiation failed: client connection to 127.7.200.193:37515: connect: Connection refused (error 111)
I20260807 04:20:56.458693 27227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:56.451718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44478 (local address 127.7.200.194:46787)
0807 04:20:56.451901 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:56.451907 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:56.451931 (+ 24us) server_negotiation.cc:407] Connection header received
0807 04:20:56.451995 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:56.451998 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:56.452080 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:56.452217 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:20:56.452706 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.453527 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.455440 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.455880 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.455978 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:56.457241 (+ 1263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:20:56.457249 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:20:56.457261 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:20:56.457861 (+ 600us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:20:56.457906 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:20:56.457925 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:20:56.458029 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:56.458195 (+ 166us) server_negotiation.cc:299] Negotiation successful
0807 04:20:56.458282 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 04:20:56.459311 27072 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:20:56.506467 27229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:56.505879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37515 (local address 127.0.0.1:50312)
0807 04:20:56.506150 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:56.506262 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:37515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260807 04:20:56.507768 27229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:56.507275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37515 (local address 127.0.0.1:50318)
0807 04:20:56.507557 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:56.507631 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:37515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163}
I20260807 04:20:56.553704 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 26942
I20260807 04:20:56.568677 27229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:56.568169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37515 (local address 127.0.0.1:50324)
0807 04:20:56.568400 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:56.568498 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:37515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260807 04:20:56.569906 27229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:56.569566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37515 (local address 127.0.0.1:50330)
0807 04:20:56.569717 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:56.569792 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:37515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260807 04:20:56.574667 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 27080
I20260807 04:20:56.581957 27231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:56.575498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60430 (local address 127.7.200.195:45261)
0807 04:20:56.575737 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:56.575744 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:56.575765 (+ 21us) server_negotiation.cc:407] Connection header received
0807 04:20:56.575996 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:56.576002 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:56.576092 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:56.576213 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:20:56.576647 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.577399 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.578744 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:56.579184 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:56.579327 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:56.580464 (+ 1137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:20:56.580476 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:20:56.580490 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:20:56.581203 (+ 713us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:20:56.581251 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:20:56.581271 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:20:56.581411 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:56.581551 (+ 140us) server_negotiation.cc:299] Negotiation successful
0807 04:20:56.581654 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 04:20:56.582615 27209 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:20:56.650840 27229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:56.650264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37515 (local address 127.0.0.1:50346)
0807 04:20:56.650523 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:56.650648 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:37515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
I20260807 04:20:56.652048 27229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:56.651635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37515 (local address 127.0.0.1:50348)
0807 04:20:56.651856 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:56.651939 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:37515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
I20260807 04:20:56.673844 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 27080
I20260807 04:20:56.693634 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 26709
I20260807 04:20:56.694834 26774 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:20:56.810813 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 26709
2026-08-07T04:20:56Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (3005 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:20:56 dist-test-slave-qg60 krb5kdc[27271](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:20:56 dist-test-slave-qg60 krb5kdc[27271](info): set up 2 sockets
Aug 07 04:20:56 dist-test-slave-qg60 krb5kdc[27271](info): commencing operation
krb5kdc: starting...
W20260807 04:20:58.019054 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.161s user 0.000s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:20:58 dist-test-slave-qg60 krb5kdc[27271](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:20:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:20:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
I20260807 04:20:58.360988 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:39025
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:41867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:39025
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:20:58.708030 27285 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:20:58.708317 27285 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:20:58.708482 27285 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:20:58.715926 27285 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:20:58.716060 27285 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:20:58.716147 27285 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:20:58.716238 27285 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:20:58.716318 27285 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:20:58.726572 27285 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:41867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:39025
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:39025
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:20:58.728044 27285 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:20:58.729450 27285 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:20:58.741469 27291 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:58.741513 27292 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:58.741422 27294 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:20:58.742563 27285 server_base.cc:1034] running on GCE node
I20260807 04:20:58.743723 27285 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:20:58.745851 27285 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:20:58.747118 27285 hybrid_clock.cc:648] HybridClock initialized: now 1786076458747051 us; error 57 us; skew 500 ppm
I20260807 04:20:58.747643 27285 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:20:58 dist-test-slave-qg60 krb5kdc[27271](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076458, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:20:58.751812 27285 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:20:58.753448 27285 webserver.cc:460] Webserver started at http://127.7.200.254:41999/ using document root <none> and password file <none>
I20260807 04:20:58.754150 27285 fs_manager.cc:359] Metadata directory not provided
I20260807 04:20:58.754256 27285 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:20:58.754521 27285 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:20:58.757871 27285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "0a04c03685bf4e988f54405cb304a950"
format_stamp: "Formatted at 2026-08-07 04:20:58 on dist-test-slave-qg60"
server_key: "6216ddd888f3c3542b9167dad67537e7"
server_key_iv: "0e26cbc64864da5812b71b831407866a"
server_key_version: "encryptionkey@0"
I20260807 04:20:58.758615 27285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "0a04c03685bf4e988f54405cb304a950"
format_stamp: "Formatted at 2026-08-07 04:20:58 on dist-test-slave-qg60"
server_key: "6216ddd888f3c3542b9167dad67537e7"
server_key_iv: "0e26cbc64864da5812b71b831407866a"
server_key_version: "encryptionkey@0"
I20260807 04:20:58.764006 27285 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 04:20:58.767544 27301 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:58.768976 27285 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:20:58.769173 27285 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "0a04c03685bf4e988f54405cb304a950"
format_stamp: "Formatted at 2026-08-07 04:20:58 on dist-test-slave-qg60"
server_key: "6216ddd888f3c3542b9167dad67537e7"
server_key_iv: "0e26cbc64864da5812b71b831407866a"
server_key_version: "encryptionkey@0"
I20260807 04:20:58.769375 27285 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:20:58.784322 27285 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:20:58.788694 27285 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:20:58.789043 27285 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:20:58.808537 27285 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:39025
I20260807 04:20:58.808561 27355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:39025 every 8 connection(s)
I20260807 04:20:58.809998 27285 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:20:58.813787 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 27285
I20260807 04:20:58.813987 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:20:58.814034 27356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:20:58.814482 7971 external_mini_cluster.cc:1428] Setting key 483cf7f2a2d9e97e01bb4df0fc5f1dcd
I20260807 04:20:58.828895 27356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a04c03685bf4e988f54405cb304a950: Bootstrap starting.
Aug 07 04:20:58 dist-test-slave-qg60 krb5kdc[27271](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:20:58.832537 27356 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0a04c03685bf4e988f54405cb304a950: Neither blocks nor log segments found. Creating new log.
I20260807 04:20:58.834007 27356 log.cc:824] T 00000000000000000000000000000000 P 0a04c03685bf4e988f54405cb304a950: Log is configured to *not* fsync() on all Append() calls
I20260807 04:20:58.837786 27356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a04c03685bf4e988f54405cb304a950: No bootstrap required, opened a new log
I20260807 04:20:58.842022 27359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:58.816398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57704 (local address 127.7.200.254:39025)
0807 04:20:58.817335 (+ 937us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:58.817350 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:58.817398 (+ 48us) server_negotiation.cc:407] Connection header received
0807 04:20:58.819326 (+ 1928us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:58.819354 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:58.819872 (+ 518us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:58.820330 (+ 458us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:20:58.821909 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:58.823888 (+ 1979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:58.825421 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:58.826535 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:58.826726 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:58.831031 (+ 4305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:20:58.831041 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:20:58.831060 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:20:58.831116 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:20:58.835224 (+ 4108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:58.836191 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:58.836200 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:58.836208 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:58.836422 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:58.837062 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:58.837069 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:58.837072 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:58.838008 (+ 936us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:20:58.838407 (+ 399us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:58.840391 (+ 1984us) server_negotiation.cc:299] Negotiation successful
0807 04:20:58.840880 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":684,"thread_start_us":386,"threads_started":1}
I20260807 04:20:58.846908 27356 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0a04c03685bf4e988f54405cb304a950 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a04c03685bf4e988f54405cb304a950" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 39025 } }
I20260807 04:20:58.847311 27356 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0a04c03685bf4e988f54405cb304a950 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:20:58.847426 27356 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0a04c03685bf4e988f54405cb304a950 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a04c03685bf4e988f54405cb304a950, State: Initialized, Role: FOLLOWER
I20260807 04:20:58.848037 27356 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0a04c03685bf4e988f54405cb304a950 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a04c03685bf4e988f54405cb304a950" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 39025 } }
I20260807 04:20:58.848286 27356 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0a04c03685bf4e988f54405cb304a950 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:20:58.848436 27356 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0a04c03685bf4e988f54405cb304a950 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:20:58.848615 27356 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0a04c03685bf4e988f54405cb304a950 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:20:58.851269 27356 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0a04c03685bf4e988f54405cb304a950 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a04c03685bf4e988f54405cb304a950" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 39025 } }
I20260807 04:20:58.851797 27356 leader_election.cc:302] T 00000000000000000000000000000000 P 0a04c03685bf4e988f54405cb304a950 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0a04c03685bf4e988f54405cb304a950; no voters:
I20260807 04:20:58.852443 27356 leader_election.cc:288] T 00000000000000000000000000000000 P 0a04c03685bf4e988f54405cb304a950 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:20:58.852532 27361 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0a04c03685bf4e988f54405cb304a950 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:20:58.853381 27361 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0a04c03685bf4e988f54405cb304a950 [term 1 LEADER]: Becoming Leader. State: Replica: 0a04c03685bf4e988f54405cb304a950, State: Running, Role: LEADER
I20260807 04:20:58.854291 27361 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0a04c03685bf4e988f54405cb304a950 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a04c03685bf4e988f54405cb304a950" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 39025 } }
I20260807 04:20:58.854949 27356 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0a04c03685bf4e988f54405cb304a950 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:20:58.858084 27363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a04c03685bf4e988f54405cb304a950 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0a04c03685bf4e988f54405cb304a950. Latest consensus state: current_term: 1 leader_uuid: "0a04c03685bf4e988f54405cb304a950" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a04c03685bf4e988f54405cb304a950" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 39025 } } }
I20260807 04:20:58.858769 27363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a04c03685bf4e988f54405cb304a950 [sys.catalog]: This master's current role is: LEADER
I20260807 04:20:58.858197 27362 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a04c03685bf4e988f54405cb304a950 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0a04c03685bf4e988f54405cb304a950" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a04c03685bf4e988f54405cb304a950" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 39025 } } }
I20260807 04:20:58.859367 27362 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a04c03685bf4e988f54405cb304a950 [sys.catalog]: This master's current role is: LEADER
I20260807 04:20:58.859664 27370 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:20:58.865423 27370 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:20:58.874621 27370 catalog_manager.cc:1347] Generated new cluster ID: 2b111b4e7a3e4fe898f7a7a071cc29fa
I20260807 04:20:58.874752 27370 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:20:58.900027 27370 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:20:58.902254 27370 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:20:58.913036 27370 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0a04c03685bf4e988f54405cb304a950: Generated new TSK 0
I20260807 04:20:58.913964 27370 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.200.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
I20260807 04:20:58.991936 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:0
--local_ip_for_outbound_sockets=127.7.200.193
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:39025
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:41867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:20:59.341547 27382 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:20:59.341863 27382 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:20:59.342023 27382 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:20:59.349431 27382 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:20:59.349594 27382 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:20:59.349767 27382 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:20:59.359982 27382 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:41867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:39025
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:20:59.361408 27382 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:20:59.362751 27382 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:20:59.377007 27389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:59.376978 27392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:59.376955 27390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:20:59.377974 27382 server_base.cc:1034] running on GCE node
I20260807 04:20:59.378697 27382 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:20:59.379753 27382 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:20:59.381006 27382 hybrid_clock.cc:648] HybridClock initialized: now 1786076459380938 us; error 60 us; skew 500 ppm
I20260807 04:20:59.381351 27382 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:20:59 dist-test-slave-qg60 krb5kdc[27271](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076459, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:20:59.385000 27382 init.cc:377] Logged in from keytab as kudu/127.7.200.193@KRBTEST.COM (short username kudu)
I20260807 04:20:59.386622 27382 webserver.cc:460] Webserver started at http://127.7.200.193:41613/ using document root <none> and password file <none>
I20260807 04:20:59.387343 27382 fs_manager.cc:359] Metadata directory not provided
I20260807 04:20:59.387580 27382 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:20:59.387971 27382 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:20:59.391090 27382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-0/data/instance:
uuid: "49f8f4f5ca5749e5a3adf48b1d354216"
format_stamp: "Formatted at 2026-08-07 04:20:59 on dist-test-slave-qg60"
server_key: "8f10976ef9c8ac52f01a1dbc9d01d4cf"
server_key_iv: "ec53c474581e3443f8088cb97f8ba421"
server_key_version: "encryptionkey@0"
I20260807 04:20:59.391957 27382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance:
uuid: "49f8f4f5ca5749e5a3adf48b1d354216"
format_stamp: "Formatted at 2026-08-07 04:20:59 on dist-test-slave-qg60"
server_key: "8f10976ef9c8ac52f01a1dbc9d01d4cf"
server_key_iv: "ec53c474581e3443f8088cb97f8ba421"
server_key_version: "encryptionkey@0"
I20260807 04:20:59.397457 27382 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 04:20:59.401031 27399 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:59.402369 27382 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 04:20:59.402555 27382 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "49f8f4f5ca5749e5a3adf48b1d354216"
format_stamp: "Formatted at 2026-08-07 04:20:59 on dist-test-slave-qg60"
server_key: "8f10976ef9c8ac52f01a1dbc9d01d4cf"
server_key_iv: "ec53c474581e3443f8088cb97f8ba421"
server_key_version: "encryptionkey@0"
I20260807 04:20:59.402766 27382 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:20:59.415683 27382 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:20:59.419697 27382 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:20:59.419991 27382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:20:59.420997 27382 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:20:59.422303 27382 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:20:59.422406 27382 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:59.422547 27382 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:20:59.422621 27382 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:59.457065 27382 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:41247
I20260807 04:20:59.457152 27518 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:41247 every 8 connection(s)
I20260807 04:20:59.458539 27382 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:20:59.465327 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 27382
I20260807 04:20:59.465528 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance
I20260807 04:20:59.465997 7971 external_mini_cluster.cc:1428] Setting key a53abd44d3e28678da303796b72bfee5
Aug 07 04:20:59 dist-test-slave-qg60 krb5kdc[27271](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076459, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:20:59.479548 27521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:59.461210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:44481 (local address 127.7.200.254:39025)
0807 04:20:59.461710 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0807 04:20:59.461717 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:20:59.462636 (+ 919us) server_negotiation.cc:407] Connection header received
0807 04:20:59.464433 (+ 1797us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:20:59.464437 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:20:59.464510 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:20:59.464607 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:20:59.466325 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:59.467294 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:59.469072 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:20:59.469476 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:20:59.469617 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:59.473426 (+ 3809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:20:59.473430 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:20:59.473434 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:20:59.473467 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:20:59.476316 (+ 2849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:59.477161 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:59.477166 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:59.477168 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:59.477293 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:20:59.477744 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:20:59.477748 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:20:59.477750 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:20:59.478018 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:20:59.478176 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 04:20:59.478889 (+ 713us) server_negotiation.cc:299] Negotiation successful
0807 04:20:59.479131 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":234,"threads_started":1}
I20260807 04:20:59.480552 27522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:20:59.461762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:39025 (local address 127.7.200.193:44481)
0807 04:20:59.462470 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0807 04:20:59.462510 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 04:20:59.464181 (+ 1671us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:20:59.464862 (+ 681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:20:59.464871 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:20:59.465418 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:20:59.466126 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:59.466158 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:59.467467 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:59.467472 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:59.468916 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:20:59.468928 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:20:59.469725 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:20:59.469735 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:20:59.469990 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:20:59.470705 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:20:59.470728 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:20:59.473180 (+ 2452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:20:59.476484 (+ 3304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:20:59.476493 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:20:59.476516 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:20:59.477029 (+ 513us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:20:59.477408 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:20:59.477413 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:20:59.477417 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:20:59.477618 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:20:59.478149 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:20:59.478157 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:20:59.478506 (+ 349us) client_negotiation.cc:769] Sending connection context
0807 04:20:59.478768 (+ 262us) client_negotiation.cc:240] Negotiation successful
0807 04:20:59.479341 (+ 573us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":280,"threads_started":1}
I20260807 04:20:59.482299 27519 heartbeater.cc:347] Connected to a master server at 127.7.200.254:39025
I20260807 04:20:59.482620 27519 heartbeater.cc:464] Registering TS with master...
I20260807 04:20:59.483369 27519 heartbeater.cc:511] Master 127.7.200.254:39025 requested a full tablet report, sending...
I20260807 04:20:59.485532 27320 ts_manager.cc:194] Registered new tserver with Master: 49f8f4f5ca5749e5a3adf48b1d354216 (127.7.200.193:41247)
I20260807 04:20:59.486994 27320 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.193@KRBTEST.COM'} at 127.7.200.193:44481
WARNING: no policy specified for kudu/127.7.200.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
I20260807 04:20:59.536087 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:0
--local_ip_for_outbound_sockets=127.7.200.194
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:39025
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:41867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:20:59.884992 27525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:20:59.885318 27525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:20:59.885486 27525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:20:59.892700 27525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:20:59.892884 27525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:20:59.893069 27525 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:20:59.903199 27525 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:41867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:39025
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:20:59.904575 27525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:20:59.905963 27525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:20:59.919540 27530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:59.919582 27533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:20:59.919632 27531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:20:59.920261 27525 server_base.cc:1034] running on GCE node
I20260807 04:20:59.920929 27525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:20:59.921895 27525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:20:59.923133 27525 hybrid_clock.cc:648] HybridClock initialized: now 1786076459923075 us; error 53 us; skew 500 ppm
I20260807 04:20:59.923450 27525 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:20:59 dist-test-slave-qg60 krb5kdc[27271](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076459, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:20:59.926604 27525 init.cc:377] Logged in from keytab as kudu/127.7.200.194@KRBTEST.COM (short username kudu)
I20260807 04:20:59.928047 27525 webserver.cc:460] Webserver started at http://127.7.200.194:33565/ using document root <none> and password file <none>
I20260807 04:20:59.928694 27525 fs_manager.cc:359] Metadata directory not provided
I20260807 04:20:59.928851 27525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:20:59.929152 27525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:20:59.932008 27525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-1/data/instance:
uuid: "f575d20a70be462b80d211b3d6f252e8"
format_stamp: "Formatted at 2026-08-07 04:20:59 on dist-test-slave-qg60"
server_key: "0360ca8134356f29f3a80339de59910f"
server_key_iv: "a3b267dbb282d355cd471a7cdcea1c2c"
server_key_version: "encryptionkey@0"
I20260807 04:20:59.932806 27525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance:
uuid: "f575d20a70be462b80d211b3d6f252e8"
format_stamp: "Formatted at 2026-08-07 04:20:59 on dist-test-slave-qg60"
server_key: "0360ca8134356f29f3a80339de59910f"
server_key_iv: "a3b267dbb282d355cd471a7cdcea1c2c"
server_key_version: "encryptionkey@0"
I20260807 04:20:59.938055 27525 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260807 04:20:59.941438 27540 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:59.942854 27525 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:20:59.942993 27525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "f575d20a70be462b80d211b3d6f252e8"
format_stamp: "Formatted at 2026-08-07 04:20:59 on dist-test-slave-qg60"
server_key: "0360ca8134356f29f3a80339de59910f"
server_key_iv: "a3b267dbb282d355cd471a7cdcea1c2c"
server_key_version: "encryptionkey@0"
I20260807 04:20:59.943167 27525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:20:59.959760 27525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:20:59.963722 27525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:20:59.963963 27525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:20:59.964947 27525 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:20:59.966226 27525 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:20:59.966300 27525 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:20:59.966410 27525 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:20:59.966454 27525 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:00.000347 27525 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:36385
I20260807 04:21:00.000505 27659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:36385 every 8 connection(s)
I20260807 04:21:00.002315 27525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:21:00.008641 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 27525
I20260807 04:21:00.008900 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance
I20260807 04:21:00.009536 7971 external_mini_cluster.cc:1428] Setting key 294ae0ab1e1f4503d9822913f473bb25
Aug 07 04:21:00 dist-test-slave-qg60 krb5kdc[27271](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076459, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:21:00.025503 27663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:00.005050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:52011 (local address 127.7.200.254:39025)
0807 04:21:00.005541 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:00.005545 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:00.006445 (+ 900us) server_negotiation.cc:407] Connection header received
0807 04:21:00.008573 (+ 2128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:00.008578 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:00.008653 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:00.008837 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:00.010942 (+ 2105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.011960 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.014512 (+ 2552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.014939 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.015046 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:00.019522 (+ 4476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:00.019528 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:00.019531 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:00.019566 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:00.022350 (+ 2784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:00.023094 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:00.023102 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:00.023107 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:00.023239 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:00.023670 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:00.023677 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:00.023680 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:00.023964 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:00.024116 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:00.024834 (+ 718us) server_negotiation.cc:299] Negotiation successful
0807 04:21:00.025098 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":264,"threads_started":1}
I20260807 04:21:00.026569 27664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:00.005539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:39025 (local address 127.7.200.194:52011)
0807 04:21:00.006284 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:00.006324 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:00.008198 (+ 1874us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:00.009179 (+ 981us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:00.009192 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:00.009966 (+ 774us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:21:00.010658 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:00.010686 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.012138 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.012144 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:00.014333 (+ 2189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:00.014352 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.015188 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.015198 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:00.015560 (+ 362us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:00.016350 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:21:00.016391 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:21:00.019238 (+ 2847us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:21:00.022501 (+ 3263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:00.022511 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:00.022528 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:00.022961 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:00.023349 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:00.023354 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:00.023357 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:00.023562 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:00.024092 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:21:00.024101 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:21:00.024449 (+ 348us) client_negotiation.cc:769] Sending connection context
0807 04:21:00.024724 (+ 275us) client_negotiation.cc:240] Negotiation successful
0807 04:21:00.025308 (+ 584us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":310,"threads_started":1}
I20260807 04:21:00.028118 27660 heartbeater.cc:347] Connected to a master server at 127.7.200.254:39025
I20260807 04:21:00.028414 27660 heartbeater.cc:464] Registering TS with master...
I20260807 04:21:00.029194 27660 heartbeater.cc:511] Master 127.7.200.254:39025 requested a full tablet report, sending...
I20260807 04:21:00.030699 27320 ts_manager.cc:194] Registered new tserver with Master: f575d20a70be462b80d211b3d6f252e8 (127.7.200.194:36385)
I20260807 04:21:00.032027 27320 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.194@KRBTEST.COM'} at 127.7.200.194:52011
WARNING: no policy specified for kudu/127.7.200.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
I20260807 04:21:00.080570 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:0
--local_ip_for_outbound_sockets=127.7.200.195
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:39025
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:41867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:21:00.441082 27667 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:00.441372 27667 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:00.441468 27667 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:00.449229 27667 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:00.449347 27667 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:00.449470 27667 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:21:00.459744 27667 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:41867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:39025
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:00.461143 27667 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:00.462451 27667 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:00.476454 27673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:00.476557 27672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:00.476504 27675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:00.477542 27667 server_base.cc:1034] running on GCE node
I20260807 04:21:00.478133 27667 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:00.479048 27667 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:00.480262 27667 hybrid_clock.cc:648] HybridClock initialized: now 1786076460480212 us; error 44 us; skew 500 ppm
I20260807 04:21:00.480588 27667 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:21:00 dist-test-slave-qg60 krb5kdc[27271](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076460, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:21:00.488898 27667 init.cc:377] Logged in from keytab as kudu/127.7.200.195@KRBTEST.COM (short username kudu)
I20260807 04:21:00.489912 27519 heartbeater.cc:503] Master 127.7.200.254:39025 was elected leader, sending a full tablet report...
I20260807 04:21:00.490707 27667 webserver.cc:460] Webserver started at http://127.7.200.195:37977/ using document root <none> and password file <none>
I20260807 04:21:00.491436 27667 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:00.491609 27667 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:00.491973 27667 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:00.495160 27667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-2/data/instance:
uuid: "4f54e7bc45014f94a4f0bf2331964b89"
format_stamp: "Formatted at 2026-08-07 04:21:00 on dist-test-slave-qg60"
server_key: "ce9f3b37085710e15f1dfacb6268ee61"
server_key_iv: "93de9e83277c1f4393c4f96e7f6e3d04"
server_key_version: "encryptionkey@0"
I20260807 04:21:00.495990 27667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance:
uuid: "4f54e7bc45014f94a4f0bf2331964b89"
format_stamp: "Formatted at 2026-08-07 04:21:00 on dist-test-slave-qg60"
server_key: "ce9f3b37085710e15f1dfacb6268ee61"
server_key_iv: "93de9e83277c1f4393c4f96e7f6e3d04"
server_key_version: "encryptionkey@0"
I20260807 04:21:00.501376 27667 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260807 04:21:00.505213 27682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:00.506716 27667 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 04:21:00.506894 27667 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "4f54e7bc45014f94a4f0bf2331964b89"
format_stamp: "Formatted at 2026-08-07 04:21:00 on dist-test-slave-qg60"
server_key: "ce9f3b37085710e15f1dfacb6268ee61"
server_key_iv: "93de9e83277c1f4393c4f96e7f6e3d04"
server_key_version: "encryptionkey@0"
I20260807 04:21:00.507144 27667 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:00.526445 27667 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:00.530751 27667 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:00.531213 27667 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:00.532232 27667 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:21:00.533705 27667 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:21:00.533798 27667 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:00.533972 27667 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:21:00.534173 27667 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:00.569034 27667 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:39837
I20260807 04:21:00.569113 27801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:39837 every 8 connection(s)
I20260807 04:21:00.570449 27667 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:21:00.574827 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 27667
I20260807 04:21:00.575038 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance
I20260807 04:21:00.575699 7971 external_mini_cluster.cc:1428] Setting key e4b5111d227d3acb7537d0e14842c44b
Aug 07 04:21:00 dist-test-slave-qg60 krb5kdc[27271](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076460, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:21:00.597081 27805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:00.573721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:39025 (local address 127.7.200.195:46429)
0807 04:21:00.574602 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:00.574657 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:00.577058 (+ 2401us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:00.578002 (+ 944us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:00.578011 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:00.578610 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:21:00.579317 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:00.579336 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.580441 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.580445 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:00.581767 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:00.581780 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.582500 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.582504 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:00.582708 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:00.583497 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:21:00.583550 (+ 53us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:21:00.586902 (+ 3352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:21:00.591716 (+ 4814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:00.591725 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:00.591739 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:00.592349 (+ 610us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:00.592877 (+ 528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:00.592882 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:00.592886 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:00.593166 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:00.593908 (+ 742us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:21:00.593922 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:21:00.594378 (+ 456us) client_negotiation.cc:769] Sending connection context
0807 04:21:00.594758 (+ 380us) client_negotiation.cc:240] Negotiation successful
0807 04:21:00.595399 (+ 641us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":362,"threads_started":1}
I20260807 04:21:00.598403 27804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:00.573217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:46429 (local address 127.7.200.254:39025)
0807 04:21:00.573685 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:00.573690 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:00.574788 (+ 1098us) server_negotiation.cc:407] Connection header received
0807 04:21:00.577422 (+ 2634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:00.577427 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:00.577561 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:00.577694 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:00.579490 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.580300 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.581900 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.582298 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.582396 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:00.587201 (+ 4805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:00.587207 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:00.587211 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:00.587276 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:00.591495 (+ 4219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:00.592519 (+ 1024us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:00.592527 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:00.592531 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:00.592683 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:00.593317 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:00.593322 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:00.593325 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:00.593746 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:00.593911 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:00.597707 (+ 3796us) server_negotiation.cc:299] Negotiation successful
0807 04:21:00.597970 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":215,"threads_started":1}
I20260807 04:21:00.599792 27802 heartbeater.cc:347] Connected to a master server at 127.7.200.254:39025
I20260807 04:21:00.600144 27802 heartbeater.cc:464] Registering TS with master...
I20260807 04:21:00.601050 27802 heartbeater.cc:511] Master 127.7.200.254:39025 requested a full tablet report, sending...
I20260807 04:21:00.602921 27320 ts_manager.cc:194] Registered new tserver with Master: 4f54e7bc45014f94a4f0bf2331964b89 (127.7.200.195:39837)
I20260807 04:21:00.604086 27320 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.195@KRBTEST.COM'} at 127.7.200.195:46429
I20260807 04:21:00.604867 7971 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 04:21:00.629132 27804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:00.610757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57712 (local address 127.7.200.254:39025)
0807 04:21:00.610978 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:00.610985 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:00.611380 (+ 395us) server_negotiation.cc:407] Connection header received
0807 04:21:00.611610 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:00.611616 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:00.611702 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:00.611814 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:00.613904 (+ 2090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.614932 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.617338 (+ 2406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.618149 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.618306 (+ 157us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:00.621541 (+ 3235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:00.621547 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:00.621550 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:00.621587 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:00.625513 (+ 3926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:00.626600 (+ 1087us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:00.626606 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:00.626611 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:00.626769 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:00.627322 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:00.627327 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:00.627331 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:00.627692 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:00.628017 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:00.628501 (+ 484us) server_negotiation.cc:299] Negotiation successful
0807 04:21:00.628724 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 04:21:00.634768 27319 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57712:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:21:00.642576 27319 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:21:00.671496 27816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:00.656508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:41247 (local address 127.0.0.1:58194)
0807 04:21:00.657414 (+ 906us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:00.657459 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:00.657646 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:00.658433 (+ 787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:00.658444 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:00.658476 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:21:00.659078 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:00.659094 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.662161 (+ 3067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.662171 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:00.665646 (+ 3475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:00.665677 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.668656 (+ 2979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.668668 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:00.669046 (+ 378us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:00.669138 (+ 92us) client_negotiation.cc:769] Sending connection context
0807 04:21:00.669295 (+ 157us) client_negotiation.cc:240] Negotiation successful
0807 04:21:00.670910 (+ 1615us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":605,"thread_start_us":487,"threads_started":1}
I20260807 04:21:00.673748 27817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:00.657034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58194 (local address 127.7.200.193:41247)
0807 04:21:00.657668 (+ 634us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:00.657678 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:00.657712 (+ 34us) server_negotiation.cc:407] Connection header received
0807 04:21:00.657895 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:00.657904 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:00.658187 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:00.659326 (+ 1139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:21:00.659661 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.661935 (+ 2274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.666010 (+ 4075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.668276 (+ 2266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.672385 (+ 4109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:00.672812 (+ 427us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:00.672913 (+ 101us) server_negotiation.cc:299] Negotiation successful
0807 04:21:00.673259 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":634,"threads_started":1}
I20260807 04:21:00.678354 27450 tablet_service.cc:1467] Processing CreateTablet for tablet 44caaae88ad04acab42675a88a17f8ae (DEFAULT_TABLE table=test-table [id=0ae7d9eead924c00a2df1978f94b6fe4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:21:00.680176 27450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44caaae88ad04acab42675a88a17f8ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:00.681391 27818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:00.657455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:39837 (local address 127.0.0.1:40770)
0807 04:21:00.658267 (+ 812us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:00.658288 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:00.658396 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:00.674658 (+ 16262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:00.674667 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:00.674714 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:21:00.675247 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:00.675263 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.677255 (+ 1992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.677261 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:00.678578 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:00.678590 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.680523 (+ 1933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.680530 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:00.680763 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:00.680798 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 04:21:00.680902 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 04:21:00.681055 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":688,"thread_start_us":553,"threads_started":1}
I20260807 04:21:00.681490 27819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:00.658075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40770 (local address 127.7.200.195:39837)
0807 04:21:00.673857 (+ 15782us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:00.673868 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:00.673912 (+ 44us) server_negotiation.cc:407] Connection header received
0807 04:21:00.674029 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:00.674039 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:00.674377 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:00.674598 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:21:00.675511 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.677115 (+ 1604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.678749 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.680236 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.680420 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:00.680662 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:00.680961 (+ 299us) server_negotiation.cc:299] Negotiation successful
0807 04:21:00.681140 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15528,"thread_start_us":18127,"threads_started":1}
I20260807 04:21:00.683151 27816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:00.658592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:36385 (local address 127.0.0.1:54690)
0807 04:21:00.671924 (+ 13332us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:00.671950 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:00.672125 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:00.676474 (+ 4349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:00.676481 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:00.676509 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:21:00.676721 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:00.676754 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.678882 (+ 2128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.678888 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:00.680823 (+ 1935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:00.680836 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.682392 (+ 1556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.682397 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:00.682577 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:00.682619 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 04:21:00.682722 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 04:21:00.682868 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13150,"thread_start_us":17017,"threads_started":1}
I20260807 04:21:00.683288 27821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:00.658943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54690 (local address 127.7.200.194:36385)
0807 04:21:00.675661 (+ 16718us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:00.675670 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:00.675698 (+ 28us) server_negotiation.cc:407] Connection header received
0807 04:21:00.675807 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:00.675815 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:00.676056 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:00.676944 (+ 888us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:21:00.677188 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.678710 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.681027 (+ 2317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.682217 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.682380 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:00.682566 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:00.682791 (+ 225us) server_negotiation.cc:299] Negotiation successful
0807 04:21:00.682947 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16557,"thread_start_us":16411,"threads_started":1}
I20260807 04:21:00.685384 27732 tablet_service.cc:1467] Processing CreateTablet for tablet 44caaae88ad04acab42675a88a17f8ae (DEFAULT_TABLE table=test-table [id=0ae7d9eead924c00a2df1978f94b6fe4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:21:00.687091 27732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44caaae88ad04acab42675a88a17f8ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:00.687601 27593 tablet_service.cc:1467] Processing CreateTablet for tablet 44caaae88ad04acab42675a88a17f8ae (DEFAULT_TABLE table=test-table [id=0ae7d9eead924c00a2df1978f94b6fe4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:21:00.689196 27593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44caaae88ad04acab42675a88a17f8ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:00.696346 27822 tablet_bootstrap.cc:492] T 44caaae88ad04acab42675a88a17f8ae P 49f8f4f5ca5749e5a3adf48b1d354216: Bootstrap starting.
I20260807 04:21:00.699644 27822 tablet_bootstrap.cc:654] T 44caaae88ad04acab42675a88a17f8ae P 49f8f4f5ca5749e5a3adf48b1d354216: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:00.700929 27822 log.cc:824] T 44caaae88ad04acab42675a88a17f8ae P 49f8f4f5ca5749e5a3adf48b1d354216: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:00.702816 27824 tablet_bootstrap.cc:492] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89: Bootstrap starting.
I20260807 04:21:00.705433 27825 tablet_bootstrap.cc:492] T 44caaae88ad04acab42675a88a17f8ae P f575d20a70be462b80d211b3d6f252e8: Bootstrap starting.
I20260807 04:21:00.706624 27822 tablet_bootstrap.cc:492] T 44caaae88ad04acab42675a88a17f8ae P 49f8f4f5ca5749e5a3adf48b1d354216: No bootstrap required, opened a new log
I20260807 04:21:00.706918 27824 tablet_bootstrap.cc:654] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:00.706945 27822 ts_tablet_manager.cc:1397] T 44caaae88ad04acab42675a88a17f8ae P 49f8f4f5ca5749e5a3adf48b1d354216: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.004s
I20260807 04:21:00.708557 27824 log.cc:824] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:00.709216 27825 tablet_bootstrap.cc:654] T 44caaae88ad04acab42675a88a17f8ae P f575d20a70be462b80d211b3d6f252e8: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:00.710418 27825 log.cc:824] T 44caaae88ad04acab42675a88a17f8ae P f575d20a70be462b80d211b3d6f252e8: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:00.713680 27824 tablet_bootstrap.cc:492] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89: No bootstrap required, opened a new log
I20260807 04:21:00.713897 27825 tablet_bootstrap.cc:492] T 44caaae88ad04acab42675a88a17f8ae P f575d20a70be462b80d211b3d6f252e8: No bootstrap required, opened a new log
I20260807 04:21:00.714004 27824 ts_tablet_manager.cc:1397] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260807 04:21:00.714222 27825 ts_tablet_manager.cc:1397] T 44caaae88ad04acab42675a88a17f8ae P f575d20a70be462b80d211b3d6f252e8: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.001s
I20260807 04:21:00.718607 27822 raft_consensus.cc:348] T 44caaae88ad04acab42675a88a17f8ae P 49f8f4f5ca5749e5a3adf48b1d354216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f8f4f5ca5749e5a3adf48b1d354216" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 41247 } } peers { permanent_uuid: "f575d20a70be462b80d211b3d6f252e8" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36385 } } peers { permanent_uuid: "4f54e7bc45014f94a4f0bf2331964b89" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39837 } }
I20260807 04:21:00.719100 27822 raft_consensus.cc:374] T 44caaae88ad04acab42675a88a17f8ae P 49f8f4f5ca5749e5a3adf48b1d354216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:00.719224 27822 raft_consensus.cc:729] T 44caaae88ad04acab42675a88a17f8ae P 49f8f4f5ca5749e5a3adf48b1d354216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49f8f4f5ca5749e5a3adf48b1d354216, State: Initialized, Role: FOLLOWER
I20260807 04:21:00.719913 27822 consensus_queue.cc:260] T 44caaae88ad04acab42675a88a17f8ae P 49f8f4f5ca5749e5a3adf48b1d354216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f8f4f5ca5749e5a3adf48b1d354216" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 41247 } } peers { permanent_uuid: "f575d20a70be462b80d211b3d6f252e8" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36385 } } peers { permanent_uuid: "4f54e7bc45014f94a4f0bf2331964b89" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39837 } }
I20260807 04:21:00.721853 27822 ts_tablet_manager.cc:1428] T 44caaae88ad04acab42675a88a17f8ae P 49f8f4f5ca5749e5a3adf48b1d354216: Time spent starting tablet: real 0.015s user 0.011s sys 0.004s
I20260807 04:21:00.723037 27824 raft_consensus.cc:348] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f8f4f5ca5749e5a3adf48b1d354216" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 41247 } } peers { permanent_uuid: "f575d20a70be462b80d211b3d6f252e8" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36385 } } peers { permanent_uuid: "4f54e7bc45014f94a4f0bf2331964b89" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39837 } }
I20260807 04:21:00.723517 27824 raft_consensus.cc:374] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:00.723636 27824 raft_consensus.cc:729] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f54e7bc45014f94a4f0bf2331964b89, State: Initialized, Role: FOLLOWER
I20260807 04:21:00.724284 27824 consensus_queue.cc:260] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f8f4f5ca5749e5a3adf48b1d354216" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 41247 } } peers { permanent_uuid: "f575d20a70be462b80d211b3d6f252e8" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36385 } } peers { permanent_uuid: "4f54e7bc45014f94a4f0bf2331964b89" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39837 } }
I20260807 04:21:00.725688 27802 heartbeater.cc:503] Master 127.7.200.254:39025 was elected leader, sending a full tablet report...
I20260807 04:21:00.725636 27825 raft_consensus.cc:348] T 44caaae88ad04acab42675a88a17f8ae P f575d20a70be462b80d211b3d6f252e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f8f4f5ca5749e5a3adf48b1d354216" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 41247 } } peers { permanent_uuid: "f575d20a70be462b80d211b3d6f252e8" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36385 } } peers { permanent_uuid: "4f54e7bc45014f94a4f0bf2331964b89" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39837 } }
I20260807 04:21:00.726109 27825 raft_consensus.cc:374] T 44caaae88ad04acab42675a88a17f8ae P f575d20a70be462b80d211b3d6f252e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:00.726163 27824 ts_tablet_manager.cc:1428] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89: Time spent starting tablet: real 0.012s user 0.009s sys 0.004s
I20260807 04:21:00.726231 27825 raft_consensus.cc:729] T 44caaae88ad04acab42675a88a17f8ae P f575d20a70be462b80d211b3d6f252e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f575d20a70be462b80d211b3d6f252e8, State: Initialized, Role: FOLLOWER
I20260807 04:21:00.726941 27825 consensus_queue.cc:260] T 44caaae88ad04acab42675a88a17f8ae P f575d20a70be462b80d211b3d6f252e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f8f4f5ca5749e5a3adf48b1d354216" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 41247 } } peers { permanent_uuid: "f575d20a70be462b80d211b3d6f252e8" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36385 } } peers { permanent_uuid: "4f54e7bc45014f94a4f0bf2331964b89" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39837 } }
I20260807 04:21:00.729743 27660 heartbeater.cc:503] Master 127.7.200.254:39025 was elected leader, sending a full tablet report...
I20260807 04:21:00.730424 27825 ts_tablet_manager.cc:1428] T 44caaae88ad04acab42675a88a17f8ae P f575d20a70be462b80d211b3d6f252e8: Time spent starting tablet: real 0.016s user 0.010s sys 0.005s
W20260807 04:21:00.754570 27661 tablet.cc:2369] T 44caaae88ad04acab42675a88a17f8ae P f575d20a70be462b80d211b3d6f252e8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:21:00.802704 27830 raft_consensus.cc:482] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:21:00.803085 27830 raft_consensus.cc:504] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f8f4f5ca5749e5a3adf48b1d354216" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 41247 } } peers { permanent_uuid: "f575d20a70be462b80d211b3d6f252e8" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36385 } } peers { permanent_uuid: "4f54e7bc45014f94a4f0bf2331964b89" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39837 } }
I20260807 04:21:00.805238 27830 leader_election.cc:288] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49f8f4f5ca5749e5a3adf48b1d354216 (127.7.200.193:41247), f575d20a70be462b80d211b3d6f252e8 (127.7.200.194:36385)
I20260807 04:21:00.813244 27817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:00.805680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:38991 (local address 127.7.200.193:41247)
0807 04:21:00.805908 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:00.805915 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:00.806184 (+ 269us) server_negotiation.cc:407] Connection header received
0807 04:21:00.806399 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:00.806404 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:00.806493 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:00.806606 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:21:00.807070 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.808276 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.810837 (+ 2561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.812171 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.812343 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:00.812418 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:00.812836 (+ 418us) server_negotiation.cc:299] Negotiation successful
0807 04:21:00.812981 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 04:21:00.813320 27805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:00.805687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:41247 (local address 127.7.200.195:38991)
0807 04:21:00.806028 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:00.806043 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:00.806215 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:00.806651 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:00.806657 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:00.806692 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:21:00.806907 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:00.806922 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.808417 (+ 1495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.808426 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:00.810662 (+ 2236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:00.810679 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.812359 (+ 1680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.812367 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:00.812614 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:00.812654 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 04:21:00.812805 (+ 151us) client_negotiation.cc:240] Negotiation successful
0807 04:21:00.812973 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221}
I20260807 04:21:00.814554 27821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:00.805832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:36467 (local address 127.7.200.194:36385)
0807 04:21:00.806101 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:00.806111 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:00.806742 (+ 631us) server_negotiation.cc:407] Connection header received
0807 04:21:00.807065 (+ 323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:00.807071 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:00.807164 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:00.807272 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:21:00.807843 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.808977 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.811570 (+ 2593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.812965 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.813139 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:00.813217 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:00.814154 (+ 937us) server_negotiation.cc:299] Negotiation successful
0807 04:21:00.814303 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 04:21:00.814668 27473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44caaae88ad04acab42675a88a17f8ae" candidate_uuid: "4f54e7bc45014f94a4f0bf2331964b89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49f8f4f5ca5749e5a3adf48b1d354216" is_pre_election: true
I20260807 04:21:00.814980 27832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:00.805775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:36385 (local address 127.7.200.195:36467)
0807 04:21:00.806640 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:00.806656 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:00.806866 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:00.807303 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:00.807307 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:00.807335 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:21:00.807680 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:00.807690 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.809160 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.809166 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:00.811404 (+ 2238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:00.811417 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.813761 (+ 2344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.813767 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:00.813903 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:00.813969 (+ 66us) client_negotiation.cc:769] Sending connection context
0807 04:21:00.814101 (+ 132us) client_negotiation.cc:240] Negotiation successful
0807 04:21:00.814278 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":731,"thread_start_us":449,"threads_started":1}
I20260807 04:21:00.815352 27473 raft_consensus.cc:2454] T 44caaae88ad04acab42675a88a17f8ae P 49f8f4f5ca5749e5a3adf48b1d354216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f54e7bc45014f94a4f0bf2331964b89 in term 0.
I20260807 04:21:00.816241 27684 leader_election.cc:302] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49f8f4f5ca5749e5a3adf48b1d354216, 4f54e7bc45014f94a4f0bf2331964b89; no voters:
I20260807 04:21:00.816717 27830 raft_consensus.cc:2781] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:21:00.816938 27830 raft_consensus.cc:482] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:21:00.816711 27613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44caaae88ad04acab42675a88a17f8ae" candidate_uuid: "4f54e7bc45014f94a4f0bf2331964b89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f575d20a70be462b80d211b3d6f252e8" is_pre_election: true
I20260807 04:21:00.817073 27830 raft_consensus.cc:3037] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:00.817443 27613 raft_consensus.cc:2454] T 44caaae88ad04acab42675a88a17f8ae P f575d20a70be462b80d211b3d6f252e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f54e7bc45014f94a4f0bf2331964b89 in term 0.
I20260807 04:21:00.819991 27830 raft_consensus.cc:504] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f8f4f5ca5749e5a3adf48b1d354216" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 41247 } } peers { permanent_uuid: "f575d20a70be462b80d211b3d6f252e8" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36385 } } peers { permanent_uuid: "4f54e7bc45014f94a4f0bf2331964b89" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39837 } }
I20260807 04:21:00.820706 27830 leader_election.cc:288] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89 [CANDIDATE]: Term 1 election: Requested vote from peers 49f8f4f5ca5749e5a3adf48b1d354216 (127.7.200.193:41247), f575d20a70be462b80d211b3d6f252e8 (127.7.200.194:36385)
I20260807 04:21:00.821285 27613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44caaae88ad04acab42675a88a17f8ae" candidate_uuid: "4f54e7bc45014f94a4f0bf2331964b89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f575d20a70be462b80d211b3d6f252e8"
I20260807 04:21:00.821262 27473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44caaae88ad04acab42675a88a17f8ae" candidate_uuid: "4f54e7bc45014f94a4f0bf2331964b89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49f8f4f5ca5749e5a3adf48b1d354216"
I20260807 04:21:00.821497 27473 raft_consensus.cc:3037] T 44caaae88ad04acab42675a88a17f8ae P 49f8f4f5ca5749e5a3adf48b1d354216 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:00.821514 27613 raft_consensus.cc:3037] T 44caaae88ad04acab42675a88a17f8ae P f575d20a70be462b80d211b3d6f252e8 [term 0 FOLLOWER]: Advancing to term 1
W20260807 04:21:00.822153 27803 tablet.cc:2369] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:21:00.824492 27613 raft_consensus.cc:2454] T 44caaae88ad04acab42675a88a17f8ae P f575d20a70be462b80d211b3d6f252e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f54e7bc45014f94a4f0bf2331964b89 in term 1.
I20260807 04:21:00.824862 27473 raft_consensus.cc:2454] T 44caaae88ad04acab42675a88a17f8ae P 49f8f4f5ca5749e5a3adf48b1d354216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f54e7bc45014f94a4f0bf2331964b89 in term 1.
I20260807 04:21:00.825135 27686 leader_election.cc:302] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f54e7bc45014f94a4f0bf2331964b89, f575d20a70be462b80d211b3d6f252e8; no voters:
I20260807 04:21:00.825500 27830 raft_consensus.cc:2781] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:21:00.826023 27830 raft_consensus.cc:686] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89 [term 1 LEADER]: Becoming Leader. State: Replica: 4f54e7bc45014f94a4f0bf2331964b89, State: Running, Role: LEADER
I20260807 04:21:00.826690 27830 consensus_queue.cc:237] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f8f4f5ca5749e5a3adf48b1d354216" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 41247 } } peers { permanent_uuid: "f575d20a70be462b80d211b3d6f252e8" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36385 } } peers { permanent_uuid: "4f54e7bc45014f94a4f0bf2331964b89" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39837 } }
I20260807 04:21:00.832312 27319 catalog_manager.cc:5495] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f54e7bc45014f94a4f0bf2331964b89 (127.7.200.195). New cstate: current_term: 1 leader_uuid: "4f54e7bc45014f94a4f0bf2331964b89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49f8f4f5ca5749e5a3adf48b1d354216" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 41247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f575d20a70be462b80d211b3d6f252e8" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f54e7bc45014f94a4f0bf2331964b89" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 39837 } health_report { overall_health: HEALTHY } } }
I20260807 04:21:00.884356 27819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:00.878620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40778 (local address 127.7.200.195:39837)
0807 04:21:00.878848 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:00.878855 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:00.878875 (+ 20us) server_negotiation.cc:407] Connection header received
0807 04:21:00.879016 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:00.879020 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:00.879115 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:00.879276 (+ 161us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:21:00.879693 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.880423 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.881890 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.882294 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.882435 (+ 141us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:00.883085 (+ 650us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:21:00.883634 (+ 549us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:21:00.883821 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:00.883985 (+ 164us) server_negotiation.cc:299] Negotiation successful
0807 04:21:00.884037 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 04:21:00.893168 27613 raft_consensus.cc:1261] T 44caaae88ad04acab42675a88a17f8ae P f575d20a70be462b80d211b3d6f252e8 [term 1 FOLLOWER]: Refusing update from remote peer 4f54e7bc45014f94a4f0bf2331964b89: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:21:00.893167 27473 raft_consensus.cc:1261] T 44caaae88ad04acab42675a88a17f8ae P 49f8f4f5ca5749e5a3adf48b1d354216 [term 1 FOLLOWER]: Refusing update from remote peer 4f54e7bc45014f94a4f0bf2331964b89: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:21:00.894295 27833 consensus_queue.cc:1035] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49f8f4f5ca5749e5a3adf48b1d354216" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 41247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:21:00.894738 27830 consensus_queue.cc:1035] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f575d20a70be462b80d211b3d6f252e8" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 36385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:21:00.911841 27837 mvcc.cc:205] Tried to move back new op lower bound from 7315769183807008768 to 7315769183550926848. Current Snapshot: MvccSnapshot[applied={T|T < 7315769183807008768 or (T in {7315769183807008768})}]
I20260807 04:21:00.921504 27319 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57712:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:21:00.921779 27319 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57712:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:21:00.925688 27319 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0a04c03685bf4e988f54405cb304a950: Sending DeleteTablet for 3 replicas of tablet 44caaae88ad04acab42675a88a17f8ae
I20260807 04:21:00.927060 27450 tablet_service.cc:1514] Processing DeleteTablet for tablet 44caaae88ad04acab42675a88a17f8ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:21:00 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:58194
I20260807 04:21:00.927073 27593 tablet_service.cc:1514] Processing DeleteTablet for tablet 44caaae88ad04acab42675a88a17f8ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:21:00 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:54690
I20260807 04:21:00.927249 27732 tablet_service.cc:1514] Processing DeleteTablet for tablet 44caaae88ad04acab42675a88a17f8ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:21:00 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:40770
I20260807 04:21:00.930173 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 27382
I20260807 04:21:00.942589 27846 tablet_replica.cc:330] T 44caaae88ad04acab42675a88a17f8ae P 49f8f4f5ca5749e5a3adf48b1d354216: stopping tablet replica
I20260807 04:21:00.943212 27846 raft_consensus.cc:2229] T 44caaae88ad04acab42675a88a17f8ae P 49f8f4f5ca5749e5a3adf48b1d354216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:21:00.943904 27846 raft_consensus.cc:2258] T 44caaae88ad04acab42675a88a17f8ae P 49f8f4f5ca5749e5a3adf48b1d354216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:21:00.946977 27846 ts_tablet_manager.cc:1905] T 44caaae88ad04acab42675a88a17f8ae P 49f8f4f5ca5749e5a3adf48b1d354216: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:21:00.957314 27846 ts_tablet_manager.cc:1918] T 44caaae88ad04acab42675a88a17f8ae P 49f8f4f5ca5749e5a3adf48b1d354216: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:21:00.957561 27846 log.cc:1196] T 44caaae88ad04acab42675a88a17f8ae P 49f8f4f5ca5749e5a3adf48b1d354216: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-0/wal/wals/44caaae88ad04acab42675a88a17f8ae
I20260807 04:21:00.958222 27846 ts_tablet_manager.cc:1939] T 44caaae88ad04acab42675a88a17f8ae P 49f8f4f5ca5749e5a3adf48b1d354216: Deleting consensus metadata
I20260807 04:21:00.960593 27303 catalog_manager.cc:4841] TS 49f8f4f5ca5749e5a3adf48b1d354216 (127.7.200.193:41247): tablet 44caaae88ad04acab42675a88a17f8ae (table test-table [id=0ae7d9eead924c00a2df1978f94b6fe4]) successfully deleted
I20260807 04:21:00.961437 27848 tablet_replica.cc:330] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89: stopping tablet replica
I20260807 04:21:00.961843 27847 tablet_replica.cc:330] T 44caaae88ad04acab42675a88a17f8ae P f575d20a70be462b80d211b3d6f252e8: stopping tablet replica
I20260807 04:21:00.962014 27848 raft_consensus.cc:2229] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89 [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:21:00.962272 27847 raft_consensus.cc:2229] T 44caaae88ad04acab42675a88a17f8ae P f575d20a70be462b80d211b3d6f252e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:21:00.962746 27848 raft_consensus.cc:2258] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:21:00.962853 27847 raft_consensus.cc:2258] T 44caaae88ad04acab42675a88a17f8ae P f575d20a70be462b80d211b3d6f252e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:21:00.965656 27848 ts_tablet_manager.cc:1905] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:21:00.966893 27847 ts_tablet_manager.cc:1905] T 44caaae88ad04acab42675a88a17f8ae P f575d20a70be462b80d211b3d6f252e8: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 07 04:21:00 dist-test-slave-qg60 krb5kdc[27271](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.193@KRBTEST.COM
I20260807 04:21:00.974148 27848 ts_tablet_manager.cc:1918] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:21:00.974416 27848 log.cc:1196] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-2/wal/wals/44caaae88ad04acab42675a88a17f8ae
I20260807 04:21:00.975108 27848 ts_tablet_manager.cc:1939] T 44caaae88ad04acab42675a88a17f8ae P 4f54e7bc45014f94a4f0bf2331964b89: Deleting consensus metadata
I20260807 04:21:00.975251 27847 ts_tablet_manager.cc:1918] T 44caaae88ad04acab42675a88a17f8ae P f575d20a70be462b80d211b3d6f252e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:21:00.975428 27847 log.cc:1196] T 44caaae88ad04acab42675a88a17f8ae P f575d20a70be462b80d211b3d6f252e8: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786076137270840-7971-0/minicluster-data/ts-1/wal/wals/44caaae88ad04acab42675a88a17f8ae
I20260807 04:21:00.976045 27847 ts_tablet_manager.cc:1939] T 44caaae88ad04acab42675a88a17f8ae P f575d20a70be462b80d211b3d6f252e8: Deleting consensus metadata
I20260807 04:21:00.977325 27302 catalog_manager.cc:4841] TS 4f54e7bc45014f94a4f0bf2331964b89 (127.7.200.195:39837): tablet 44caaae88ad04acab42675a88a17f8ae (table test-table [id=0ae7d9eead924c00a2df1978f94b6fe4]) successfully deleted
I20260807 04:21:00.978549 27305 catalog_manager.cc:4841] TS f575d20a70be462b80d211b3d6f252e8 (127.7.200.194:36385): tablet 44caaae88ad04acab42675a88a17f8ae (table test-table [id=0ae7d9eead924c00a2df1978f94b6fe4]) successfully deleted
I20260807 04:21:00.983671 27817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:00.932036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58200 (local address 127.7.200.193:41247)
0807 04:21:00.932290 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:00.932300 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:00.957551 (+ 25251us) server_negotiation.cc:407] Connection header received
0807 04:21:00.958274 (+ 723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:00.958284 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:00.958383 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:00.958480 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:00.961815 (+ 3335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.963075 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.965547 (+ 2472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:00.966283 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:00.966425 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:00.975523 (+ 9098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:00.975543 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:00.975564 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:00.975616 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:00.980094 (+ 4478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:00.981007 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:00.981018 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:00.981022 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:00.981212 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:00.981653 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:00.981659 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:00.981662 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:00.982319 (+ 657us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:00.982682 (+ 363us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:00.982920 (+ 238us) server_negotiation.cc:299] Negotiation successful
0807 04:21:00.983209 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 04:21:00.984442 27513 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:21:01.098608 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 27382
I20260807 04:21:01.126808 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 27525
Aug 07 04:21:01 dist-test-slave-qg60 krb5kdc[27271](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.194@KRBTEST.COM
I20260807 04:21:01.145468 27821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:01.127712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54696 (local address 127.7.200.194:36385)
0807 04:21:01.127910 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:01.127915 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:01.127933 (+ 18us) server_negotiation.cc:407] Connection header received
0807 04:21:01.128185 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:01.128190 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:01.128258 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:01.128348 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:01.130219 (+ 1871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:01.130980 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:01.133091 (+ 2111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:01.133476 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:01.133585 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:01.139308 (+ 5723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:01.139326 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:01.139342 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:01.139382 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:01.142390 (+ 3008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:01.143327 (+ 937us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:01.143335 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:01.143337 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:01.143471 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:01.143902 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:01.143905 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:01.143907 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:01.144327 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:01.144562 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:01.144969 (+ 407us) server_negotiation.cc:299] Negotiation successful
0807 04:21:01.145163 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 04:21:01.146265 27655 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:21:01.238417 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 27525
I20260807 04:21:01.265129 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 27667
Aug 07 04:21:01 dist-test-slave-qg60 krb5kdc[27271](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076458, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.195@KRBTEST.COM
I20260807 04:21:01.283211 27819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:01.266019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40782 (local address 127.7.200.195:39837)
0807 04:21:01.266233 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:01.266241 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:01.266273 (+ 32us) server_negotiation.cc:407] Connection header received
0807 04:21:01.266390 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:01.266402 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:01.266497 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:01.266631 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:01.267950 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:01.269269 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:01.270579 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:01.271294 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:01.271456 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:01.276581 (+ 5125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:01.276597 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:01.276613 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:01.276658 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:01.280055 (+ 3397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:01.281044 (+ 989us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:01.281052 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:01.281054 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:01.281215 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:01.281666 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:01.281672 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:01.281674 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:01.282040 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:01.282283 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:01.282696 (+ 413us) server_negotiation.cc:299] Negotiation successful
0807 04:21:01.282873 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 04:21:01.283953 27796 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:21:01.411556 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 27667
I20260807 04:21:01.434949 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 27285
I20260807 04:21:01.436247 27351 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:21:01.550971 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 27285
2026-08-07T04:21:01Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4741 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-07T04:21:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:21:01Z Disabled control of system clock
I20260807 04:21:01.650678 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:42981
--webserver_interface=127.7.200.254
--webserver_port=0
--builtin_ntp_servers=127.7.200.212:38387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:42981
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 04:21:02.003901 27859 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:02.004235 27859 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:02.004321 27859 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:02.011888 27859 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:21:02.012038 27859 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:02.012095 27859 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:02.012156 27859 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:21:02.012200 27859 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:21:02.021947 27859 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:38387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:42981
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:42981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:02.023279 27859 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:02.025172 27859 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:02.037437 27865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:02.037403 27867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:02.037480 27869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:02.038766 27859 server_base.cc:1034] running on GCE node
I20260807 04:21:02.039659 27859 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:02.041210 27859 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:02.042446 27859 hybrid_clock.cc:648] HybridClock initialized: now 1786076462042397 us; error 45 us; skew 500 ppm
I20260807 04:21:02.042806 27859 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 04:21:02.052312 27859 webserver.cc:460] Webserver started at http://127.7.200.254:33877/ using document root <none> and password file <none>
I20260807 04:21:02.053496 27859 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:02.053661 27859 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:02.054116 27859 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:02.057554 27859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "52f2065e0a88471cbe75f401c23ed826"
format_stamp: "Formatted at 2026-08-07 04:21:02 on dist-test-slave-qg60"
server_key: "1b4633c027298db134d9673379e0ba00"
server_key_iv: "783e934a9c011751898f3b5844b0f771"
server_key_version: "encryptionkey@0"
I20260807 04:21:02.058501 27859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "52f2065e0a88471cbe75f401c23ed826"
format_stamp: "Formatted at 2026-08-07 04:21:02 on dist-test-slave-qg60"
server_key: "1b4633c027298db134d9673379e0ba00"
server_key_iv: "783e934a9c011751898f3b5844b0f771"
server_key_version: "encryptionkey@0"
I20260807 04:21:02.064252 27859 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260807 04:21:02.068111 27876 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:02.069773 27859 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:21:02.069977 27859 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "52f2065e0a88471cbe75f401c23ed826"
format_stamp: "Formatted at 2026-08-07 04:21:02 on dist-test-slave-qg60"
server_key: "1b4633c027298db134d9673379e0ba00"
server_key_iv: "783e934a9c011751898f3b5844b0f771"
server_key_version: "encryptionkey@0"
I20260807 04:21:02.070279 27859 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:02.121908 27859 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:02.122866 27859 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:02.123200 27859 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:02.143816 27859 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:42981
I20260807 04:21:02.143862 27931 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:42981 every 8 connection(s)
I20260807 04:21:02.145335 27859 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:21:02.150419 27933 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:02.154079 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 27859
I20260807 04:21:02.154278 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:21:02.154762 7971 external_mini_cluster.cc:1428] Setting key 316c19ea0d03a79b1ef34d1953ca902a
I20260807 04:21:02.163260 27933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52f2065e0a88471cbe75f401c23ed826: Bootstrap starting.
I20260807 04:21:02.166759 27933 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 52f2065e0a88471cbe75f401c23ed826: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:02.167972 27933 log.cc:824] T 00000000000000000000000000000000 P 52f2065e0a88471cbe75f401c23ed826: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:02.168800 27936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:02.156919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59410 (local address 127.7.200.254:42981)
0807 04:21:02.157927 (+ 1008us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:02.157940 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:02.157982 (+ 42us) server_negotiation.cc:407] Connection header received
0807 04:21:02.159731 (+ 1749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:02.159756 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:02.160259 (+ 503us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:02.160680 (+ 421us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:02.161328 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:02.162592 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:02.164069 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:02.164854 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:02.165056 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:02.166313 (+ 1257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:02.166320 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:02.166334 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:02.166865 (+ 531us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:02.166984 (+ 119us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:02.167022 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:02.167161 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:02.167382 (+ 221us) server_negotiation.cc:299] Negotiation successful
0807 04:21:02.167701 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":595,"thread_start_us":337,"threads_started":1}
I20260807 04:21:02.171042 27933 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52f2065e0a88471cbe75f401c23ed826: No bootstrap required, opened a new log
I20260807 04:21:02.178941 27933 raft_consensus.cc:348] T 00000000000000000000000000000000 P 52f2065e0a88471cbe75f401c23ed826 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52f2065e0a88471cbe75f401c23ed826" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42981 } }
I20260807 04:21:02.179394 27933 raft_consensus.cc:374] T 00000000000000000000000000000000 P 52f2065e0a88471cbe75f401c23ed826 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:02.179522 27933 raft_consensus.cc:729] T 00000000000000000000000000000000 P 52f2065e0a88471cbe75f401c23ed826 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52f2065e0a88471cbe75f401c23ed826, State: Initialized, Role: FOLLOWER
I20260807 04:21:02.180106 27933 consensus_queue.cc:260] T 00000000000000000000000000000000 P 52f2065e0a88471cbe75f401c23ed826 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52f2065e0a88471cbe75f401c23ed826" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42981 } }
I20260807 04:21:02.180377 27933 raft_consensus.cc:388] T 00000000000000000000000000000000 P 52f2065e0a88471cbe75f401c23ed826 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:21:02.180526 27933 raft_consensus.cc:482] T 00000000000000000000000000000000 P 52f2065e0a88471cbe75f401c23ed826 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:21:02.180791 27933 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 52f2065e0a88471cbe75f401c23ed826 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:02.183203 27933 raft_consensus.cc:504] T 00000000000000000000000000000000 P 52f2065e0a88471cbe75f401c23ed826 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52f2065e0a88471cbe75f401c23ed826" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42981 } }
I20260807 04:21:02.183760 27933 leader_election.cc:302] T 00000000000000000000000000000000 P 52f2065e0a88471cbe75f401c23ed826 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 52f2065e0a88471cbe75f401c23ed826; no voters:
I20260807 04:21:02.184372 27933 leader_election.cc:288] T 00000000000000000000000000000000 P 52f2065e0a88471cbe75f401c23ed826 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:21:02.184523 27938 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 52f2065e0a88471cbe75f401c23ed826 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:21:02.185302 27938 raft_consensus.cc:686] T 00000000000000000000000000000000 P 52f2065e0a88471cbe75f401c23ed826 [term 1 LEADER]: Becoming Leader. State: Replica: 52f2065e0a88471cbe75f401c23ed826, State: Running, Role: LEADER
I20260807 04:21:02.185865 27938 consensus_queue.cc:237] T 00000000000000000000000000000000 P 52f2065e0a88471cbe75f401c23ed826 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52f2065e0a88471cbe75f401c23ed826" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42981 } }
I20260807 04:21:02.186602 27933 sys_catalog.cc:564] T 00000000000000000000000000000000 P 52f2065e0a88471cbe75f401c23ed826 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:21:02.189168 27940 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52f2065e0a88471cbe75f401c23ed826 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 52f2065e0a88471cbe75f401c23ed826. Latest consensus state: current_term: 1 leader_uuid: "52f2065e0a88471cbe75f401c23ed826" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52f2065e0a88471cbe75f401c23ed826" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42981 } } }
I20260807 04:21:02.189607 27940 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52f2065e0a88471cbe75f401c23ed826 [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:02.189093 27939 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52f2065e0a88471cbe75f401c23ed826 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "52f2065e0a88471cbe75f401c23ed826" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52f2065e0a88471cbe75f401c23ed826" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 42981 } } }
I20260807 04:21:02.190861 27939 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52f2065e0a88471cbe75f401c23ed826 [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:02.194725 27944 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:21:02.200541 27944 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:21:02.209600 27944 catalog_manager.cc:1347] Generated new cluster ID: e7a41dc00cb64aa3b3d182a51861a5e3
I20260807 04:21:02.209720 27944 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:21:02.232120 27944 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:21:02.234081 27944 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:21:02.250190 27944 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 52f2065e0a88471cbe75f401c23ed826: Generated new TSK 0
I20260807 04:21:02.251402 27944 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:21:02.266548 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:0
--local_ip_for_outbound_sockets=127.7.200.193
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:42981
--builtin_ntp_servers=127.7.200.212:38387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 04:21:02.621327 27957 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:02.621649 27957 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:02.621747 27957 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:02.630203 27957 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:02.630319 27957 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:02.630445 27957 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:21:02.641006 27957 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:38387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:42981
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:02.642390 27957 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:02.644362 27957 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:02.659416 27963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:02.659469 27962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:02.659421 27965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:02.660851 27957 server_base.cc:1034] running on GCE node
I20260807 04:21:02.661516 27957 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:02.662545 27957 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:02.663789 27957 hybrid_clock.cc:648] HybridClock initialized: now 1786076462663742 us; error 42 us; skew 500 ppm
I20260807 04:21:02.664130 27957 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 04:21:02.666613 27957 webserver.cc:460] Webserver started at http://127.7.200.193:45447/ using document root <none> and password file <none>
I20260807 04:21:02.667367 27957 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:02.667510 27957 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:02.667878 27957 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:02.671098 27957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-0/data/instance:
uuid: "0dfea8fa4bf148399d360ebd8ebc55ad"
format_stamp: "Formatted at 2026-08-07 04:21:02 on dist-test-slave-qg60"
server_key: "dbfaae65b355869ffb5e5d47b8a28e55"
server_key_iv: "3983aa3ae79476f36dc0d50268eca363"
server_key_version: "encryptionkey@0"
I20260807 04:21:02.671913 27957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance:
uuid: "0dfea8fa4bf148399d360ebd8ebc55ad"
format_stamp: "Formatted at 2026-08-07 04:21:02 on dist-test-slave-qg60"
server_key: "dbfaae65b355869ffb5e5d47b8a28e55"
server_key_iv: "3983aa3ae79476f36dc0d50268eca363"
server_key_version: "encryptionkey@0"
I20260807 04:21:02.677380 27957 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260807 04:21:02.681123 27971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:02.682482 27957 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 04:21:02.682659 27957 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "0dfea8fa4bf148399d360ebd8ebc55ad"
format_stamp: "Formatted at 2026-08-07 04:21:02 on dist-test-slave-qg60"
server_key: "dbfaae65b355869ffb5e5d47b8a28e55"
server_key_iv: "3983aa3ae79476f36dc0d50268eca363"
server_key_version: "encryptionkey@0"
I20260807 04:21:02.682889 27957 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:02.710702 27957 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:02.711658 27957 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:02.711988 27957 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:02.713122 27957 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:21:02.714713 27957 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:21:02.714830 27957 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:02.714977 27957 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:21:02.715093 27957 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:02.753814 27957 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:37009
I20260807 04:21:02.753904 28090 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:37009 every 8 connection(s)
I20260807 04:21:02.755208 27957 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:21:02.760865 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 27957
I20260807 04:21:02.761056 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance
I20260807 04:21:02.761536 7971 external_mini_cluster.cc:1428] Setting key f1d0844f997facb5d174776d9288a47f
I20260807 04:21:02.764639 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:0
--local_ip_for_outbound_sockets=127.7.200.194
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:42981
--builtin_ntp_servers=127.7.200.212:38387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 04:21:02.769095 28093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:02.757896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:47771 (local address 127.7.200.254:42981)
0807 04:21:02.758379 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:02.758386 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:02.759578 (+ 1192us) server_negotiation.cc:407] Connection header received
0807 04:21:02.761617 (+ 2039us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:02.761623 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:02.761719 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:02.761847 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:02.763150 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:02.764146 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:02.765853 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:02.766640 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:02.766792 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:02.768060 (+ 1268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:02.768068 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:02.768075 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:02.768102 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:02.768153 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:02.768171 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:02.768266 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:02.768467 (+ 201us) server_negotiation.cc:299] Negotiation successful
0807 04:21:02.768604 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":232,"threads_started":1}
I20260807 04:21:02.769982 28094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:02.758506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42981 (local address 127.7.200.193:47771)
0807 04:21:02.759415 (+ 909us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:02.759458 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:02.761333 (+ 1875us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:02.762034 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:02.762042 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:02.762185 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:21:02.762981 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:02.763006 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:02.764311 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:02.764315 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:02.765701 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:02.765714 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:02.766845 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:02.766850 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:02.767045 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:02.767746 (+ 701us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 04:21:02.767749 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:21:02.767787 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 04:21:02.767862 (+ 75us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:21:02.768270 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:21:02.768279 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:21:02.768285 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 04:21:02.768425 (+ 140us) client_negotiation.cc:240] Negotiation successful
0807 04:21:02.768788 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":284,"threads_started":1}
I20260807 04:21:02.771485 28091 heartbeater.cc:347] Connected to a master server at 127.7.200.254:42981
I20260807 04:21:02.771818 28091 heartbeater.cc:464] Registering TS with master...
I20260807 04:21:02.772716 28091 heartbeater.cc:511] Master 127.7.200.254:42981 requested a full tablet report, sending...
I20260807 04:21:02.774911 27894 ts_manager.cc:194] Registered new tserver with Master: 0dfea8fa4bf148399d360ebd8ebc55ad (127.7.200.193:37009)
I20260807 04:21:02.776451 27894 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.200.193:47771
W20260807 04:21:03.114148 28095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:03.114473 28095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:03.114617 28095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:03.122157 28095 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:03.122267 28095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:03.122437 28095 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:21:03.131740 28095 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:38387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:42981
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:03.133109 28095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:03.134924 28095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:03.150048 28101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:03.150810 28103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:03.151688 28100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:03.152570 28095 server_base.cc:1034] running on GCE node
I20260807 04:21:03.153586 28095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:03.155072 28095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:03.156327 28095 hybrid_clock.cc:648] HybridClock initialized: now 1786076463156239 us; error 73 us; skew 500 ppm
I20260807 04:21:03.156836 28095 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 04:21:03.159495 28095 webserver.cc:460] Webserver started at http://127.7.200.194:41255/ using document root <none> and password file <none>
I20260807 04:21:03.160231 28095 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:03.160323 28095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:03.160706 28095 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:03.164085 28095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-1/data/instance:
uuid: "8f24e671de7347da89bb27588060fc35"
format_stamp: "Formatted at 2026-08-07 04:21:03 on dist-test-slave-qg60"
server_key: "773eb5b9e32c1fddbdba70c88b43a7c5"
server_key_iv: "b1648b7f9ff47f8d166d177cbd178b1c"
server_key_version: "encryptionkey@0"
I20260807 04:21:03.165007 28095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance:
uuid: "8f24e671de7347da89bb27588060fc35"
format_stamp: "Formatted at 2026-08-07 04:21:03 on dist-test-slave-qg60"
server_key: "773eb5b9e32c1fddbdba70c88b43a7c5"
server_key_iv: "b1648b7f9ff47f8d166d177cbd178b1c"
server_key_version: "encryptionkey@0"
I20260807 04:21:03.170297 28095 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 04:21:03.173969 28109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:03.175359 28095 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:21:03.175570 28095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "8f24e671de7347da89bb27588060fc35"
format_stamp: "Formatted at 2026-08-07 04:21:03 on dist-test-slave-qg60"
server_key: "773eb5b9e32c1fddbdba70c88b43a7c5"
server_key_iv: "b1648b7f9ff47f8d166d177cbd178b1c"
server_key_version: "encryptionkey@0"
I20260807 04:21:03.175823 28095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:03.211635 28095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:03.212548 28095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:03.212896 28095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:03.214002 28095 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:21:03.215597 28095 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:21:03.215728 28095 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:03.215857 28095 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:21:03.215957 28095 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:03.251459 28095 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:40479
I20260807 04:21:03.251562 28225 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:40479 every 8 connection(s)
I20260807 04:21:03.252961 28095 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:21:03.261624 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 28095
I20260807 04:21:03.261818 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance
I20260807 04:21:03.262403 7971 external_mini_cluster.cc:1428] Setting key 5d149f93c90635f797905ae2a1698def
I20260807 04:21:03.265753 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:0
--local_ip_for_outbound_sockets=127.7.200.195
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:42981
--builtin_ntp_servers=127.7.200.212:38387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 04:21:03.267760 28093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:03.255915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:46187 (local address 127.7.200.254:42981)
0807 04:21:03.256159 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:03.256166 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:03.257801 (+ 1635us) server_negotiation.cc:407] Connection header received
0807 04:21:03.259738 (+ 1937us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:03.259742 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:03.259814 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:03.259908 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:03.261233 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:03.262363 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:03.264557 (+ 2194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:03.265167 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:03.265299 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:03.266778 (+ 1479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:03.266786 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:03.266793 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:03.266819 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:03.266863 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:03.266882 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:03.266982 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:03.267193 (+ 211us) server_negotiation.cc:299] Negotiation successful
0807 04:21:03.267318 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260807 04:21:03.268674 28228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:03.256496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42981 (local address 127.7.200.194:46187)
0807 04:21:03.257627 (+ 1131us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:03.257676 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:03.259468 (+ 1792us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:03.260207 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:03.260216 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:03.260308 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:21:03.261032 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:03.261054 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:03.262589 (+ 1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:03.262593 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:03.264386 (+ 1793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:03.264404 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:03.265379 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:03.265384 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:03.265606 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:03.266426 (+ 820us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 04:21:03.266429 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:21:03.266470 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 04:21:03.266560 (+ 90us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:21:03.266987 (+ 427us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:21:03.266994 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:21:03.267000 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 04:21:03.267147 (+ 147us) client_negotiation.cc:240] Negotiation successful
0807 04:21:03.267514 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":669,"thread_start_us":464,"threads_started":1}
I20260807 04:21:03.270226 28226 heartbeater.cc:347] Connected to a master server at 127.7.200.254:42981
I20260807 04:21:03.270571 28226 heartbeater.cc:464] Registering TS with master...
I20260807 04:21:03.271494 28226 heartbeater.cc:511] Master 127.7.200.254:42981 requested a full tablet report, sending...
I20260807 04:21:03.273211 27894 ts_manager.cc:194] Registered new tserver with Master: 8f24e671de7347da89bb27588060fc35 (127.7.200.194:40479)
I20260807 04:21:03.274060 27894 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.200.194:46187
W20260807 04:21:03.615834 28229 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:03.616151 28229 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:03.616304 28229 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:03.623987 28229 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:03.624114 28229 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:03.624298 28229 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:21:03.634479 28229 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:38387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:42981
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:03.635910 28229 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:03.637923 28229 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:03.652040 28234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:03.651937 28237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:03.651991 28235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:03.652765 28229 server_base.cc:1034] running on GCE node
I20260807 04:21:03.653451 28229 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:03.654636 28229 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:03.655884 28229 hybrid_clock.cc:648] HybridClock initialized: now 1786076463655835 us; error 42 us; skew 500 ppm
I20260807 04:21:03.656270 28229 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 04:21:03.658851 28229 webserver.cc:460] Webserver started at http://127.7.200.195:40305/ using document root <none> and password file <none>
I20260807 04:21:03.659618 28229 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:03.659744 28229 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:03.660107 28229 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:03.663209 28229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-2/data/instance:
uuid: "abed4c752f924762b8fb6ab89b9e99dd"
format_stamp: "Formatted at 2026-08-07 04:21:03 on dist-test-slave-qg60"
server_key: "4c0c638b5c2a97b225bcfd2dae903d12"
server_key_iv: "0bfc94bbbebeb195d7b6a4eb9848f553"
server_key_version: "encryptionkey@0"
I20260807 04:21:03.664238 28229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance:
uuid: "abed4c752f924762b8fb6ab89b9e99dd"
format_stamp: "Formatted at 2026-08-07 04:21:03 on dist-test-slave-qg60"
server_key: "4c0c638b5c2a97b225bcfd2dae903d12"
server_key_iv: "0bfc94bbbebeb195d7b6a4eb9848f553"
server_key_version: "encryptionkey@0"
I20260807 04:21:03.669778 28229 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260807 04:21:03.673738 28243 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:03.675174 28229 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:21:03.675364 28229 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "abed4c752f924762b8fb6ab89b9e99dd"
format_stamp: "Formatted at 2026-08-07 04:21:03 on dist-test-slave-qg60"
server_key: "4c0c638b5c2a97b225bcfd2dae903d12"
server_key_iv: "0bfc94bbbebeb195d7b6a4eb9848f553"
server_key_version: "encryptionkey@0"
I20260807 04:21:03.675617 28229 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:03.697448 28229 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:03.698318 28229 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:03.698640 28229 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:03.699674 28229 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:21:03.701292 28229 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:21:03.701383 28229 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:03.701545 28229 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:21:03.701639 28229 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:03.735519 28229 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:35633
I20260807 04:21:03.735630 28360 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:35633 every 8 connection(s)
I20260807 04:21:03.736999 28229 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:21:03.741963 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 28229
I20260807 04:21:03.742173 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance
I20260807 04:21:03.742712 7971 external_mini_cluster.cc:1428] Setting key 662649a17600bd980f96d70784ba1738
I20260807 04:21:03.750865 28093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:03.739910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:46425 (local address 127.7.200.254:42981)
0807 04:21:03.740109 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:03.740114 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:03.741606 (+ 1492us) server_negotiation.cc:407] Connection header received
0807 04:21:03.743820 (+ 2214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:03.743828 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:03.743923 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:03.744032 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:03.745231 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:03.746150 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:03.747754 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:03.748186 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:03.748327 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:03.749910 (+ 1583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:03.749915 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:03.749918 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:03.749938 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:03.749971 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:03.749984 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:03.750085 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:03.750374 (+ 289us) server_negotiation.cc:299] Negotiation successful
0807 04:21:03.750487 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 04:21:03.752010 28363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:03.740373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:42981 (local address 127.7.200.195:46425)
0807 04:21:03.741436 (+ 1063us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:03.741479 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:03.743538 (+ 2059us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:03.744269 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:03.744277 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:03.744366 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:21:03.745058 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:03.745081 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:03.746320 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:03.746324 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:03.747601 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:03.747614 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:03.748427 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:03.748434 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:03.748689 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:03.749526 (+ 837us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 04:21:03.749529 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:21:03.749573 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 04:21:03.749675 (+ 102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:21:03.750086 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:21:03.750135 (+ 49us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:21:03.750143 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 04:21:03.750341 (+ 198us) client_negotiation.cc:240] Negotiation successful
0807 04:21:03.750794 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":639,"thread_start_us":464,"threads_started":1}
I20260807 04:21:03.753949 28361 heartbeater.cc:347] Connected to a master server at 127.7.200.254:42981
I20260807 04:21:03.754324 28361 heartbeater.cc:464] Registering TS with master...
I20260807 04:21:03.755108 28361 heartbeater.cc:511] Master 127.7.200.254:42981 requested a full tablet report, sending...
I20260807 04:21:03.756904 27894 ts_manager.cc:194] Registered new tserver with Master: abed4c752f924762b8fb6ab89b9e99dd (127.7.200.195:35633)
I20260807 04:21:03.758013 27894 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.200.195:46425
I20260807 04:21:03.758551 7971 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 04:21:03.769752 28093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:03.763612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59484 (local address 127.7.200.254:42981)
0807 04:21:03.763783 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:03.763787 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:03.764234 (+ 447us) server_negotiation.cc:407] Connection header received
0807 04:21:03.764370 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:03.764373 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:03.764431 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:03.764513 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:03.765076 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:03.765780 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:03.767162 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:03.767590 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:03.767681 (+ 91us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:03.768956 (+ 1275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:03.768960 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:03.768964 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:03.768980 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:03.769027 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:03.769039 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:03.769150 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:03.769373 (+ 223us) server_negotiation.cc:299] Negotiation successful
0807 04:21:03.769453 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 04:21:03.779505 28091 heartbeater.cc:503] Master 127.7.200.254:42981 was elected leader, sending a full tablet report...
I20260807 04:21:03.773659 27894 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59484:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:21:03.781399 27894 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:21:03.819274 28378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:03.794538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37009 (local address 127.0.0.1:56306)
0807 04:21:03.809622 (+ 15084us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:03.809639 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:03.809782 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:03.810757 (+ 975us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:03.810765 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:03.810803 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:21:03.811562 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:03.811582 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:03.813457 (+ 1875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:03.813463 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:03.816104 (+ 2641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:03.816121 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:03.818044 (+ 1923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:03.818054 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:03.818314 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:03.818423 (+ 109us) client_negotiation.cc:769] Sending connection context
0807 04:21:03.818558 (+ 135us) client_negotiation.cc:240] Negotiation successful
0807 04:21:03.818771 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14981,"mutex_wait_us":30,"thread_start_us":14877,"threads_started":1}
I20260807 04:21:03.819981 28380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:03.795101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38022 (local address 127.7.200.195:35633)
0807 04:21:03.811710 (+ 16609us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:03.811722 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:03.811764 (+ 42us) server_negotiation.cc:407] Connection header received
0807 04:21:03.811887 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:03.811893 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:03.812201 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:03.812464 (+ 263us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:21:03.813080 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:03.814417 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:03.817025 (+ 2608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:03.817982 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:03.818462 (+ 480us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:03.818834 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:03.819397 (+ 563us) server_negotiation.cc:299] Negotiation successful
0807 04:21:03.819623 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16372,"thread_start_us":17638,"threads_started":1}
I20260807 04:21:03.820393 28374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:03.794132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:35633 (local address 127.0.0.1:38022)
0807 04:21:03.807810 (+ 13678us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:03.807832 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:03.807957 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:03.812456 (+ 4499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:03.812461 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:03.812487 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:21:03.812866 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:03.812879 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:03.814570 (+ 1691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:03.814576 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:03.816833 (+ 2257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:03.816845 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:03.818208 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:03.818215 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:03.818906 (+ 691us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:03.818949 (+ 43us) client_negotiation.cc:769] Sending connection context
0807 04:21:03.819039 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 04:21:03.819197 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13511,"mutex_wait_us":512,"thread_start_us":12128,"threads_started":1}
I20260807 04:21:03.820711 28379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:03.794914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56306 (local address 127.7.200.193:37009)
0807 04:21:03.809289 (+ 14375us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:03.809297 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:03.809758 (+ 461us) server_negotiation.cc:407] Connection header received
0807 04:21:03.809956 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:03.809963 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:03.810236 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:03.810447 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:21:03.811752 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:03.813246 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:03.816322 (+ 3076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:03.817814 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:03.817964 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:03.818242 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:03.820037 (+ 1795us) server_negotiation.cc:299] Negotiation successful
0807 04:21:03.820325 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14181,"thread_start_us":14035,"threads_started":1}
I20260807 04:21:03.824810 28375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:03.794000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:40479 (local address 127.0.0.1:56414)
0807 04:21:03.806814 (+ 12814us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:03.806874 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:03.807127 (+ 253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:03.814330 (+ 7203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:03.814335 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:03.814361 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:21:03.816546 (+ 2185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:03.816558 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:03.818559 (+ 2001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:03.818563 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:03.821804 (+ 3241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:03.821824 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:03.823935 (+ 2111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:03.823943 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:03.824128 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:03.824163 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 04:21:03.824264 (+ 101us) client_negotiation.cc:240] Negotiation successful
0807 04:21:03.824436 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12439,"mutex_wait_us":3,"thread_start_us":13756,"threads_started":1}
I20260807 04:21:03.824890 28377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:03.794201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56414 (local address 127.7.200.194:40479)
0807 04:21:03.813444 (+ 19243us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:03.813452 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:03.813481 (+ 29us) server_negotiation.cc:407] Connection header received
0807 04:21:03.813586 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:03.813593 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:03.813818 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:03.814033 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:21:03.816785 (+ 2752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:03.818355 (+ 1570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:03.822071 (+ 3716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:03.823682 (+ 1611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:03.823860 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:03.824122 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:03.824331 (+ 209us) server_negotiation.cc:299] Negotiation successful
0807 04:21:03.824515 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19054,"thread_start_us":18952,"threads_started":1}
I20260807 04:21:03.824338 28293 tablet_service.cc:1467] Processing CreateTablet for tablet a0d27ad6f52840a5bb25b87701ce2f87 (DEFAULT_TABLE table=test-table [id=ff4b81fa35304d218fa0f2b6e7fbef29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:21:03.824700 28022 tablet_service.cc:1467] Processing CreateTablet for tablet a0d27ad6f52840a5bb25b87701ce2f87 (DEFAULT_TABLE table=test-table [id=ff4b81fa35304d218fa0f2b6e7fbef29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:21:03.826150 28293 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0d27ad6f52840a5bb25b87701ce2f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:03.827189 28022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0d27ad6f52840a5bb25b87701ce2f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:03.829330 28158 tablet_service.cc:1467] Processing CreateTablet for tablet a0d27ad6f52840a5bb25b87701ce2f87 (DEFAULT_TABLE table=test-table [id=ff4b81fa35304d218fa0f2b6e7fbef29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:21:03.830928 28158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0d27ad6f52840a5bb25b87701ce2f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:03.838421 28381 tablet_bootstrap.cc:492] T a0d27ad6f52840a5bb25b87701ce2f87 P abed4c752f924762b8fb6ab89b9e99dd: Bootstrap starting.
I20260807 04:21:03.842439 28381 tablet_bootstrap.cc:654] T a0d27ad6f52840a5bb25b87701ce2f87 P abed4c752f924762b8fb6ab89b9e99dd: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:03.843704 28381 log.cc:824] T a0d27ad6f52840a5bb25b87701ce2f87 P abed4c752f924762b8fb6ab89b9e99dd: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:03.844410 28382 tablet_bootstrap.cc:492] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad: Bootstrap starting.
I20260807 04:21:03.847617 28384 tablet_bootstrap.cc:492] T a0d27ad6f52840a5bb25b87701ce2f87 P 8f24e671de7347da89bb27588060fc35: Bootstrap starting.
I20260807 04:21:03.851279 28381 tablet_bootstrap.cc:492] T a0d27ad6f52840a5bb25b87701ce2f87 P abed4c752f924762b8fb6ab89b9e99dd: No bootstrap required, opened a new log
I20260807 04:21:03.851356 28384 tablet_bootstrap.cc:654] T a0d27ad6f52840a5bb25b87701ce2f87 P 8f24e671de7347da89bb27588060fc35: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:03.851616 28381 ts_tablet_manager.cc:1397] T a0d27ad6f52840a5bb25b87701ce2f87 P abed4c752f924762b8fb6ab89b9e99dd: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.005s
I20260807 04:21:03.852173 28382 tablet_bootstrap.cc:654] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:03.852646 28384 log.cc:824] T a0d27ad6f52840a5bb25b87701ce2f87 P 8f24e671de7347da89bb27588060fc35: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:03.853519 28382 log.cc:824] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:03.856433 28384 tablet_bootstrap.cc:492] T a0d27ad6f52840a5bb25b87701ce2f87 P 8f24e671de7347da89bb27588060fc35: No bootstrap required, opened a new log
I20260807 04:21:03.856902 28384 ts_tablet_manager.cc:1397] T a0d27ad6f52840a5bb25b87701ce2f87 P 8f24e671de7347da89bb27588060fc35: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.006s
I20260807 04:21:03.866820 28384 raft_consensus.cc:348] T a0d27ad6f52840a5bb25b87701ce2f87 P 8f24e671de7347da89bb27588060fc35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f24e671de7347da89bb27588060fc35" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 40479 } } peers { permanent_uuid: "abed4c752f924762b8fb6ab89b9e99dd" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 35633 } } peers { permanent_uuid: "0dfea8fa4bf148399d360ebd8ebc55ad" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37009 } }
I20260807 04:21:03.866806 28381 raft_consensus.cc:348] T a0d27ad6f52840a5bb25b87701ce2f87 P abed4c752f924762b8fb6ab89b9e99dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f24e671de7347da89bb27588060fc35" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 40479 } } peers { permanent_uuid: "abed4c752f924762b8fb6ab89b9e99dd" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 35633 } } peers { permanent_uuid: "0dfea8fa4bf148399d360ebd8ebc55ad" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37009 } }
I20260807 04:21:03.867316 28381 raft_consensus.cc:374] T a0d27ad6f52840a5bb25b87701ce2f87 P abed4c752f924762b8fb6ab89b9e99dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:03.867314 28384 raft_consensus.cc:374] T a0d27ad6f52840a5bb25b87701ce2f87 P 8f24e671de7347da89bb27588060fc35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:03.867424 28381 raft_consensus.cc:729] T a0d27ad6f52840a5bb25b87701ce2f87 P abed4c752f924762b8fb6ab89b9e99dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abed4c752f924762b8fb6ab89b9e99dd, State: Initialized, Role: FOLLOWER
I20260807 04:21:03.867434 28384 raft_consensus.cc:729] T a0d27ad6f52840a5bb25b87701ce2f87 P 8f24e671de7347da89bb27588060fc35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f24e671de7347da89bb27588060fc35, State: Initialized, Role: FOLLOWER
I20260807 04:21:03.868191 28382 tablet_bootstrap.cc:492] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad: No bootstrap required, opened a new log
I20260807 04:21:03.868147 28381 consensus_queue.cc:260] T a0d27ad6f52840a5bb25b87701ce2f87 P abed4c752f924762b8fb6ab89b9e99dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f24e671de7347da89bb27588060fc35" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 40479 } } peers { permanent_uuid: "abed4c752f924762b8fb6ab89b9e99dd" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 35633 } } peers { permanent_uuid: "0dfea8fa4bf148399d360ebd8ebc55ad" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37009 } }
I20260807 04:21:03.868515 28382 ts_tablet_manager.cc:1397] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad: Time spent bootstrapping tablet: real 0.024s user 0.013s sys 0.004s
I20260807 04:21:03.868345 28384 consensus_queue.cc:260] T a0d27ad6f52840a5bb25b87701ce2f87 P 8f24e671de7347da89bb27588060fc35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f24e671de7347da89bb27588060fc35" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 40479 } } peers { permanent_uuid: "abed4c752f924762b8fb6ab89b9e99dd" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 35633 } } peers { permanent_uuid: "0dfea8fa4bf148399d360ebd8ebc55ad" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37009 } }
I20260807 04:21:03.869756 28226 heartbeater.cc:503] Master 127.7.200.254:42981 was elected leader, sending a full tablet report...
I20260807 04:21:03.870370 28384 ts_tablet_manager.cc:1428] T a0d27ad6f52840a5bb25b87701ce2f87 P 8f24e671de7347da89bb27588060fc35: Time spent starting tablet: real 0.013s user 0.010s sys 0.002s
I20260807 04:21:03.873746 28361 heartbeater.cc:503] Master 127.7.200.254:42981 was elected leader, sending a full tablet report...
I20260807 04:21:03.874375 28381 ts_tablet_manager.cc:1428] T a0d27ad6f52840a5bb25b87701ce2f87 P abed4c752f924762b8fb6ab89b9e99dd: Time spent starting tablet: real 0.023s user 0.012s sys 0.006s
I20260807 04:21:03.879588 28382 raft_consensus.cc:348] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f24e671de7347da89bb27588060fc35" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 40479 } } peers { permanent_uuid: "abed4c752f924762b8fb6ab89b9e99dd" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 35633 } } peers { permanent_uuid: "0dfea8fa4bf148399d360ebd8ebc55ad" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37009 } }
I20260807 04:21:03.880067 28382 raft_consensus.cc:374] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:03.880182 28382 raft_consensus.cc:729] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dfea8fa4bf148399d360ebd8ebc55ad, State: Initialized, Role: FOLLOWER
I20260807 04:21:03.880913 28382 consensus_queue.cc:260] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f24e671de7347da89bb27588060fc35" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 40479 } } peers { permanent_uuid: "abed4c752f924762b8fb6ab89b9e99dd" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 35633 } } peers { permanent_uuid: "0dfea8fa4bf148399d360ebd8ebc55ad" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37009 } }
I20260807 04:21:03.882440 28382 ts_tablet_manager.cc:1428] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad: Time spent starting tablet: real 0.014s user 0.016s sys 0.000s
W20260807 04:21:03.989032 28362 tablet.cc:2369] T a0d27ad6f52840a5bb25b87701ce2f87 P abed4c752f924762b8fb6ab89b9e99dd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 04:21:04.005275 28227 tablet.cc:2369] T a0d27ad6f52840a5bb25b87701ce2f87 P 8f24e671de7347da89bb27588060fc35: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 04:21:04.007732 28092 tablet.cc:2369] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:21:04.129967 28390 raft_consensus.cc:482] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:21:04.130261 28390 raft_consensus.cc:504] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f24e671de7347da89bb27588060fc35" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 40479 } } peers { permanent_uuid: "abed4c752f924762b8fb6ab89b9e99dd" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 35633 } } peers { permanent_uuid: "0dfea8fa4bf148399d360ebd8ebc55ad" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37009 } }
I20260807 04:21:04.132002 28390 leader_election.cc:288] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f24e671de7347da89bb27588060fc35 (127.7.200.194:40479), abed4c752f924762b8fb6ab89b9e99dd (127.7.200.195:35633)
I20260807 04:21:04.141897 28377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:04.132631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:33553 (local address 127.7.200.194:40479)
0807 04:21:04.132854 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:04.132861 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:04.133711 (+ 850us) server_negotiation.cc:407] Connection header received
0807 04:21:04.133993 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:04.134000 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:04.134103 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:04.134221 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:21:04.135126 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:04.136232 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:04.139321 (+ 3089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:04.140573 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:04.140788 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:04.140864 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:04.141497 (+ 633us) server_negotiation.cc:299] Negotiation successful
0807 04:21:04.141638 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 04:21:04.141978 28380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:04.132627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:46529 (local address 127.7.200.195:35633)
0807 04:21:04.132854 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:04.132861 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:04.133716 (+ 855us) server_negotiation.cc:407] Connection header received
0807 04:21:04.134040 (+ 324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:04.134045 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:04.134129 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:04.134221 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:21:04.135121 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:04.136280 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:04.139321 (+ 3041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:04.140644 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:04.140826 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:04.140890 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:04.141497 (+ 607us) server_negotiation.cc:299] Negotiation successful
0807 04:21:04.141638 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 04:21:04.142383 28392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:04.132340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:40479 (local address 127.7.200.193:33553)
0807 04:21:04.133536 (+ 1196us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:04.133557 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:04.133778 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:04.134282 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:04.134288 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:04.134338 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:21:04.134979 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:04.134993 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:04.136405 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:04.136409 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:04.139076 (+ 2667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:04.139085 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:04.140863 (+ 1778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:04.140872 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:04.141177 (+ 305us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:04.141322 (+ 145us) client_negotiation.cc:769] Sending connection context
0807 04:21:04.141422 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 04:21:04.141562 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1043,"mutex_wait_us":356,"spinlock_wait_cycles":49920,"thread_start_us":806,"threads_started":1}
I20260807 04:21:04.142407 28391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:04.132485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:35633 (local address 127.7.200.193:46529)
0807 04:21:04.133595 (+ 1110us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:04.133611 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:04.133740 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:04.134282 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:04.134288 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:04.134336 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:21:04.134864 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:04.134884 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:04.136404 (+ 1520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:04.136409 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:04.139070 (+ 2661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:04.139085 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:04.140879 (+ 1794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:04.140883 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:04.141180 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:04.141322 (+ 142us) client_negotiation.cc:769] Sending connection context
0807 04:21:04.141446 (+ 124us) client_negotiation.cc:240] Negotiation successful
0807 04:21:04.141560 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":999,"mutex_wait_us":255,"spinlock_wait_cycles":16000,"thread_start_us":596,"threads_started":1}
I20260807 04:21:04.143657 28316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0d27ad6f52840a5bb25b87701ce2f87" candidate_uuid: "0dfea8fa4bf148399d360ebd8ebc55ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abed4c752f924762b8fb6ab89b9e99dd" is_pre_election: true
I20260807 04:21:04.143688 28181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0d27ad6f52840a5bb25b87701ce2f87" candidate_uuid: "0dfea8fa4bf148399d360ebd8ebc55ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f24e671de7347da89bb27588060fc35" is_pre_election: true
I20260807 04:21:04.144253 28316 raft_consensus.cc:2454] T a0d27ad6f52840a5bb25b87701ce2f87 P abed4c752f924762b8fb6ab89b9e99dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0dfea8fa4bf148399d360ebd8ebc55ad in term 0.
I20260807 04:21:04.144434 28181 raft_consensus.cc:2454] T a0d27ad6f52840a5bb25b87701ce2f87 P 8f24e671de7347da89bb27588060fc35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0dfea8fa4bf148399d360ebd8ebc55ad in term 0.
I20260807 04:21:04.145188 27973 leader_election.cc:302] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfea8fa4bf148399d360ebd8ebc55ad, 8f24e671de7347da89bb27588060fc35; no voters:
I20260807 04:21:04.145609 28390 raft_consensus.cc:2781] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:21:04.145787 28390 raft_consensus.cc:482] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:21:04.145903 28390 raft_consensus.cc:3037] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:04.148094 28390 raft_consensus.cc:504] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f24e671de7347da89bb27588060fc35" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 40479 } } peers { permanent_uuid: "abed4c752f924762b8fb6ab89b9e99dd" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 35633 } } peers { permanent_uuid: "0dfea8fa4bf148399d360ebd8ebc55ad" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37009 } }
I20260807 04:21:04.148815 28390 leader_election.cc:288] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad [CANDIDATE]: Term 1 election: Requested vote from peers 8f24e671de7347da89bb27588060fc35 (127.7.200.194:40479), abed4c752f924762b8fb6ab89b9e99dd (127.7.200.195:35633)
I20260807 04:21:04.149278 28181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0d27ad6f52840a5bb25b87701ce2f87" candidate_uuid: "0dfea8fa4bf148399d360ebd8ebc55ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f24e671de7347da89bb27588060fc35"
I20260807 04:21:04.149358 28316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0d27ad6f52840a5bb25b87701ce2f87" candidate_uuid: "0dfea8fa4bf148399d360ebd8ebc55ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abed4c752f924762b8fb6ab89b9e99dd"
I20260807 04:21:04.149513 28181 raft_consensus.cc:3037] T a0d27ad6f52840a5bb25b87701ce2f87 P 8f24e671de7347da89bb27588060fc35 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:04.149571 28316 raft_consensus.cc:3037] T a0d27ad6f52840a5bb25b87701ce2f87 P abed4c752f924762b8fb6ab89b9e99dd [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:04.152874 28181 raft_consensus.cc:2454] T a0d27ad6f52840a5bb25b87701ce2f87 P 8f24e671de7347da89bb27588060fc35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dfea8fa4bf148399d360ebd8ebc55ad in term 1.
I20260807 04:21:04.152874 28316 raft_consensus.cc:2454] T a0d27ad6f52840a5bb25b87701ce2f87 P abed4c752f924762b8fb6ab89b9e99dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dfea8fa4bf148399d360ebd8ebc55ad in term 1.
I20260807 04:21:04.153312 27973 leader_election.cc:302] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dfea8fa4bf148399d360ebd8ebc55ad, 8f24e671de7347da89bb27588060fc35; no voters:
I20260807 04:21:04.153663 28390 raft_consensus.cc:2781] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:21:04.154168 28390 raft_consensus.cc:686] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad [term 1 LEADER]: Becoming Leader. State: Replica: 0dfea8fa4bf148399d360ebd8ebc55ad, State: Running, Role: LEADER
I20260807 04:21:04.154752 28390 consensus_queue.cc:237] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f24e671de7347da89bb27588060fc35" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 40479 } } peers { permanent_uuid: "abed4c752f924762b8fb6ab89b9e99dd" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 35633 } } peers { permanent_uuid: "0dfea8fa4bf148399d360ebd8ebc55ad" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37009 } }
I20260807 04:21:04.163296 27893 catalog_manager.cc:5495] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad reported cstate change: term changed from 0 to 1, leader changed from <none> to 0dfea8fa4bf148399d360ebd8ebc55ad (127.7.200.193). New cstate: current_term: 1 leader_uuid: "0dfea8fa4bf148399d360ebd8ebc55ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f24e671de7347da89bb27588060fc35" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 40479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abed4c752f924762b8fb6ab89b9e99dd" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 35633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dfea8fa4bf148399d360ebd8ebc55ad" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 37009 } health_report { overall_health: HEALTHY } } }
I20260807 04:21:04.192411 28379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:04.186445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56312 (local address 127.7.200.193:37009)
0807 04:21:04.186648 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:04.186655 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:04.186766 (+ 111us) server_negotiation.cc:407] Connection header received
0807 04:21:04.187088 (+ 322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:04.187092 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:04.187190 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:04.187387 (+ 197us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:21:04.187811 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:04.188492 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:04.190092 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:04.190544 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:04.190682 (+ 138us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:04.191307 (+ 625us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:21:04.191801 (+ 494us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:21:04.192015 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:04.192130 (+ 115us) server_negotiation.cc:299] Negotiation successful
0807 04:21:04.192175 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 04:21:04.201670 28181 raft_consensus.cc:1261] T a0d27ad6f52840a5bb25b87701ce2f87 P 8f24e671de7347da89bb27588060fc35 [term 1 FOLLOWER]: Refusing update from remote peer 0dfea8fa4bf148399d360ebd8ebc55ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:21:04.201673 28316 raft_consensus.cc:1261] T a0d27ad6f52840a5bb25b87701ce2f87 P abed4c752f924762b8fb6ab89b9e99dd [term 1 FOLLOWER]: Refusing update from remote peer 0dfea8fa4bf148399d360ebd8ebc55ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:21:04.202916 28390 consensus_queue.cc:1035] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f24e671de7347da89bb27588060fc35" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 40479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:21:04.203298 28393 consensus_queue.cc:1035] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "abed4c752f924762b8fb6ab89b9e99dd" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 35633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:21:04.216523 28397 mvcc.cc:205] Tried to move back new op lower bound from 7315769197358096384 to 7315769197182365696. Current Snapshot: MvccSnapshot[applied={T|T < 7315769197358096384}]
I20260807 04:21:04.216881 28396 mvcc.cc:205] Tried to move back new op lower bound from 7315769197358096384 to 7315769197182365696. Current Snapshot: MvccSnapshot[applied={T|T < 7315769197358096384}]
I20260807 04:21:04.229562 27894 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59484:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:21:04.229887 27894 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59484:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:21:04.234118 27894 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 52f2065e0a88471cbe75f401c23ed826: Sending DeleteTablet for 3 replicas of tablet a0d27ad6f52840a5bb25b87701ce2f87
I20260807 04:21:04.235409 28158 tablet_service.cc:1514] Processing DeleteTablet for tablet a0d27ad6f52840a5bb25b87701ce2f87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:21:04 UTC) from {username='slave'} at 127.0.0.1:56414
I20260807 04:21:04.235442 28293 tablet_service.cc:1514] Processing DeleteTablet for tablet a0d27ad6f52840a5bb25b87701ce2f87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:21:04 UTC) from {username='slave'} at 127.0.0.1:38022
I20260807 04:21:04.236194 28022 tablet_service.cc:1514] Processing DeleteTablet for tablet a0d27ad6f52840a5bb25b87701ce2f87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:21:04 UTC) from {username='slave'} at 127.0.0.1:56306
I20260807 04:21:04.236658 28405 tablet_replica.cc:330] T a0d27ad6f52840a5bb25b87701ce2f87 P abed4c752f924762b8fb6ab89b9e99dd: stopping tablet replica
I20260807 04:21:04.237329 28405 raft_consensus.cc:2229] T a0d27ad6f52840a5bb25b87701ce2f87 P abed4c752f924762b8fb6ab89b9e99dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:21:04.237958 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 27957
I20260807 04:21:04.237967 28405 raft_consensus.cc:2258] T a0d27ad6f52840a5bb25b87701ce2f87 P abed4c752f924762b8fb6ab89b9e99dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:21:04.238905 28406 tablet_replica.cc:330] T a0d27ad6f52840a5bb25b87701ce2f87 P 8f24e671de7347da89bb27588060fc35: stopping tablet replica
I20260807 04:21:04.239418 28406 raft_consensus.cc:2229] T a0d27ad6f52840a5bb25b87701ce2f87 P 8f24e671de7347da89bb27588060fc35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:21:04.240089 28406 raft_consensus.cc:2258] T a0d27ad6f52840a5bb25b87701ce2f87 P 8f24e671de7347da89bb27588060fc35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:21:04.242352 28405 ts_tablet_manager.cc:1905] T a0d27ad6f52840a5bb25b87701ce2f87 P abed4c752f924762b8fb6ab89b9e99dd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:21:04.245643 28406 ts_tablet_manager.cc:1905] T a0d27ad6f52840a5bb25b87701ce2f87 P 8f24e671de7347da89bb27588060fc35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:21:04.247328 28407 tablet_replica.cc:330] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad: stopping tablet replica
I20260807 04:21:04.247808 28407 raft_consensus.cc:2229] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:21:04.248505 28407 raft_consensus.cc:2258] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:21:04.250744 28379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:04.239855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56316 (local address 127.7.200.193:37009)
0807 04:21:04.240041 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:04.240049 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:04.241638 (+ 1589us) server_negotiation.cc:407] Connection header received
0807 04:21:04.241945 (+ 307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:04.241952 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:04.242091 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:04.242171 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:04.242891 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:04.244122 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:04.246135 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:04.246876 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:04.246983 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:04.248870 (+ 1887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:04.248900 (+ 30us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:04.248917 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:04.249729 (+ 812us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:04.249797 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:04.249827 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:04.249925 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:04.250214 (+ 289us) server_negotiation.cc:299] Negotiation successful
0807 04:21:04.250331 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 04:21:04.252244 28086 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:21:04.254347 28406 ts_tablet_manager.cc:1918] T a0d27ad6f52840a5bb25b87701ce2f87 P 8f24e671de7347da89bb27588060fc35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:21:04.254567 28406 log.cc:1196] T a0d27ad6f52840a5bb25b87701ce2f87 P 8f24e671de7347da89bb27588060fc35: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-1/wal/wals/a0d27ad6f52840a5bb25b87701ce2f87
I20260807 04:21:04.255219 28406 ts_tablet_manager.cc:1939] T a0d27ad6f52840a5bb25b87701ce2f87 P 8f24e671de7347da89bb27588060fc35: Deleting consensus metadata
I20260807 04:21:04.257493 27878 catalog_manager.cc:4841] TS 8f24e671de7347da89bb27588060fc35 (127.7.200.194:40479): tablet a0d27ad6f52840a5bb25b87701ce2f87 (table test-table [id=ff4b81fa35304d218fa0f2b6e7fbef29]) successfully deleted
I20260807 04:21:04.258181 28405 ts_tablet_manager.cc:1918] T a0d27ad6f52840a5bb25b87701ce2f87 P abed4c752f924762b8fb6ab89b9e99dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:21:04.258435 28405 log.cc:1196] T a0d27ad6f52840a5bb25b87701ce2f87 P abed4c752f924762b8fb6ab89b9e99dd: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786076137270840-7971-0/minicluster-data/ts-2/wal/wals/a0d27ad6f52840a5bb25b87701ce2f87
I20260807 04:21:04.259090 28405 ts_tablet_manager.cc:1939] T a0d27ad6f52840a5bb25b87701ce2f87 P abed4c752f924762b8fb6ab89b9e99dd: Deleting consensus metadata
I20260807 04:21:04.261345 27880 catalog_manager.cc:4841] TS abed4c752f924762b8fb6ab89b9e99dd (127.7.200.195:35633): tablet a0d27ad6f52840a5bb25b87701ce2f87 (table test-table [id=ff4b81fa35304d218fa0f2b6e7fbef29]) successfully deleted
I20260807 04:21:04.258620 28407 ts_tablet_manager.cc:1905] T a0d27ad6f52840a5bb25b87701ce2f87 P 0dfea8fa4bf148399d360ebd8ebc55ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:21:04.355970 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 27957
I20260807 04:21:04.376642 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 28095
W20260807 04:21:04.376726 27879 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.200.193:37009 (error 108)
I20260807 04:21:04.378788 28411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:04.378037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37009 (local address 127.0.0.1:56328)
0807 04:21:04.378497 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:04.378617 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:37009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":253,"threads_started":1}
W20260807 04:21:04.379001 27879 catalog_manager.cc:4584] TS 0dfea8fa4bf148399d360ebd8ebc55ad (127.7.200.193:37009): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a0d27ad6f52840a5bb25b87701ce2f87: Network error: Client connection negotiation failed: client connection to 127.7.200.193:37009: connect: Connection refused (error 111)
I20260807 04:21:04.384439 28377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:04.377873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56416 (local address 127.7.200.194:40479)
0807 04:21:04.378059 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:04.378063 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:04.378098 (+ 35us) server_negotiation.cc:407] Connection header received
0807 04:21:04.378154 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:04.378157 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:04.378244 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:04.378365 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:04.378849 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:04.379860 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:04.381425 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:04.381863 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:04.381997 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:04.383025 (+ 1028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:04.383034 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:04.383049 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:04.383646 (+ 597us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:04.383694 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:04.383714 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:04.383848 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:04.383984 (+ 136us) server_negotiation.cc:299] Negotiation successful
0807 04:21:04.384104 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 04:21:04.385149 28221 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:21:04.432595 28411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:04.432126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37009 (local address 127.0.0.1:56338)
0807 04:21:04.432348 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:04.432436 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:37009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260807 04:21:04.433728 28411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:04.433346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37009 (local address 127.0.0.1:56346)
0807 04:21:04.433522 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:04.433597 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:37009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260807 04:21:04.475163 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 28095
I20260807 04:21:04.494557 28411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:04.493951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37009 (local address 127.0.0.1:56360)
0807 04:21:04.494218 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:04.494348 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:37009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260807 04:21:04.495795 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 28229
I20260807 04:21:04.495901 28411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:04.495344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37009 (local address 127.0.0.1:56366)
0807 04:21:04.495641 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:04.495726 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:37009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175}
I20260807 04:21:04.503038 28380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:04.496640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38030 (local address 127.7.200.195:35633)
0807 04:21:04.496852 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:04.496858 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:04.496879 (+ 21us) server_negotiation.cc:407] Connection header received
0807 04:21:04.497088 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:04.497092 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:04.497182 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:04.497301 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:04.497713 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:04.498481 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:04.499824 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:04.500235 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:04.500375 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:04.501611 (+ 1236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:04.501620 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:04.501636 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:04.502240 (+ 604us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:04.502289 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:04.502309 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:04.502445 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:04.502583 (+ 138us) server_negotiation.cc:299] Negotiation successful
0807 04:21:04.502703 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260807 04:21:04.503747 28356 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:21:04.576709 28411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:04.576147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37009 (local address 127.0.0.1:56378)
0807 04:21:04.576368 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:04.576483 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:37009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260807 04:21:04.577972 28411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:04.577472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:37009 (local address 127.0.0.1:56392)
0807 04:21:04.577704 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:04.577802 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:37009: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130}
I20260807 04:21:04.594321 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 28229
I20260807 04:21:04.613621 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 27859
I20260807 04:21:04.614851 27927 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:21:04.726836 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 27859
2026-08-07T04:21:04Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (3175 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:21:04 dist-test-slave-qg60 krb5kdc[28418](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:21:04 dist-test-slave-qg60 krb5kdc[28418](info): set up 2 sockets
Aug 07 04:21:04 dist-test-slave-qg60 krb5kdc[28418](info): commencing operation
krb5kdc: starting...
W20260807 04:21:05.909508 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.134s user 0.003s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:21:06 dist-test-slave-qg60 krb5kdc[28418](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:21:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:21:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
I20260807 04:21:06.250522 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:37243
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:36711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:37243
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:21:06.601670 28432 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:06.601980 28432 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:06.602166 28432 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:06.609680 28432 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:21:06.609800 28432 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:06.609929 28432 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:06.610029 28432 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:21:06.610095 28432 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:21:06.620255 28432 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:36711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:37243
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:37243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:06.621690 28432 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:06.623111 28432 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:06.635555 28441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:06.635608 28438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:06.635663 28439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:06.636965 28432 server_base.cc:1034] running on GCE node
I20260807 04:21:06.637785 28432 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:06.639290 28432 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:06.640559 28432 hybrid_clock.cc:648] HybridClock initialized: now 1786076466640518 us; error 56 us; skew 500 ppm
I20260807 04:21:06.641059 28432 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:21:06 dist-test-slave-qg60 krb5kdc[28418](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076466, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:21:06.644340 28432 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:21:06.646364 28432 webserver.cc:460] Webserver started at http://127.7.200.254:35797/ using document root <none> and password file <none>
I20260807 04:21:06.647200 28432 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:06.647368 28432 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:06.647732 28432 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:06.651415 28432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "e3e7d59dd09a4d91b7fb4cd9c278ab24"
format_stamp: "Formatted at 2026-08-07 04:21:06 on dist-test-slave-qg60"
server_key: "5c7e410939470ab8ac2f5f288cfb200e"
server_key_iv: "12e1c8e513e44e23312d9275e307fa77"
server_key_version: "encryptionkey@0"
I20260807 04:21:06.652338 28432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "e3e7d59dd09a4d91b7fb4cd9c278ab24"
format_stamp: "Formatted at 2026-08-07 04:21:06 on dist-test-slave-qg60"
server_key: "5c7e410939470ab8ac2f5f288cfb200e"
server_key_iv: "12e1c8e513e44e23312d9275e307fa77"
server_key_version: "encryptionkey@0"
I20260807 04:21:06.658353 28432 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.004s
I20260807 04:21:06.662323 28449 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:06.663803 28432 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260807 04:21:06.664028 28432 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "e3e7d59dd09a4d91b7fb4cd9c278ab24"
format_stamp: "Formatted at 2026-08-07 04:21:06 on dist-test-slave-qg60"
server_key: "5c7e410939470ab8ac2f5f288cfb200e"
server_key_iv: "12e1c8e513e44e23312d9275e307fa77"
server_key_version: "encryptionkey@0"
I20260807 04:21:06.664248 28432 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:06.684478 28432 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:06.689189 28432 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:06.689496 28432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:06.709045 28432 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:37243
I20260807 04:21:06.709065 28502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:37243 every 8 connection(s)
I20260807 04:21:06.710485 28432 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:21:06.713696 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 28432
I20260807 04:21:06.713898 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:21:06.714325 7971 external_mini_cluster.cc:1428] Setting key 76546b23136d209286057502a6d10a24
I20260807 04:21:06.714529 28503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:06.727167 28503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3e7d59dd09a4d91b7fb4cd9c278ab24: Bootstrap starting.
Aug 07 04:21:06 dist-test-slave-qg60 krb5kdc[28418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:21:06.730952 28503 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e3e7d59dd09a4d91b7fb4cd9c278ab24: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:06.732057 28503 log.cc:824] T 00000000000000000000000000000000 P e3e7d59dd09a4d91b7fb4cd9c278ab24: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:06.735481 28503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3e7d59dd09a4d91b7fb4cd9c278ab24: No bootstrap required, opened a new log
I20260807 04:21:06.738396 28507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:06.716343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59578 (local address 127.7.200.254:37243)
0807 04:21:06.717190 (+ 847us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:06.717202 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:06.717241 (+ 39us) server_negotiation.cc:407] Connection header received
0807 04:21:06.719295 (+ 2054us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:06.719317 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:06.719731 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:06.720142 (+ 411us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:06.721749 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:06.723010 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:06.724369 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:06.725169 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:06.725413 (+ 244us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:06.730302 (+ 4889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:06.730310 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:06.730323 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:06.730359 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:06.733988 (+ 3629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:06.734861 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:06.734866 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:06.734872 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:06.735031 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:06.735500 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:06.735509 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:06.735511 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:06.736182 (+ 671us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:06.736429 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:06.736975 (+ 546us) server_negotiation.cc:299] Negotiation successful
0807 04:21:06.737338 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":611,"thread_start_us":408,"threads_started":1}
I20260807 04:21:06.744478 28503 raft_consensus.cc:348] T 00000000000000000000000000000000 P e3e7d59dd09a4d91b7fb4cd9c278ab24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3e7d59dd09a4d91b7fb4cd9c278ab24" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 37243 } }
I20260807 04:21:06.744904 28503 raft_consensus.cc:374] T 00000000000000000000000000000000 P e3e7d59dd09a4d91b7fb4cd9c278ab24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:06.745021 28503 raft_consensus.cc:729] T 00000000000000000000000000000000 P e3e7d59dd09a4d91b7fb4cd9c278ab24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3e7d59dd09a4d91b7fb4cd9c278ab24, State: Initialized, Role: FOLLOWER
I20260807 04:21:06.745710 28503 consensus_queue.cc:260] T 00000000000000000000000000000000 P e3e7d59dd09a4d91b7fb4cd9c278ab24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3e7d59dd09a4d91b7fb4cd9c278ab24" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 37243 } }
I20260807 04:21:06.746023 28503 raft_consensus.cc:388] T 00000000000000000000000000000000 P e3e7d59dd09a4d91b7fb4cd9c278ab24 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:21:06.746210 28503 raft_consensus.cc:482] T 00000000000000000000000000000000 P e3e7d59dd09a4d91b7fb4cd9c278ab24 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:21:06.746418 28503 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e3e7d59dd09a4d91b7fb4cd9c278ab24 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:06.749773 28503 raft_consensus.cc:504] T 00000000000000000000000000000000 P e3e7d59dd09a4d91b7fb4cd9c278ab24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3e7d59dd09a4d91b7fb4cd9c278ab24" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 37243 } }
I20260807 04:21:06.750507 28503 leader_election.cc:302] T 00000000000000000000000000000000 P e3e7d59dd09a4d91b7fb4cd9c278ab24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e3e7d59dd09a4d91b7fb4cd9c278ab24; no voters:
I20260807 04:21:06.751255 28503 leader_election.cc:288] T 00000000000000000000000000000000 P e3e7d59dd09a4d91b7fb4cd9c278ab24 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:21:06.751410 28509 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e3e7d59dd09a4d91b7fb4cd9c278ab24 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:21:06.752133 28509 raft_consensus.cc:686] T 00000000000000000000000000000000 P e3e7d59dd09a4d91b7fb4cd9c278ab24 [term 1 LEADER]: Becoming Leader. State: Replica: e3e7d59dd09a4d91b7fb4cd9c278ab24, State: Running, Role: LEADER
I20260807 04:21:06.752758 28509 consensus_queue.cc:237] T 00000000000000000000000000000000 P e3e7d59dd09a4d91b7fb4cd9c278ab24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3e7d59dd09a4d91b7fb4cd9c278ab24" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 37243 } }
I20260807 04:21:06.753799 28503 sys_catalog.cc:564] T 00000000000000000000000000000000 P e3e7d59dd09a4d91b7fb4cd9c278ab24 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:21:06.755947 28511 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3e7d59dd09a4d91b7fb4cd9c278ab24 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e3e7d59dd09a4d91b7fb4cd9c278ab24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3e7d59dd09a4d91b7fb4cd9c278ab24" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 37243 } } }
I20260807 04:21:06.756431 28511 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3e7d59dd09a4d91b7fb4cd9c278ab24 [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:06.757315 28512 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3e7d59dd09a4d91b7fb4cd9c278ab24 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3e7d59dd09a4d91b7fb4cd9c278ab24. Latest consensus state: current_term: 1 leader_uuid: "e3e7d59dd09a4d91b7fb4cd9c278ab24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3e7d59dd09a4d91b7fb4cd9c278ab24" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 37243 } } }
I20260807 04:21:06.757686 28512 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3e7d59dd09a4d91b7fb4cd9c278ab24 [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:06.762094 28517 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:21:06.767676 28517 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:21:06.777383 28517 catalog_manager.cc:1347] Generated new cluster ID: baf6b510521f4a618c424d2e42c51f7b
I20260807 04:21:06.777508 28517 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:21:06.791321 28517 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:21:06.792613 28517 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:21:06.799672 28517 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e3e7d59dd09a4d91b7fb4cd9c278ab24: Generated new TSK 0
I20260807 04:21:06.800714 28517 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.7.200.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
Entry for principal kudu/127.7.200.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab.
I20260807 04:21:06.886575 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:0
--local_ip_for_outbound_sockets=127.7.200.193
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:37243
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:36711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:21:07.243295 28532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:07.243579 28532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:07.243741 28532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:07.251338 28532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:07.251461 28532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:07.251631 28532 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:21:07.262266 28532 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:36711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.193.keytab
--principal=kudu/127.7.200.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:37243
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:07.263680 28532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:07.265085 28532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:07.278980 28540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:07.278942 28538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:07.279249 28537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:07.279886 28532 server_base.cc:1034] running on GCE node
I20260807 04:21:07.280503 28532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:07.281530 28532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:07.282764 28532 hybrid_clock.cc:648] HybridClock initialized: now 1786076467282713 us; error 42 us; skew 500 ppm
I20260807 04:21:07.283092 28532 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:21:07 dist-test-slave-qg60 krb5kdc[28418](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076467, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:21:07.291642 28532 init.cc:377] Logged in from keytab as kudu/127.7.200.193@KRBTEST.COM (short username kudu)
I20260807 04:21:07.293337 28532 webserver.cc:460] Webserver started at http://127.7.200.193:34077/ using document root <none> and password file <none>
I20260807 04:21:07.294018 28532 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:07.294139 28532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:07.294457 28532 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:07.297560 28532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-0/data/instance:
uuid: "8fd1e88ebc68479dade8947c432ee4b7"
format_stamp: "Formatted at 2026-08-07 04:21:07 on dist-test-slave-qg60"
server_key: "a0ffc547aad1651617a250a6b4ce2597"
server_key_iv: "92a8ce52b5f9da299640019b2079a847"
server_key_version: "encryptionkey@0"
I20260807 04:21:07.298336 28532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance:
uuid: "8fd1e88ebc68479dade8947c432ee4b7"
format_stamp: "Formatted at 2026-08-07 04:21:07 on dist-test-slave-qg60"
server_key: "a0ffc547aad1651617a250a6b4ce2597"
server_key_iv: "92a8ce52b5f9da299640019b2079a847"
server_key_version: "encryptionkey@0"
I20260807 04:21:07.303889 28532 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 04:21:07.307534 28547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:07.308997 28532 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 04:21:07.309188 28532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "8fd1e88ebc68479dade8947c432ee4b7"
format_stamp: "Formatted at 2026-08-07 04:21:07 on dist-test-slave-qg60"
server_key: "a0ffc547aad1651617a250a6b4ce2597"
server_key_iv: "92a8ce52b5f9da299640019b2079a847"
server_key_version: "encryptionkey@0"
I20260807 04:21:07.309408 28532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:07.331519 28532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:07.336036 28532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:07.336344 28532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:07.337399 28532 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:21:07.338769 28532 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:21:07.338848 28532 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:07.338989 28532 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:21:07.339054 28532 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:07.374375 28532 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:43407
I20260807 04:21:07.374475 28667 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:43407 every 8 connection(s)
I20260807 04:21:07.375792 28532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:21:07.381181 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 28532
I20260807 04:21:07.381385 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance
I20260807 04:21:07.381990 7971 external_mini_cluster.cc:1428] Setting key 8ad5ef6d80fb4f3c3d887a8c9ee40fbd
Aug 07 04:21:07 dist-test-slave-qg60 krb5kdc[28418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076467, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.193@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:21:07.400789 28670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:07.378806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:51613 (local address 127.7.200.254:37243)
0807 04:21:07.379330 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:07.379335 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:07.380267 (+ 932us) server_negotiation.cc:407] Connection header received
0807 04:21:07.383155 (+ 2888us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:07.383162 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:07.383260 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:07.383380 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:07.385612 (+ 2232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:07.386369 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:07.388905 (+ 2536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:07.389316 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:07.389421 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:07.394207 (+ 4786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:07.394212 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:07.394216 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:07.394253 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:07.397239 (+ 2986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:07.398151 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:07.398156 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:07.398158 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:07.398301 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:07.398817 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:07.398822 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:07.398824 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:07.399112 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:07.399288 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:07.400075 (+ 787us) server_negotiation.cc:299] Negotiation successful
0807 04:21:07.400334 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":250,"threads_started":1}
I20260807 04:21:07.401899 28671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:07.379355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:37243 (local address 127.7.200.193:51613)
0807 04:21:07.380100 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:07.380140 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:07.382600 (+ 2460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:07.383651 (+ 1051us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:07.383661 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:07.384508 (+ 847us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:21:07.385402 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:07.385432 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:07.386533 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:07.386542 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:07.388719 (+ 2177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:07.388767 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:07.389556 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:07.389565 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:07.389920 (+ 355us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:07.390702 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:21:07.390770 (+ 68us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:21:07.393911 (+ 3141us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:21:07.397398 (+ 3487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:07.397408 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:07.397426 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:07.397990 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:07.398429 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:07.398437 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:07.398441 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:07.398672 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:07.399258 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:21:07.399267 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:21:07.399653 (+ 386us) client_negotiation.cc:769] Sending connection context
0807 04:21:07.399952 (+ 299us) client_negotiation.cc:240] Negotiation successful
0807 04:21:07.400563 (+ 611us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":298,"threads_started":1}
I20260807 04:21:07.403692 28668 heartbeater.cc:347] Connected to a master server at 127.7.200.254:37243
I20260807 04:21:07.404039 28668 heartbeater.cc:464] Registering TS with master...
I20260807 04:21:07.404920 28668 heartbeater.cc:511] Master 127.7.200.254:37243 requested a full tablet report, sending...
I20260807 04:21:07.407240 28468 ts_manager.cc:194] Registered new tserver with Master: 8fd1e88ebc68479dade8947c432ee4b7 (127.7.200.193:43407)
I20260807 04:21:07.408802 28468 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.193@KRBTEST.COM'} at 127.7.200.193:51613
WARNING: no policy specified for kudu/127.7.200.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
Entry for principal kudu/127.7.200.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab.
I20260807 04:21:07.456568 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:0
--local_ip_for_outbound_sockets=127.7.200.194
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:37243
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:36711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:21:07.802316 28674 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:07.802662 28674 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:07.802837 28674 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:07.810731 28674 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:07.810899 28674 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:07.811077 28674 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:21:07.821650 28674 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:36711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.194.keytab
--principal=kudu/127.7.200.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:37243
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:07.823115 28674 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:07.824466 28674 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:07.838661 28679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:07.838570 28680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:07.838604 28682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:07.839941 28674 server_base.cc:1034] running on GCE node
I20260807 04:21:07.840564 28674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:07.841624 28674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:07.842869 28674 hybrid_clock.cc:648] HybridClock initialized: now 1786076467842786 us; error 78 us; skew 500 ppm
I20260807 04:21:07.843211 28674 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:21:07 dist-test-slave-qg60 krb5kdc[28418](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076467, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:21:07.846565 28674 init.cc:377] Logged in from keytab as kudu/127.7.200.194@KRBTEST.COM (short username kudu)
I20260807 04:21:07.848093 28674 webserver.cc:460] Webserver started at http://127.7.200.194:36439/ using document root <none> and password file <none>
I20260807 04:21:07.848922 28674 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:07.849076 28674 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:07.849422 28674 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:07.852499 28674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-1/data/instance:
uuid: "84bec40cf48d4056b0d3a340f4380564"
format_stamp: "Formatted at 2026-08-07 04:21:07 on dist-test-slave-qg60"
server_key: "7a1b2ae724bc79b855e980b76a4ab456"
server_key_iv: "ba7a6ac5c992dd266af5a147b8c9f18a"
server_key_version: "encryptionkey@0"
I20260807 04:21:07.853471 28674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance:
uuid: "84bec40cf48d4056b0d3a340f4380564"
format_stamp: "Formatted at 2026-08-07 04:21:07 on dist-test-slave-qg60"
server_key: "7a1b2ae724bc79b855e980b76a4ab456"
server_key_iv: "ba7a6ac5c992dd266af5a147b8c9f18a"
server_key_version: "encryptionkey@0"
I20260807 04:21:07.859014 28674 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 04:21:07.862839 28689 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:07.864343 28674 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 04:21:07.864543 28674 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "84bec40cf48d4056b0d3a340f4380564"
format_stamp: "Formatted at 2026-08-07 04:21:07 on dist-test-slave-qg60"
server_key: "7a1b2ae724bc79b855e980b76a4ab456"
server_key_iv: "ba7a6ac5c992dd266af5a147b8c9f18a"
server_key_version: "encryptionkey@0"
I20260807 04:21:07.864787 28674 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:07.889806 28674 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:07.894066 28674 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:07.894392 28674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:07.895448 28674 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:21:07.896914 28674 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:21:07.897019 28674 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:07.897176 28674 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:21:07.897250 28674 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:07.932441 28674 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:41731
I20260807 04:21:07.932504 28808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:41731 every 8 connection(s)
I20260807 04:21:07.933866 28674 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:21:07.940267 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 28674
I20260807 04:21:07.940466 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance
I20260807 04:21:07.941009 7971 external_mini_cluster.cc:1428] Setting key 503100cd0e9653927fc3aa9d40609e7c
Aug 07 04:21:07 dist-test-slave-qg60 krb5kdc[28418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076467, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.194@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:21:07.956331 28811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:07.936477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:57171 (local address 127.7.200.254:37243)
0807 04:21:07.936982 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:07.936987 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:07.937895 (+ 908us) server_negotiation.cc:407] Connection header received
0807 04:21:07.939805 (+ 1910us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:07.939811 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:07.939913 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:07.940038 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:07.941842 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:07.942898 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:07.944601 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:07.945092 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:07.945233 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:07.949067 (+ 3834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:07.949076 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:07.949084 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:07.949132 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:07.952745 (+ 3613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:07.953601 (+ 856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:07.953609 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:07.953614 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:07.953797 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:07.954244 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:07.954251 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:07.954257 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:07.954688 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:07.954845 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:07.955572 (+ 727us) server_negotiation.cc:299] Negotiation successful
0807 04:21:07.955848 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":284,"threads_started":1}
I20260807 04:21:07.957059 28813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:07.937026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:37243 (local address 127.7.200.194:57171)
0807 04:21:07.937733 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:07.937773 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:07.939506 (+ 1733us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:07.940291 (+ 785us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:07.940300 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:07.941016 (+ 716us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:21:07.941651 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:07.941670 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:07.943060 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:07.943064 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:07.944446 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:07.944459 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:07.945342 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:07.945349 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:07.945578 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:07.946311 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:21:07.946339 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:21:07.948816 (+ 2477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:21:07.952933 (+ 4117us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:07.952942 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:07.952962 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:07.953438 (+ 476us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:07.953917 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:07.953920 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:07.953923 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:07.954105 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:07.954817 (+ 712us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:21:07.954823 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:21:07.955166 (+ 343us) client_negotiation.cc:769] Sending connection context
0807 04:21:07.955405 (+ 239us) client_negotiation.cc:240] Negotiation successful
0807 04:21:07.955819 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":273,"threads_started":1}
I20260807 04:21:07.958570 28809 heartbeater.cc:347] Connected to a master server at 127.7.200.254:37243
I20260807 04:21:07.958942 28809 heartbeater.cc:464] Registering TS with master...
I20260807 04:21:07.959681 28809 heartbeater.cc:511] Master 127.7.200.254:37243 requested a full tablet report, sending...
I20260807 04:21:07.961521 28468 ts_manager.cc:194] Registered new tserver with Master: 84bec40cf48d4056b0d3a340f4380564 (127.7.200.194:41731)
I20260807 04:21:07.962816 28468 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.194@KRBTEST.COM'} at 127.7.200.194:57171
WARNING: no policy specified for kudu/127.7.200.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
Entry for principal kudu/127.7.200.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab.
I20260807 04:21:08.016938 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:0
--local_ip_for_outbound_sockets=127.7.200.195
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:37243
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:36711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:21:08.371665 28816 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:08.371977 28816 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:08.372162 28816 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:08.380187 28816 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:08.380298 28816 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:08.380487 28816 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:21:08.390688 28816 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:36711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.195.keytab
--principal=kudu/127.7.200.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:37243
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:08.392089 28816 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:08.393533 28816 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:08.407665 28821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:08.407815 28822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:08.407842 28824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:08.409003 28816 server_base.cc:1034] running on GCE node
I20260807 04:21:08.409714 28816 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:08.410775 28816 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:08.411840 28668 heartbeater.cc:503] Master 127.7.200.254:37243 was elected leader, sending a full tablet report...
I20260807 04:21:08.412055 28816 hybrid_clock.cc:648] HybridClock initialized: now 1786076468412002 us; error 38 us; skew 500 ppm
I20260807 04:21:08.412451 28816 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:21:08 dist-test-slave-qg60 krb5kdc[28418](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076468, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:21:08.416157 28816 init.cc:377] Logged in from keytab as kudu/127.7.200.195@KRBTEST.COM (short username kudu)
I20260807 04:21:08.417659 28816 webserver.cc:460] Webserver started at http://127.7.200.195:36765/ using document root <none> and password file <none>
I20260807 04:21:08.418301 28816 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:08.418402 28816 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:08.418679 28816 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:08.421739 28816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-2/data/instance:
uuid: "419a7068047a46b4aea049aaacf55dce"
format_stamp: "Formatted at 2026-08-07 04:21:08 on dist-test-slave-qg60"
server_key: "aeba149de8aa11ee795bd8ca72ffb360"
server_key_iv: "22ecdffc7d424946a30562b67ff94f9d"
server_key_version: "encryptionkey@0"
I20260807 04:21:08.422505 28816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance:
uuid: "419a7068047a46b4aea049aaacf55dce"
format_stamp: "Formatted at 2026-08-07 04:21:08 on dist-test-slave-qg60"
server_key: "aeba149de8aa11ee795bd8ca72ffb360"
server_key_iv: "22ecdffc7d424946a30562b67ff94f9d"
server_key_version: "encryptionkey@0"
I20260807 04:21:08.427780 28816 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 04:21:08.431324 28831 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:08.432698 28816 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 04:21:08.432890 28816 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "419a7068047a46b4aea049aaacf55dce"
format_stamp: "Formatted at 2026-08-07 04:21:08 on dist-test-slave-qg60"
server_key: "aeba149de8aa11ee795bd8ca72ffb360"
server_key_iv: "22ecdffc7d424946a30562b67ff94f9d"
server_key_version: "encryptionkey@0"
I20260807 04:21:08.433066 28816 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:08.451411 28816 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:08.455904 28816 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:08.456218 28816 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:08.457429 28816 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:21:08.458833 28816 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:21:08.458906 28816 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:08.459075 28816 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:21:08.459128 28816 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:08.493994 28816 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:42451
I20260807 04:21:08.494043 28947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:42451 every 8 connection(s)
I20260807 04:21:08.495334 28816 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:21:08.501046 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 28816
I20260807 04:21:08.501262 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance
I20260807 04:21:08.501715 7971 external_mini_cluster.cc:1428] Setting key 84903eb7c2803bc45371f2e058d5994a
Aug 07 04:21:08 dist-test-slave-qg60 krb5kdc[28418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076468, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.195@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:21:08.515882 28950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:08.497964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:57043 (local address 127.7.200.254:37243)
0807 04:21:08.498466 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:08.498470 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:08.499229 (+ 759us) server_negotiation.cc:407] Connection header received
0807 04:21:08.501161 (+ 1932us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:08.501166 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:08.501276 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:08.501396 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:08.503146 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:08.504189 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:08.505923 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:08.506326 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:08.506433 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:08.509884 (+ 3451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:08.509889 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:08.509892 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:08.509927 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:08.512767 (+ 2840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:08.513516 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:08.513520 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:08.513522 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:08.513669 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:08.514046 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:08.514049 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:08.514051 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:08.514395 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:08.514519 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:08.515241 (+ 722us) server_negotiation.cc:299] Negotiation successful
0807 04:21:08.515454 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":270,"threads_started":1}
I20260807 04:21:08.516928 28951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:08.498350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:37243 (local address 127.7.200.195:57043)
0807 04:21:08.499039 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:08.499087 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:08.500879 (+ 1792us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:08.501659 (+ 780us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:08.501667 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:08.502323 (+ 656us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:21:08.502901 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:08.502946 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:08.504367 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:08.504374 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:08.505790 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:08.505803 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:08.506523 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:08.506528 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:08.506740 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:08.507378 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:21:08.507405 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:21:08.509668 (+ 2263us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:21:08.512908 (+ 3240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:08.512914 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:08.512926 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:08.513403 (+ 477us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:08.513766 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:08.513769 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:08.513771 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:08.513945 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:08.514506 (+ 561us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:21:08.514512 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:21:08.514845 (+ 333us) client_negotiation.cc:769] Sending connection context
0807 04:21:08.515067 (+ 222us) client_negotiation.cc:240] Negotiation successful
0807 04:21:08.515562 (+ 495us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":277,"threads_started":1}
I20260807 04:21:08.518311 28948 heartbeater.cc:347] Connected to a master server at 127.7.200.254:37243
I20260807 04:21:08.518638 28948 heartbeater.cc:464] Registering TS with master...
I20260807 04:21:08.519374 28948 heartbeater.cc:511] Master 127.7.200.254:37243 requested a full tablet report, sending...
I20260807 04:21:08.520881 28468 ts_manager.cc:194] Registered new tserver with Master: 419a7068047a46b4aea049aaacf55dce (127.7.200.195:42451)
I20260807 04:21:08.521703 28468 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.7.200.195@KRBTEST.COM'} at 127.7.200.195:57043
I20260807 04:21:08.530037 7971 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 04:21:08.547989 28950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:08.534728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59580 (local address 127.7.200.254:37243)
0807 04:21:08.534927 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:08.534932 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:08.535345 (+ 413us) server_negotiation.cc:407] Connection header received
0807 04:21:08.535489 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:08.535493 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:08.535560 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:08.535656 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:08.537499 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:08.538289 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:08.539660 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:08.540071 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:08.540175 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:08.542751 (+ 2576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:08.542757 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:08.542760 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:08.542794 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:08.545593 (+ 2799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:08.546281 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:08.546284 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:08.546286 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:08.546416 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:08.546756 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:08.546759 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:08.546761 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:08.547075 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:08.547278 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:08.547581 (+ 303us) server_negotiation.cc:299] Negotiation successful
0807 04:21:08.547764 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 04:21:08.552419 28468 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59580:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:21:08.559854 28468 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:21:08.604282 28965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:08.573873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:42451 (local address 127.0.0.1:38824)
0807 04:21:08.594912 (+ 21039us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:08.594941 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:08.595109 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:08.596599 (+ 1490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:08.596604 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:08.596634 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:21:08.597128 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:08.597145 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:08.598842 (+ 1697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:08.598848 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:08.601144 (+ 2296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:08.601159 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:08.603133 (+ 1974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:08.603141 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:08.603336 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:08.603407 (+ 71us) client_negotiation.cc:769] Sending connection context
0807 04:21:08.603534 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 04:21:08.603772 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20871,"mutex_wait_us":35,"thread_start_us":20716,"threads_started":1}
I20260807 04:21:08.604388 28968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:08.574537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38824 (local address 127.7.200.195:42451)
0807 04:21:08.594348 (+ 19811us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:08.594362 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:08.595263 (+ 901us) server_negotiation.cc:407] Connection header received
0807 04:21:08.595407 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:08.595420 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:08.595732 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:08.595962 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:21:08.597513 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:08.598663 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:08.601421 (+ 2758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:08.602913 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:08.603063 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:08.603304 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:08.603850 (+ 546us) server_negotiation.cc:299] Negotiation successful
0807 04:21:08.604029 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19554,"thread_start_us":19351,"threads_started":1}
I20260807 04:21:08.604902 28966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:08.573988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48202 (local address 127.7.200.194:41731)
0807 04:21:08.595327 (+ 21339us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:08.595333 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:08.595358 (+ 25us) server_negotiation.cc:407] Connection header received
0807 04:21:08.595438 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:08.595444 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:08.595651 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:08.595884 (+ 233us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:21:08.596582 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:08.598342 (+ 1760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:08.601825 (+ 3483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:08.603257 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:08.603404 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:08.603639 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:08.604391 (+ 752us) server_negotiation.cc:299] Negotiation successful
0807 04:21:08.604555 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21171,"thread_start_us":21041,"threads_started":1}
I20260807 04:21:08.605141 28963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:08.573373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:43407 (local address 127.0.0.1:39252)
0807 04:21:08.584514 (+ 11141us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:08.584581 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:08.584855 (+ 274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:08.597314 (+ 12459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:08.597319 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:08.597345 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:21:08.597683 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:08.597695 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:08.599823 (+ 2128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:08.599828 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:08.602067 (+ 2239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:08.602078 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:08.603581 (+ 1503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:08.603587 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:08.603791 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:08.603823 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 04:21:08.603915 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 04:21:08.604053 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10749,"mutex_wait_us":54,"thread_start_us":15490,"threads_started":1}
I20260807 04:21:08.605461 28962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:08.573434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:41731 (local address 127.0.0.1:48202)
0807 04:21:08.588562 (+ 15128us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:08.588587 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:08.588747 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:08.595891 (+ 7144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:08.595898 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:08.595928 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:21:08.596342 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:08.596356 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:08.598513 (+ 2157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:08.598519 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:08.601648 (+ 3129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:08.601663 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:08.603783 (+ 2120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:08.603789 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:08.603958 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:08.603986 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 04:21:08.604056 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 04:21:08.604200 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14957,"thread_start_us":10491,"threads_started":1}
I20260807 04:21:08.605508 28964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:08.573578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39252 (local address 127.7.200.193:43407)
0807 04:21:08.596645 (+ 23067us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:08.596655 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:08.596682 (+ 27us) server_negotiation.cc:407] Connection header received
0807 04:21:08.596826 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:08.596834 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:08.597062 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:08.597888 (+ 826us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:21:08.598100 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:08.599666 (+ 1566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:08.602233 (+ 2567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:08.603331 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:08.603482 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:08.603712 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:08.604769 (+ 1057us) server_negotiation.cc:299] Negotiation successful
0807 04:21:08.604953 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22865,"thread_start_us":22685,"threads_started":1}
I20260807 04:21:08.608652 28742 tablet_service.cc:1467] Processing CreateTablet for tablet 42674818bab047e7844e4f8780e862d2 (DEFAULT_TABLE table=test-table [id=24f42c2d38e04600976b7b40f6f5417f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:21:08.608671 28881 tablet_service.cc:1467] Processing CreateTablet for tablet 42674818bab047e7844e4f8780e862d2 (DEFAULT_TABLE table=test-table [id=24f42c2d38e04600976b7b40f6f5417f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:21:08.609972 28742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42674818bab047e7844e4f8780e862d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:08.609591 28597 tablet_service.cc:1467] Processing CreateTablet for tablet 42674818bab047e7844e4f8780e862d2 (DEFAULT_TABLE table=test-table [id=24f42c2d38e04600976b7b40f6f5417f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:21:08.610152 28881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42674818bab047e7844e4f8780e862d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:08.610920 28597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42674818bab047e7844e4f8780e862d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:08.622051 28969 tablet_bootstrap.cc:492] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564: Bootstrap starting.
I20260807 04:21:08.624699 28970 tablet_bootstrap.cc:492] T 42674818bab047e7844e4f8780e862d2 P 419a7068047a46b4aea049aaacf55dce: Bootstrap starting.
I20260807 04:21:08.626190 28969 tablet_bootstrap.cc:654] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:08.626461 28971 tablet_bootstrap.cc:492] T 42674818bab047e7844e4f8780e862d2 P 8fd1e88ebc68479dade8947c432ee4b7: Bootstrap starting.
I20260807 04:21:08.627729 28969 log.cc:824] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:08.628389 28970 tablet_bootstrap.cc:654] T 42674818bab047e7844e4f8780e862d2 P 419a7068047a46b4aea049aaacf55dce: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:08.629763 28970 log.cc:824] T 42674818bab047e7844e4f8780e862d2 P 419a7068047a46b4aea049aaacf55dce: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:08.629796 28971 tablet_bootstrap.cc:654] T 42674818bab047e7844e4f8780e862d2 P 8fd1e88ebc68479dade8947c432ee4b7: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:08.631013 28971 log.cc:824] T 42674818bab047e7844e4f8780e862d2 P 8fd1e88ebc68479dade8947c432ee4b7: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:08.632058 28969 tablet_bootstrap.cc:492] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564: No bootstrap required, opened a new log
I20260807 04:21:08.632382 28969 ts_tablet_manager.cc:1397] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260807 04:21:08.633163 28970 tablet_bootstrap.cc:492] T 42674818bab047e7844e4f8780e862d2 P 419a7068047a46b4aea049aaacf55dce: No bootstrap required, opened a new log
I20260807 04:21:08.633424 28970 ts_tablet_manager.cc:1397] T 42674818bab047e7844e4f8780e862d2 P 419a7068047a46b4aea049aaacf55dce: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.006s
I20260807 04:21:08.633898 28971 tablet_bootstrap.cc:492] T 42674818bab047e7844e4f8780e862d2 P 8fd1e88ebc68479dade8947c432ee4b7: No bootstrap required, opened a new log
I20260807 04:21:08.634137 28971 ts_tablet_manager.cc:1397] T 42674818bab047e7844e4f8780e862d2 P 8fd1e88ebc68479dade8947c432ee4b7: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.005s
I20260807 04:21:08.642155 28971 raft_consensus.cc:348] T 42674818bab047e7844e4f8780e862d2 P 8fd1e88ebc68479dade8947c432ee4b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fd1e88ebc68479dade8947c432ee4b7" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43407 } } peers { permanent_uuid: "84bec40cf48d4056b0d3a340f4380564" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41731 } } peers { permanent_uuid: "419a7068047a46b4aea049aaacf55dce" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 42451 } }
I20260807 04:21:08.642544 28971 raft_consensus.cc:374] T 42674818bab047e7844e4f8780e862d2 P 8fd1e88ebc68479dade8947c432ee4b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:08.642652 28971 raft_consensus.cc:729] T 42674818bab047e7844e4f8780e862d2 P 8fd1e88ebc68479dade8947c432ee4b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fd1e88ebc68479dade8947c432ee4b7, State: Initialized, Role: FOLLOWER
I20260807 04:21:08.643277 28971 consensus_queue.cc:260] T 42674818bab047e7844e4f8780e862d2 P 8fd1e88ebc68479dade8947c432ee4b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fd1e88ebc68479dade8947c432ee4b7" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43407 } } peers { permanent_uuid: "84bec40cf48d4056b0d3a340f4380564" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41731 } } peers { permanent_uuid: "419a7068047a46b4aea049aaacf55dce" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 42451 } }
I20260807 04:21:08.643424 28969 raft_consensus.cc:348] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fd1e88ebc68479dade8947c432ee4b7" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43407 } } peers { permanent_uuid: "84bec40cf48d4056b0d3a340f4380564" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41731 } } peers { permanent_uuid: "419a7068047a46b4aea049aaacf55dce" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 42451 } }
I20260807 04:21:08.643882 28969 raft_consensus.cc:374] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:08.643985 28969 raft_consensus.cc:729] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84bec40cf48d4056b0d3a340f4380564, State: Initialized, Role: FOLLOWER
I20260807 04:21:08.644701 28969 consensus_queue.cc:260] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fd1e88ebc68479dade8947c432ee4b7" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43407 } } peers { permanent_uuid: "84bec40cf48d4056b0d3a340f4380564" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41731 } } peers { permanent_uuid: "419a7068047a46b4aea049aaacf55dce" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 42451 } }
I20260807 04:21:08.645242 28971 ts_tablet_manager.cc:1428] T 42674818bab047e7844e4f8780e862d2 P 8fd1e88ebc68479dade8947c432ee4b7: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260807 04:21:08.645937 28809 heartbeater.cc:503] Master 127.7.200.254:37243 was elected leader, sending a full tablet report...
I20260807 04:21:08.645807 28970 raft_consensus.cc:348] T 42674818bab047e7844e4f8780e862d2 P 419a7068047a46b4aea049aaacf55dce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fd1e88ebc68479dade8947c432ee4b7" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43407 } } peers { permanent_uuid: "84bec40cf48d4056b0d3a340f4380564" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41731 } } peers { permanent_uuid: "419a7068047a46b4aea049aaacf55dce" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 42451 } }
I20260807 04:21:08.646253 28970 raft_consensus.cc:374] T 42674818bab047e7844e4f8780e862d2 P 419a7068047a46b4aea049aaacf55dce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:08.646353 28970 raft_consensus.cc:729] T 42674818bab047e7844e4f8780e862d2 P 419a7068047a46b4aea049aaacf55dce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 419a7068047a46b4aea049aaacf55dce, State: Initialized, Role: FOLLOWER
I20260807 04:21:08.646620 28969 ts_tablet_manager.cc:1428] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564: Time spent starting tablet: real 0.014s user 0.007s sys 0.008s
I20260807 04:21:08.646910 28970 consensus_queue.cc:260] T 42674818bab047e7844e4f8780e862d2 P 419a7068047a46b4aea049aaacf55dce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fd1e88ebc68479dade8947c432ee4b7" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43407 } } peers { permanent_uuid: "84bec40cf48d4056b0d3a340f4380564" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41731 } } peers { permanent_uuid: "419a7068047a46b4aea049aaacf55dce" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 42451 } }
I20260807 04:21:08.648056 28948 heartbeater.cc:503] Master 127.7.200.254:37243 was elected leader, sending a full tablet report...
I20260807 04:21:08.648581 28970 ts_tablet_manager.cc:1428] T 42674818bab047e7844e4f8780e862d2 P 419a7068047a46b4aea049aaacf55dce: Time spent starting tablet: real 0.015s user 0.011s sys 0.002s
W20260807 04:21:08.685931 28810 tablet.cc:2369] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 04:21:08.747046 28949 tablet.cc:2369] T 42674818bab047e7844e4f8780e862d2 P 419a7068047a46b4aea049aaacf55dce: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 04:21:08.878486 28669 tablet.cc:2369] T 42674818bab047e7844e4f8780e862d2 P 8fd1e88ebc68479dade8947c432ee4b7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:21:08.994757 28976 raft_consensus.cc:482] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:21:08.995129 28976 raft_consensus.cc:504] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fd1e88ebc68479dade8947c432ee4b7" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43407 } } peers { permanent_uuid: "84bec40cf48d4056b0d3a340f4380564" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41731 } } peers { permanent_uuid: "419a7068047a46b4aea049aaacf55dce" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 42451 } }
I20260807 04:21:08.997006 28976 leader_election.cc:288] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fd1e88ebc68479dade8947c432ee4b7 (127.7.200.193:43407), 419a7068047a46b4aea049aaacf55dce (127.7.200.195:42451)
I20260807 04:21:09.005208 28968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:08.997658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:51243 (local address 127.7.200.195:42451)
0807 04:21:08.997894 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:08.997903 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:08.999357 (+ 1454us) server_negotiation.cc:407] Connection header received
0807 04:21:08.999571 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:08.999575 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:08.999637 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:08.999736 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:21:09.000450 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:09.001248 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:09.003344 (+ 2096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:09.004181 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:09.004385 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:09.004465 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:09.004801 (+ 336us) server_negotiation.cc:299] Negotiation successful
0807 04:21:09.004933 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 04:21:09.005331 28979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:08.998108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:42451 (local address 127.7.200.194:51243)
0807 04:21:08.999242 (+ 1134us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:08.999257 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:08.999410 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:08.999749 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:08.999754 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:08.999776 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:21:09.000255 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:09.000265 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:09.001380 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:09.001388 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:09.003150 (+ 1762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:09.003166 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:09.004404 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:09.004410 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:09.004585 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:09.004610 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 04:21:09.004729 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 04:21:09.004898 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1025,"mutex_wait_us":24,"thread_start_us":768,"threads_started":1}
I20260807 04:21:09.005563 28964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:08.997426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:57867 (local address 127.7.200.193:43407)
0807 04:21:08.997685 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:08.997693 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:08.999264 (+ 1571us) server_negotiation.cc:407] Connection header received
0807 04:21:08.999513 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:08.999517 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:08.999591 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:08.999699 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:21:09.000385 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:09.001221 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:09.003618 (+ 2397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:09.004529 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:09.004729 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:09.004843 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:09.005163 (+ 320us) server_negotiation.cc:299] Negotiation successful
0807 04:21:09.005313 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 04:21:09.005874 28978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:08.998096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:43407 (local address 127.7.200.194:57867)
0807 04:21:08.999137 (+ 1041us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:08.999155 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:08.999348 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:08.999717 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:08.999721 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:08.999748 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:21:09.000221 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:09.000233 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:09.001371 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:09.001378 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:09.003420 (+ 2042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:09.003434 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:09.004817 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:09.004825 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:09.004982 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:09.005009 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 04:21:09.005132 (+ 123us) client_negotiation.cc:240] Negotiation successful
0807 04:21:09.005285 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":914,"mutex_wait_us":32,"thread_start_us":526,"threads_started":1}
I20260807 04:21:09.006880 28903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42674818bab047e7844e4f8780e862d2" candidate_uuid: "84bec40cf48d4056b0d3a340f4380564" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "419a7068047a46b4aea049aaacf55dce" is_pre_election: true
I20260807 04:21:09.006887 28620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42674818bab047e7844e4f8780e862d2" candidate_uuid: "84bec40cf48d4056b0d3a340f4380564" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fd1e88ebc68479dade8947c432ee4b7" is_pre_election: true
I20260807 04:21:09.007548 28903 raft_consensus.cc:2454] T 42674818bab047e7844e4f8780e862d2 P 419a7068047a46b4aea049aaacf55dce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84bec40cf48d4056b0d3a340f4380564 in term 0.
I20260807 04:21:09.007547 28620 raft_consensus.cc:2454] T 42674818bab047e7844e4f8780e862d2 P 8fd1e88ebc68479dade8947c432ee4b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84bec40cf48d4056b0d3a340f4380564 in term 0.
I20260807 04:21:09.008375 28691 leader_election.cc:302] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 419a7068047a46b4aea049aaacf55dce, 84bec40cf48d4056b0d3a340f4380564; no voters:
I20260807 04:21:09.009003 28976 raft_consensus.cc:2781] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:21:09.009212 28976 raft_consensus.cc:482] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:21:09.009341 28976 raft_consensus.cc:3037] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:09.011688 28976 raft_consensus.cc:504] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fd1e88ebc68479dade8947c432ee4b7" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43407 } } peers { permanent_uuid: "84bec40cf48d4056b0d3a340f4380564" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41731 } } peers { permanent_uuid: "419a7068047a46b4aea049aaacf55dce" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 42451 } }
I20260807 04:21:09.012344 28976 leader_election.cc:288] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564 [CANDIDATE]: Term 1 election: Requested vote from peers 8fd1e88ebc68479dade8947c432ee4b7 (127.7.200.193:43407), 419a7068047a46b4aea049aaacf55dce (127.7.200.195:42451)
I20260807 04:21:09.013039 28620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42674818bab047e7844e4f8780e862d2" candidate_uuid: "84bec40cf48d4056b0d3a340f4380564" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fd1e88ebc68479dade8947c432ee4b7"
I20260807 04:21:09.013067 28903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42674818bab047e7844e4f8780e862d2" candidate_uuid: "84bec40cf48d4056b0d3a340f4380564" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "419a7068047a46b4aea049aaacf55dce"
I20260807 04:21:09.013286 28903 raft_consensus.cc:3037] T 42674818bab047e7844e4f8780e862d2 P 419a7068047a46b4aea049aaacf55dce [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:09.013286 28620 raft_consensus.cc:3037] T 42674818bab047e7844e4f8780e862d2 P 8fd1e88ebc68479dade8947c432ee4b7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:09.016798 28620 raft_consensus.cc:2454] T 42674818bab047e7844e4f8780e862d2 P 8fd1e88ebc68479dade8947c432ee4b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84bec40cf48d4056b0d3a340f4380564 in term 1.
I20260807 04:21:09.016798 28903 raft_consensus.cc:2454] T 42674818bab047e7844e4f8780e862d2 P 419a7068047a46b4aea049aaacf55dce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84bec40cf48d4056b0d3a340f4380564 in term 1.
I20260807 04:21:09.017334 28693 leader_election.cc:302] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 419a7068047a46b4aea049aaacf55dce, 84bec40cf48d4056b0d3a340f4380564, 8fd1e88ebc68479dade8947c432ee4b7; no voters:
I20260807 04:21:09.017742 28976 raft_consensus.cc:2781] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:21:09.018424 28976 raft_consensus.cc:686] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564 [term 1 LEADER]: Becoming Leader. State: Replica: 84bec40cf48d4056b0d3a340f4380564, State: Running, Role: LEADER
I20260807 04:21:09.019032 28976 consensus_queue.cc:237] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fd1e88ebc68479dade8947c432ee4b7" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43407 } } peers { permanent_uuid: "84bec40cf48d4056b0d3a340f4380564" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41731 } } peers { permanent_uuid: "419a7068047a46b4aea049aaacf55dce" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 42451 } }
I20260807 04:21:09.024092 28468 catalog_manager.cc:5495] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84bec40cf48d4056b0d3a340f4380564 (127.7.200.194). New cstate: current_term: 1 leader_uuid: "84bec40cf48d4056b0d3a340f4380564" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fd1e88ebc68479dade8947c432ee4b7" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84bec40cf48d4056b0d3a340f4380564" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "419a7068047a46b4aea049aaacf55dce" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 42451 } health_report { overall_health: UNKNOWN } } }
I20260807 04:21:09.058801 28966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:09.052111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48204 (local address 127.7.200.194:41731)
0807 04:21:09.052320 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:09.052325 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:09.052977 (+ 652us) server_negotiation.cc:407] Connection header received
0807 04:21:09.053160 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:09.053163 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:09.053245 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:09.053382 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:21:09.053893 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:09.054783 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:09.056519 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:09.057054 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:09.057153 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:09.057704 (+ 551us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:21:09.058265 (+ 561us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:21:09.058374 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:09.058510 (+ 136us) server_negotiation.cc:299] Negotiation successful
0807 04:21:09.058580 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 04:21:09.067893 28620 raft_consensus.cc:1261] T 42674818bab047e7844e4f8780e862d2 P 8fd1e88ebc68479dade8947c432ee4b7 [term 1 FOLLOWER]: Refusing update from remote peer 84bec40cf48d4056b0d3a340f4380564: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:21:09.067893 28903 raft_consensus.cc:1261] T 42674818bab047e7844e4f8780e862d2 P 419a7068047a46b4aea049aaacf55dce [term 1 FOLLOWER]: Refusing update from remote peer 84bec40cf48d4056b0d3a340f4380564: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:21:09.069068 28982 consensus_queue.cc:1035] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564 [LEADER]: Connected to new peer: Peer: permanent_uuid: "419a7068047a46b4aea049aaacf55dce" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 42451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:21:09.069442 28976 consensus_queue.cc:1035] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fd1e88ebc68479dade8947c432ee4b7" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 43407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:21:09.081631 28986 mvcc.cc:205] Tried to move back new op lower bound from 7315769217290825728 to 7315769217105907712. Current Snapshot: MvccSnapshot[applied={T|T < 7315769217290825728}]
I20260807 04:21:09.082011 28988 mvcc.cc:205] Tried to move back new op lower bound from 7315769217290825728 to 7315769217105907712. Current Snapshot: MvccSnapshot[applied={T|T < 7315769217290825728}]
I20260807 04:21:09.100391 28468 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59580:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:21:09.100639 28468 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59580:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:21:09.104040 28468 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e3e7d59dd09a4d91b7fb4cd9c278ab24: Sending DeleteTablet for 3 replicas of tablet 42674818bab047e7844e4f8780e862d2
I20260807 04:21:09.105300 28597 tablet_service.cc:1514] Processing DeleteTablet for tablet 42674818bab047e7844e4f8780e862d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:21:09 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:39252
I20260807 04:21:09.105492 28742 tablet_service.cc:1514] Processing DeleteTablet for tablet 42674818bab047e7844e4f8780e862d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:21:09 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:48202
I20260807 04:21:09.105499 28881 tablet_service.cc:1514] Processing DeleteTablet for tablet 42674818bab047e7844e4f8780e862d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:21:09 UTC) from {username='kudu', principal='kudu/127.7.200.254@KRBTEST.COM'} at 127.0.0.1:38824
I20260807 04:21:09.107543 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 28532
I20260807 04:21:09.122117 28998 tablet_replica.cc:330] T 42674818bab047e7844e4f8780e862d2 P 419a7068047a46b4aea049aaacf55dce: stopping tablet replica
I20260807 04:21:09.122809 28998 raft_consensus.cc:2229] T 42674818bab047e7844e4f8780e862d2 P 419a7068047a46b4aea049aaacf55dce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:21:09.123448 28998 raft_consensus.cc:2258] T 42674818bab047e7844e4f8780e862d2 P 419a7068047a46b4aea049aaacf55dce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:21:09.124370 28997 tablet_replica.cc:330] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564: stopping tablet replica
I20260807 04:21:09.124478 28996 tablet_replica.cc:330] T 42674818bab047e7844e4f8780e862d2 P 8fd1e88ebc68479dade8947c432ee4b7: stopping tablet replica
I20260807 04:21:09.124914 28996 raft_consensus.cc:2229] T 42674818bab047e7844e4f8780e862d2 P 8fd1e88ebc68479dade8947c432ee4b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:21:09.124842 28997 raft_consensus.cc:2229] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564 [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:21:09.125424 28996 raft_consensus.cc:2258] T 42674818bab047e7844e4f8780e862d2 P 8fd1e88ebc68479dade8947c432ee4b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:21:09.125861 28997 raft_consensus.cc:2258] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:21:09.127655 28998 ts_tablet_manager.cc:1905] T 42674818bab047e7844e4f8780e862d2 P 419a7068047a46b4aea049aaacf55dce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:21:09.130223 28997 ts_tablet_manager.cc:1905] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:21:09.134954 28998 ts_tablet_manager.cc:1918] T 42674818bab047e7844e4f8780e862d2 P 419a7068047a46b4aea049aaacf55dce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:21:09.135175 28998 log.cc:1196] T 42674818bab047e7844e4f8780e862d2 P 419a7068047a46b4aea049aaacf55dce: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-2/wal/wals/42674818bab047e7844e4f8780e862d2
I20260807 04:21:09.135799 28998 ts_tablet_manager.cc:1939] T 42674818bab047e7844e4f8780e862d2 P 419a7068047a46b4aea049aaacf55dce: Deleting consensus metadata
I20260807 04:21:09.136999 28997 ts_tablet_manager.cc:1918] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:21:09.137168 28997 log.cc:1196] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-1/wal/wals/42674818bab047e7844e4f8780e862d2
Aug 07 04:21:09 dist-test-slave-qg60 krb5kdc[28418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.193@KRBTEST.COM
I20260807 04:21:09.137861 28997 ts_tablet_manager.cc:1939] T 42674818bab047e7844e4f8780e862d2 P 84bec40cf48d4056b0d3a340f4380564: Deleting consensus metadata
I20260807 04:21:09.138075 28451 catalog_manager.cc:4841] TS 419a7068047a46b4aea049aaacf55dce (127.7.200.195:42451): tablet 42674818bab047e7844e4f8780e862d2 (table test-table [id=24f42c2d38e04600976b7b40f6f5417f]) successfully deleted
I20260807 04:21:09.138913 28996 ts_tablet_manager.cc:1905] T 42674818bab047e7844e4f8780e862d2 P 8fd1e88ebc68479dade8947c432ee4b7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:21:09.139698 28453 catalog_manager.cc:4841] TS 84bec40cf48d4056b0d3a340f4380564 (127.7.200.194:41731): tablet 42674818bab047e7844e4f8780e862d2 (table test-table [id=24f42c2d38e04600976b7b40f6f5417f]) successfully deleted
I20260807 04:21:09.146198 28964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:09.109283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39258 (local address 127.7.200.193:43407)
0807 04:21:09.109524 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:09.109533 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:09.123579 (+ 14046us) server_negotiation.cc:407] Connection header received
0807 04:21:09.123815 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:09.123824 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:09.123948 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:09.124101 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:09.126514 (+ 2413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:09.127253 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:09.128597 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:09.129302 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:09.129426 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:09.139465 (+ 10039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:09.139484 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:09.139505 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:09.139560 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:09.142937 (+ 3377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:09.143745 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:09.143756 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:09.143758 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:09.143925 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:09.144355 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:09.144358 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:09.144360 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:09.144815 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:09.145182 (+ 367us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:09.145497 (+ 315us) server_negotiation.cc:299] Negotiation successful
0807 04:21:09.145744 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260807 04:21:09.146862 28663 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:21:09.150601 28996 ts_tablet_manager.cc:1918] T 42674818bab047e7844e4f8780e862d2 P 8fd1e88ebc68479dade8947c432ee4b7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:21:09.150817 28996 log.cc:1196] T 42674818bab047e7844e4f8780e862d2 P 8fd1e88ebc68479dade8947c432ee4b7: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786076137270840-7971-0/minicluster-data/ts-0/wal/wals/42674818bab047e7844e4f8780e862d2
I20260807 04:21:09.238831 28996 ts_tablet_manager.cc:1939] T 42674818bab047e7844e4f8780e862d2 P 8fd1e88ebc68479dade8947c432ee4b7: Deleting consensus metadata
I20260807 04:21:09.238930 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 28532
W20260807 04:21:09.267081 28454 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.200.193:43407 (error 108)
I20260807 04:21:09.267974 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 28674
I20260807 04:21:09.269834 29002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:09.268561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:43407 (local address 127.0.0.1:39274)
0807 04:21:09.269445 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:09.269583 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:43407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":735,"thread_start_us":617,"threads_started":1}
W20260807 04:21:09.270167 28454 catalog_manager.cc:4584] TS 8fd1e88ebc68479dade8947c432ee4b7 (127.7.200.193:43407): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 42674818bab047e7844e4f8780e862d2: Network error: Client connection negotiation failed: client connection to 127.7.200.193:43407: connect: Connection refused (error 111)
Aug 07 04:21:09 dist-test-slave-qg60 krb5kdc[28418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.194@KRBTEST.COM
I20260807 04:21:09.287788 28966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:09.268789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48212 (local address 127.7.200.194:41731)
0807 04:21:09.269004 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:09.269011 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:09.269440 (+ 429us) server_negotiation.cc:407] Connection header received
0807 04:21:09.269521 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:09.269525 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:09.269640 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:09.269754 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:09.271502 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:09.272333 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:09.274418 (+ 2085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:09.274855 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:09.274958 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:09.280350 (+ 5392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:09.280370 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:09.280391 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:09.280448 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:09.284576 (+ 4128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:09.285356 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:09.285371 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:09.285377 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:09.285560 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:09.285951 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:09.285957 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:09.285960 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:09.286509 (+ 549us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:09.286846 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:09.287122 (+ 276us) server_negotiation.cc:299] Negotiation successful
0807 04:21:09.287372 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 04:21:09.288635 28804 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:21:09.323839 29002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:09.323324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:43407 (local address 127.0.0.1:39290)
0807 04:21:09.323597 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:09.323690 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:43407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260807 04:21:09.324997 29002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:09.324557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:43407 (local address 127.0.0.1:39298)
0807 04:21:09.324782 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:09.324859 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:43407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260807 04:21:09.385754 29002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:09.385274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:43407 (local address 127.0.0.1:39312)
0807 04:21:09.385512 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:09.385608 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:43407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260807 04:21:09.387049 29002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:09.386657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:43407 (local address 127.0.0.1:39326)
0807 04:21:09.386812 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:09.386890 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:43407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260807 04:21:09.407351 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 28674
I20260807 04:21:09.426395 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 28816
Aug 07 04:21:09 dist-test-slave-qg60 krb5kdc[28418](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.195@KRBTEST.COM
I20260807 04:21:09.443038 28968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:09.427236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38838 (local address 127.7.200.195:42451)
0807 04:21:09.427455 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:09.427459 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:09.427479 (+ 20us) server_negotiation.cc:407] Connection header received
0807 04:21:09.427586 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:09.427590 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:09.427658 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:09.427753 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:09.429196 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:09.429964 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:09.431301 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:09.431723 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:09.431829 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:09.437000 (+ 5171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:09.437019 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:09.437036 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:09.437082 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:09.439949 (+ 2867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:09.440654 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:09.440661 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:09.440663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:09.441141 (+ 478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:09.441529 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:09.441532 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:09.441535 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:09.441919 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:09.442146 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:09.442439 (+ 293us) server_negotiation.cc:299] Negotiation successful
0807 04:21:09.442641 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260807 04:21:09.443702 28943 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:21:09.467599 29002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:09.466990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:43407 (local address 127.0.0.1:39336)
0807 04:21:09.467269 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:09.467395 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:43407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260807 04:21:09.468849 29002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:09.468340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:43407 (local address 127.0.0.1:39344)
0807 04:21:09.468561 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:09.468648 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:43407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260807 04:21:09.535008 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 28816
I20260807 04:21:09.554498 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 28432
I20260807 04:21:09.555749 28498 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:21:09.669550 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 28432
2026-08-07T04:21:09Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4942 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-07T04:21:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:21:09Z Disabled control of system clock
I20260807 04:21:09.770982 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:34819
--webserver_interface=127.7.200.254
--webserver_port=0
--builtin_ntp_servers=127.7.200.212:40907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:34819
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 04:21:10.119237 29010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:10.119673 29010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:10.119823 29010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:10.127226 29010 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:21:10.127345 29010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:10.127424 29010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:10.127544 29010 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:21:10.127620 29010 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:21:10.137571 29010 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:40907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:34819
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:34819
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:10.138981 29010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:10.140942 29010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:10.153399 29018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:10.153491 29016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:10.153510 29015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:10.154433 29010 server_base.cc:1034] running on GCE node
I20260807 04:21:10.155355 29010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:10.157016 29010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:10.158233 29010 hybrid_clock.cc:648] HybridClock initialized: now 1786076470158191 us; error 32 us; skew 500 ppm
I20260807 04:21:10.158632 29010 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 04:21:10.161091 29010 webserver.cc:460] Webserver started at http://127.7.200.254:44223/ using document root <none> and password file <none>
I20260807 04:21:10.161844 29010 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:10.161963 29010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:10.162329 29010 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:10.165488 29010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "41ed0c6ef3a8401e8b9e8bc48e713c1d"
format_stamp: "Formatted at 2026-08-07 04:21:10 on dist-test-slave-qg60"
server_key: "86d51a898b653d2e2c2f380d4cfcddbe"
server_key_iv: "2b93ced6611be2fecfa79be95998f2f3"
server_key_version: "encryptionkey@0"
I20260807 04:21:10.166369 29010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "41ed0c6ef3a8401e8b9e8bc48e713c1d"
format_stamp: "Formatted at 2026-08-07 04:21:10 on dist-test-slave-qg60"
server_key: "86d51a898b653d2e2c2f380d4cfcddbe"
server_key_iv: "2b93ced6611be2fecfa79be95998f2f3"
server_key_version: "encryptionkey@0"
I20260807 04:21:10.172016 29010 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 04:21:10.175967 29024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:10.177539 29010 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260807 04:21:10.177747 29010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "41ed0c6ef3a8401e8b9e8bc48e713c1d"
format_stamp: "Formatted at 2026-08-07 04:21:10 on dist-test-slave-qg60"
server_key: "86d51a898b653d2e2c2f380d4cfcddbe"
server_key_iv: "2b93ced6611be2fecfa79be95998f2f3"
server_key_version: "encryptionkey@0"
I20260807 04:21:10.177986 29010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:10.194335 29010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:10.195250 29010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:10.195572 29010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:10.215173 29010 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:34819
I20260807 04:21:10.215209 29077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:34819 every 8 connection(s)
I20260807 04:21:10.216619 29010 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:21:10.220525 29078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:10.221786 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 29010
I20260807 04:21:10.221994 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:21:10.222659 7971 external_mini_cluster.cc:1428] Setting key acff30a3a14f17040605122766d6f794
I20260807 04:21:10.233951 29078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41ed0c6ef3a8401e8b9e8bc48e713c1d: Bootstrap starting.
I20260807 04:21:10.236258 29082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:10.224715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41108 (local address 127.7.200.254:34819)
0807 04:21:10.225791 (+ 1076us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:10.225802 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:10.225848 (+ 46us) server_negotiation.cc:407] Connection header received
0807 04:21:10.227541 (+ 1693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:10.227562 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:10.228043 (+ 481us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:10.228429 (+ 386us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:10.229055 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:10.230298 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:10.231652 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:10.232350 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:10.232549 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:10.233816 (+ 1267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:10.233823 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:10.233837 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:10.234463 (+ 626us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:10.234563 (+ 100us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:10.234591 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:10.234721 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:10.234943 (+ 222us) server_negotiation.cc:299] Negotiation successful
0807 04:21:10.235301 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":614,"thread_start_us":374,"threads_started":1}
I20260807 04:21:10.237592 29078 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 41ed0c6ef3a8401e8b9e8bc48e713c1d: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:10.238927 29078 log.cc:824] T 00000000000000000000000000000000 P 41ed0c6ef3a8401e8b9e8bc48e713c1d: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:10.241786 29078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41ed0c6ef3a8401e8b9e8bc48e713c1d: No bootstrap required, opened a new log
I20260807 04:21:10.249338 29078 raft_consensus.cc:348] T 00000000000000000000000000000000 P 41ed0c6ef3a8401e8b9e8bc48e713c1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41ed0c6ef3a8401e8b9e8bc48e713c1d" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 34819 } }
I20260807 04:21:10.249744 29078 raft_consensus.cc:374] T 00000000000000000000000000000000 P 41ed0c6ef3a8401e8b9e8bc48e713c1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:10.249823 29078 raft_consensus.cc:729] T 00000000000000000000000000000000 P 41ed0c6ef3a8401e8b9e8bc48e713c1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41ed0c6ef3a8401e8b9e8bc48e713c1d, State: Initialized, Role: FOLLOWER
I20260807 04:21:10.250348 29078 consensus_queue.cc:260] T 00000000000000000000000000000000 P 41ed0c6ef3a8401e8b9e8bc48e713c1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41ed0c6ef3a8401e8b9e8bc48e713c1d" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 34819 } }
I20260807 04:21:10.250566 29078 raft_consensus.cc:388] T 00000000000000000000000000000000 P 41ed0c6ef3a8401e8b9e8bc48e713c1d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:21:10.250660 29078 raft_consensus.cc:482] T 00000000000000000000000000000000 P 41ed0c6ef3a8401e8b9e8bc48e713c1d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:21:10.250792 29078 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 41ed0c6ef3a8401e8b9e8bc48e713c1d [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:10.253126 29078 raft_consensus.cc:504] T 00000000000000000000000000000000 P 41ed0c6ef3a8401e8b9e8bc48e713c1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41ed0c6ef3a8401e8b9e8bc48e713c1d" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 34819 } }
I20260807 04:21:10.253638 29078 leader_election.cc:302] T 00000000000000000000000000000000 P 41ed0c6ef3a8401e8b9e8bc48e713c1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 41ed0c6ef3a8401e8b9e8bc48e713c1d; no voters:
I20260807 04:21:10.254256 29078 leader_election.cc:288] T 00000000000000000000000000000000 P 41ed0c6ef3a8401e8b9e8bc48e713c1d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:21:10.254464 29085 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 41ed0c6ef3a8401e8b9e8bc48e713c1d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:21:10.255549 29085 raft_consensus.cc:686] T 00000000000000000000000000000000 P 41ed0c6ef3a8401e8b9e8bc48e713c1d [term 1 LEADER]: Becoming Leader. State: Replica: 41ed0c6ef3a8401e8b9e8bc48e713c1d, State: Running, Role: LEADER
I20260807 04:21:10.256194 29085 consensus_queue.cc:237] T 00000000000000000000000000000000 P 41ed0c6ef3a8401e8b9e8bc48e713c1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41ed0c6ef3a8401e8b9e8bc48e713c1d" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 34819 } }
I20260807 04:21:10.256844 29078 sys_catalog.cc:564] T 00000000000000000000000000000000 P 41ed0c6ef3a8401e8b9e8bc48e713c1d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:21:10.259862 29087 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41ed0c6ef3a8401e8b9e8bc48e713c1d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 41ed0c6ef3a8401e8b9e8bc48e713c1d. Latest consensus state: current_term: 1 leader_uuid: "41ed0c6ef3a8401e8b9e8bc48e713c1d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41ed0c6ef3a8401e8b9e8bc48e713c1d" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 34819 } } }
I20260807 04:21:10.259941 29086 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41ed0c6ef3a8401e8b9e8bc48e713c1d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "41ed0c6ef3a8401e8b9e8bc48e713c1d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41ed0c6ef3a8401e8b9e8bc48e713c1d" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 34819 } } }
I20260807 04:21:10.260492 29087 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41ed0c6ef3a8401e8b9e8bc48e713c1d [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:10.260528 29086 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41ed0c6ef3a8401e8b9e8bc48e713c1d [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:10.267387 29091 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:21:10.273310 29091 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:21:10.283289 29091 catalog_manager.cc:1347] Generated new cluster ID: e64f92e0807b4dbc9a256027c75bf76f
I20260807 04:21:10.283450 29091 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:21:10.309096 29091 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:21:10.311151 29091 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:21:10.332832 29091 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 41ed0c6ef3a8401e8b9e8bc48e713c1d: Generated new TSK 0
I20260807 04:21:10.333797 29091 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:21:10.339093 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.193:0
--local_ip_for_outbound_sockets=127.7.200.193
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:34819
--builtin_ntp_servers=127.7.200.212:40907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 04:21:10.730213 29104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:10.730571 29104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:10.730731 29104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:10.738379 29104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:10.738528 29104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:10.738703 29104 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.193
I20260807 04:21:10.751196 29104 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:40907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.200.193
--webserver_port=0
--tserver_master_addrs=127.7.200.254:34819
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.193
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:10.752624 29104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:10.754529 29104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:10.768375 29111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:10.768326 29113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:10.769018 29104 server_base.cc:1034] running on GCE node
W20260807 04:21:10.769225 29110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:10.769919 29104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:10.770898 29104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:10.772195 29104 hybrid_clock.cc:648] HybridClock initialized: now 1786076470772132 us; error 36 us; skew 500 ppm
I20260807 04:21:10.772563 29104 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 04:21:10.775051 29104 webserver.cc:460] Webserver started at http://127.7.200.193:38065/ using document root <none> and password file <none>
I20260807 04:21:10.775777 29104 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:10.775902 29104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:10.776288 29104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:10.779273 29104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-0/data/instance:
uuid: "50b9a0fee83f4ff3b10958a4a0b71fb9"
format_stamp: "Formatted at 2026-08-07 04:21:10 on dist-test-slave-qg60"
server_key: "bc6dc1a25027542a38b967e91646673a"
server_key_iv: "da1a64afca23f1e493ebc3abfbd05a24"
server_key_version: "encryptionkey@0"
I20260807 04:21:10.780093 29104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance:
uuid: "50b9a0fee83f4ff3b10958a4a0b71fb9"
format_stamp: "Formatted at 2026-08-07 04:21:10 on dist-test-slave-qg60"
server_key: "bc6dc1a25027542a38b967e91646673a"
server_key_iv: "da1a64afca23f1e493ebc3abfbd05a24"
server_key_version: "encryptionkey@0"
I20260807 04:21:10.785455 29104 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260807 04:21:10.789201 29119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:10.790575 29104 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260807 04:21:10.790776 29104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-0/wal
uuid: "50b9a0fee83f4ff3b10958a4a0b71fb9"
format_stamp: "Formatted at 2026-08-07 04:21:10 on dist-test-slave-qg60"
server_key: "bc6dc1a25027542a38b967e91646673a"
server_key_iv: "da1a64afca23f1e493ebc3abfbd05a24"
server_key_version: "encryptionkey@0"
I20260807 04:21:10.791007 29104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:10.815927 29104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:10.816843 29104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:10.817173 29104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:10.818269 29104 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:21:10.819871 29104 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:21:10.819963 29104 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:10.820102 29104 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:21:10.820240 29104 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:10.856608 29104 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.193:39633
I20260807 04:21:10.856791 29238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.193:39633 every 8 connection(s)
I20260807 04:21:10.858144 29104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-0/data/info.pb
I20260807 04:21:10.860492 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 29104
I20260807 04:21:10.860690 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-0/wal/instance
I20260807 04:21:10.861277 7971 external_mini_cluster.cc:1428] Setting key 9647eb887a0d7e0012934dc33c6c4d10
I20260807 04:21:10.863996 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.194:0
--local_ip_for_outbound_sockets=127.7.200.194
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:34819
--builtin_ntp_servers=127.7.200.212:40907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 04:21:10.872575 29241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:10.861141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.193:49839 (local address 127.7.200.254:34819)
0807 04:21:10.861645 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:10.861651 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:10.863026 (+ 1375us) server_negotiation.cc:407] Connection header received
0807 04:21:10.865073 (+ 2047us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:10.865081 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:10.865180 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:10.865304 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:10.866364 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:10.867546 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:10.869332 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:10.870044 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:10.870181 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:10.871545 (+ 1364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:10.871553 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:10.871561 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:10.871586 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:10.871650 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:10.871669 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:10.871766 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:10.871980 (+ 214us) server_negotiation.cc:299] Negotiation successful
0807 04:21:10.872107 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":240,"threads_started":1}
I20260807 04:21:10.873333 29242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:10.861782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:34819 (local address 127.7.200.193:49839)
0807 04:21:10.862856 (+ 1074us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:10.862903 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:10.864794 (+ 1891us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:10.865505 (+ 711us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:10.865513 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:10.865607 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:21:10.866185 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:10.866202 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:10.867691 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:10.867694 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:10.869195 (+ 1501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:10.869208 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:10.870275 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:10.870280 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:10.870478 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:10.871215 (+ 737us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 04:21:10.871217 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:21:10.871262 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 04:21:10.871345 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:21:10.871770 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:21:10.871779 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:21:10.871785 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 04:21:10.871926 (+ 141us) client_negotiation.cc:240] Negotiation successful
0807 04:21:10.872226 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":345,"threads_started":1}
I20260807 04:21:10.874996 29239 heartbeater.cc:347] Connected to a master server at 127.7.200.254:34819
I20260807 04:21:10.875339 29239 heartbeater.cc:464] Registering TS with master...
I20260807 04:21:10.876264 29239 heartbeater.cc:511] Master 127.7.200.254:34819 requested a full tablet report, sending...
I20260807 04:21:10.878755 29042 ts_manager.cc:194] Registered new tserver with Master: 50b9a0fee83f4ff3b10958a4a0b71fb9 (127.7.200.193:39633)
I20260807 04:21:10.880450 29042 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.200.193:49839
W20260807 04:21:11.217223 29243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:11.217567 29243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:11.217737 29243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:11.225158 29243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:11.225293 29243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:11.225474 29243 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.194
I20260807 04:21:11.235131 29243 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:40907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.200.194
--webserver_port=0
--tserver_master_addrs=127.7.200.254:34819
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.194
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:11.236480 29243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:11.238438 29243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:11.252105 29248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:11.251994 29251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:11.252082 29249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:11.253226 29243 server_base.cc:1034] running on GCE node
I20260807 04:21:11.253912 29243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:11.255048 29243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:11.256315 29243 hybrid_clock.cc:648] HybridClock initialized: now 1786076471256254 us; error 45 us; skew 500 ppm
I20260807 04:21:11.256700 29243 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 04:21:11.259456 29243 webserver.cc:460] Webserver started at http://127.7.200.194:33183/ using document root <none> and password file <none>
I20260807 04:21:11.260329 29243 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:11.260478 29243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:11.260939 29243 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:11.264143 29243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-1/data/instance:
uuid: "a8b436a56c49458c8ead4245806f3fcc"
format_stamp: "Formatted at 2026-08-07 04:21:11 on dist-test-slave-qg60"
server_key: "457d31a7acfa3077407a48f5342e54bd"
server_key_iv: "4a7c4c985f737c9af4765328d8e8b0af"
server_key_version: "encryptionkey@0"
I20260807 04:21:11.265120 29243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance:
uuid: "a8b436a56c49458c8ead4245806f3fcc"
format_stamp: "Formatted at 2026-08-07 04:21:11 on dist-test-slave-qg60"
server_key: "457d31a7acfa3077407a48f5342e54bd"
server_key_iv: "4a7c4c985f737c9af4765328d8e8b0af"
server_key_version: "encryptionkey@0"
I20260807 04:21:11.270920 29243 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 04:21:11.274734 29258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:11.276108 29243 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 04:21:11.276316 29243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-1/wal
uuid: "a8b436a56c49458c8ead4245806f3fcc"
format_stamp: "Formatted at 2026-08-07 04:21:11 on dist-test-slave-qg60"
server_key: "457d31a7acfa3077407a48f5342e54bd"
server_key_iv: "4a7c4c985f737c9af4765328d8e8b0af"
server_key_version: "encryptionkey@0"
I20260807 04:21:11.276571 29243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:11.300463 29243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:11.301436 29243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:11.301811 29243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:11.302903 29243 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:21:11.304549 29243 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:21:11.304703 29243 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:11.304877 29243 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:21:11.304994 29243 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:11.341581 29243 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.194:39231
I20260807 04:21:11.341692 29378 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.194:39231 every 8 connection(s)
I20260807 04:21:11.343103 29243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-1/data/info.pb
I20260807 04:21:11.352500 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 29243
I20260807 04:21:11.352762 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-1/wal/instance
I20260807 04:21:11.353300 7971 external_mini_cluster.cc:1428] Setting key 6f571b8d86d01a5d6a5062df1e047e97
I20260807 04:21:11.356845 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.200.195:0
--local_ip_for_outbound_sockets=127.7.200.195
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:34819
--builtin_ntp_servers=127.7.200.212:40907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 04:21:11.356972 29241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:11.345989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.194:43599 (local address 127.7.200.254:34819)
0807 04:21:11.346203 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:11.346208 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:11.347638 (+ 1430us) server_negotiation.cc:407] Connection header received
0807 04:21:11.349524 (+ 1886us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:11.349529 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:11.349607 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:11.349716 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:11.350853 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:11.351666 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:11.353410 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:11.354059 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:11.354220 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:11.355991 (+ 1771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:11.355998 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:11.356003 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:11.356027 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:11.356072 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:11.356089 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:11.356202 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:11.356409 (+ 207us) server_negotiation.cc:299] Negotiation successful
0807 04:21:11.356536 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260807 04:21:11.358032 29381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:11.346547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:34819 (local address 127.7.200.194:43599)
0807 04:21:11.347493 (+ 946us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:11.347528 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:11.349256 (+ 1728us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:11.349976 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:11.349988 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:11.350123 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:21:11.350698 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:11.350714 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:11.351819 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:11.351823 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:11.353251 (+ 1428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:11.353263 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:11.354303 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:11.354308 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:11.354550 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:11.355644 (+ 1094us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 04:21:11.355647 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:21:11.355688 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 04:21:11.355774 (+ 86us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:21:11.356191 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:21:11.356199 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:21:11.356205 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 04:21:11.356351 (+ 146us) client_negotiation.cc:240] Negotiation successful
0807 04:21:11.356699 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":293,"threads_started":1}
I20260807 04:21:11.359601 29379 heartbeater.cc:347] Connected to a master server at 127.7.200.254:34819
I20260807 04:21:11.359910 29379 heartbeater.cc:464] Registering TS with master...
I20260807 04:21:11.360705 29379 heartbeater.cc:511] Master 127.7.200.254:34819 requested a full tablet report, sending...
I20260807 04:21:11.362303 29042 ts_manager.cc:194] Registered new tserver with Master: a8b436a56c49458c8ead4245806f3fcc (127.7.200.194:39231)
I20260807 04:21:11.363642 29042 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.200.194:43599
W20260807 04:21:11.707993 29382 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:11.708277 29382 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:11.708436 29382 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:11.715960 29382 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:11.716063 29382 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:11.716239 29382 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.200.195
I20260807 04:21:11.725620 29382 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:40907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.200.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.200.195
--webserver_port=0
--tserver_master_addrs=127.7.200.254:34819
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.200.195
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:11.727026 29382 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:11.728904 29382 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:11.742316 29387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:11.742480 29388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:11.742599 29390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:11.743494 29382 server_base.cc:1034] running on GCE node
I20260807 04:21:11.744187 29382 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:11.745322 29382 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:11.746546 29382 hybrid_clock.cc:648] HybridClock initialized: now 1786076471746504 us; error 27 us; skew 500 ppm
I20260807 04:21:11.746845 29382 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 04:21:11.749212 29382 webserver.cc:460] Webserver started at http://127.7.200.195:38937/ using document root <none> and password file <none>
I20260807 04:21:11.749890 29382 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:11.749992 29382 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:11.750273 29382 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:11.753475 29382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-2/data/instance:
uuid: "b45f314049a34b8584e903a0377bc585"
format_stamp: "Formatted at 2026-08-07 04:21:11 on dist-test-slave-qg60"
server_key: "4a455bdefdf4a9cf13242e95bac5b212"
server_key_iv: "f581bf7ddc534bdc52e3349a7e417c62"
server_key_version: "encryptionkey@0"
I20260807 04:21:11.754282 29382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance:
uuid: "b45f314049a34b8584e903a0377bc585"
format_stamp: "Formatted at 2026-08-07 04:21:11 on dist-test-slave-qg60"
server_key: "4a455bdefdf4a9cf13242e95bac5b212"
server_key_iv: "f581bf7ddc534bdc52e3349a7e417c62"
server_key_version: "encryptionkey@0"
I20260807 04:21:11.759824 29382 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 04:21:11.763501 29396 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:11.765085 29382 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:21:11.765275 29382 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-2/wal
uuid: "b45f314049a34b8584e903a0377bc585"
format_stamp: "Formatted at 2026-08-07 04:21:11 on dist-test-slave-qg60"
server_key: "4a455bdefdf4a9cf13242e95bac5b212"
server_key_iv: "f581bf7ddc534bdc52e3349a7e417c62"
server_key_version: "encryptionkey@0"
I20260807 04:21:11.765506 29382 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:11.783625 29382 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:11.784498 29382 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:11.784876 29382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:11.785895 29382 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 04:21:11.787524 29382 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 04:21:11.787653 29382 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:11.787781 29382 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 04:21:11.787865 29382 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:11.822579 29382 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.195:41553
I20260807 04:21:11.822671 29516 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.195:41553 every 8 connection(s)
I20260807 04:21:11.823931 29382 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-2/data/info.pb
I20260807 04:21:11.831696 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 29382
I20260807 04:21:11.831872 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-2/wal/instance
I20260807 04:21:11.832319 7971 external_mini_cluster.cc:1428] Setting key 606f71f4d7de83e5390e04bf90ef9838
I20260807 04:21:11.838109 29241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:11.826768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:57635 (local address 127.7.200.254:34819)
0807 04:21:11.827016 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:11.827023 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:11.828386 (+ 1363us) server_negotiation.cc:407] Connection header received
0807 04:21:11.830238 (+ 1852us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:11.830242 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:11.830313 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:11.830404 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:11.831570 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:11.832446 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:11.834615 (+ 2169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:11.835288 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:11.835440 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:11.837253 (+ 1813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:11.837259 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:11.837262 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:11.837282 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:11.837319 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:11.837333 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:11.837426 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:11.837722 (+ 296us) server_negotiation.cc:299] Negotiation successful
0807 04:21:11.837808 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260807 04:21:11.839272 29519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:11.827280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:34819 (local address 127.7.200.195:57635)
0807 04:21:11.828226 (+ 946us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:11.828268 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:11.829988 (+ 1720us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:11.830599 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:11.830606 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:11.830697 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:21:11.831385 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:11.831412 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:11.832603 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:11.832609 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:11.834470 (+ 1861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:11.834483 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:11.835635 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:11.835642 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:11.835870 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:11.836628 (+ 758us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 04:21:11.836631 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:21:11.836704 (+ 73us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 04:21:11.836876 (+ 172us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:21:11.837437 (+ 561us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:21:11.837445 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:21:11.837451 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 04:21:11.837637 (+ 186us) client_negotiation.cc:240] Negotiation successful
0807 04:21:11.837949 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":278,"threads_started":1}
I20260807 04:21:11.840838 29517 heartbeater.cc:347] Connected to a master server at 127.7.200.254:34819
I20260807 04:21:11.841167 29517 heartbeater.cc:464] Registering TS with master...
I20260807 04:21:11.842025 29517 heartbeater.cc:511] Master 127.7.200.254:34819 requested a full tablet report, sending...
I20260807 04:21:11.843592 29042 ts_manager.cc:194] Registered new tserver with Master: b45f314049a34b8584e903a0377bc585 (127.7.200.195:41553)
I20260807 04:21:11.844489 29042 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.200.195:57635
I20260807 04:21:11.848176 7971 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 04:21:11.858943 29241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:11.852405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41116 (local address 127.7.200.254:34819)
0807 04:21:11.852628 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:11.852638 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:11.853096 (+ 458us) server_negotiation.cc:407] Connection header received
0807 04:21:11.853288 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:11.853299 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:11.853363 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:11.853468 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:11.854039 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:11.854739 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:11.856128 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:11.856547 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:11.856692 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:11.857944 (+ 1252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:11.857949 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:11.857952 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:11.857969 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:11.858009 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:11.858023 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:11.858122 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:11.858271 (+ 149us) server_negotiation.cc:299] Negotiation successful
0807 04:21:11.858369 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 04:21:11.863062 29042 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41116:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 04:21:11.870173 29042 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 04:21:11.884698 29239 heartbeater.cc:503] Master 127.7.200.254:34819 was elected leader, sending a full tablet report...
I20260807 04:21:11.906073 29531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:11.882806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.195:41553 (local address 127.0.0.1:52592)
0807 04:21:11.895049 (+ 12243us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:11.895232 (+ 183us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:11.895340 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:11.896847 (+ 1507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:11.896858 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:11.896911 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:21:11.897378 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:11.897394 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:11.899910 (+ 2516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:11.899915 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:11.902559 (+ 2644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:11.902576 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:11.905039 (+ 2463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:11.905046 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:11.905299 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:11.905358 (+ 59us) client_negotiation.cc:769] Sending connection context
0807 04:21:11.905488 (+ 130us) client_negotiation.cc:240] Negotiation successful
0807 04:21:11.905710 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12125,"thread_start_us":11769,"threads_started":1}
I20260807 04:21:11.907342 29532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:11.882711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:39231 (local address 127.0.0.1:51684)
0807 04:21:11.895045 (+ 12334us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:11.895116 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:11.895380 (+ 264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:11.899390 (+ 4010us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:11.899395 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:11.899423 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:21:11.899950 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:11.899967 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:11.902207 (+ 2240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:11.902213 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:11.904423 (+ 2210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:11.904443 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:11.906462 (+ 2019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:11.906468 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:11.906678 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:11.906728 (+ 50us) client_negotiation.cc:769] Sending connection context
0807 04:21:11.906815 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 04:21:11.906969 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11968,"thread_start_us":24034,"threads_started":1}
I20260807 04:21:11.908345 29533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:11.883558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52592 (local address 127.7.200.195:41553)
0807 04:21:11.893322 (+ 9764us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:11.893337 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:11.895582 (+ 2245us) server_negotiation.cc:407] Connection header received
0807 04:21:11.895730 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:11.895742 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:11.896162 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:11.896398 (+ 236us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:21:11.897917 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:11.899690 (+ 1773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:11.902815 (+ 3125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:11.904361 (+ 1546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:11.904531 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:11.904888 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:11.907761 (+ 2873us) server_negotiation.cc:299] Negotiation successful
0807 04:21:11.907961 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9502,"thread_start_us":9313,"threads_started":1}
I20260807 04:21:11.908689 29530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:11.882738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51684 (local address 127.7.200.194:39231)
0807 04:21:11.898562 (+ 15824us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:11.898573 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:11.898607 (+ 34us) server_negotiation.cc:407] Connection header received
0807 04:21:11.898719 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:11.898728 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:11.898955 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:11.900207 (+ 1252us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:21:11.900453 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:11.902048 (+ 1595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:11.904698 (+ 2650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:11.906239 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:11.907795 (+ 1556us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:11.908060 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:11.908135 (+ 75us) server_negotiation.cc:299] Negotiation successful
0807 04:21:11.908312 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15618,"thread_start_us":16367,"threads_started":1}
I20260807 04:21:11.913147 29445 tablet_service.cc:1467] Processing CreateTablet for tablet 67723b1df9464cc7904f81aec8e82b12 (DEFAULT_TABLE table=test-table [id=f782f4834ca345e89c157fbfb243b803]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:21:11.913147 29311 tablet_service.cc:1467] Processing CreateTablet for tablet 67723b1df9464cc7904f81aec8e82b12 (DEFAULT_TABLE table=test-table [id=f782f4834ca345e89c157fbfb243b803]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:21:11.914780 29311 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67723b1df9464cc7904f81aec8e82b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:11.914778 29445 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67723b1df9464cc7904f81aec8e82b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:11.915271 29529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:11.883157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:39633 (local address 127.0.0.1:57378)
0807 04:21:11.907058 (+ 23901us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:11.907079 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:11.907200 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:11.908758 (+ 1558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:11.908767 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:11.908797 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:21:11.909186 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:11.909202 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:11.910897 (+ 1695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:11.910903 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:11.912246 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:11.912259 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:11.914378 (+ 2119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:11.914385 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:11.914571 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:11.914608 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 04:21:11.914715 (+ 107us) client_negotiation.cc:240] Negotiation successful
0807 04:21:11.914922 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23759,"thread_start_us":14421,"threads_started":1}
I20260807 04:21:11.915326 29534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:11.889275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57378 (local address 127.7.200.193:39633)
0807 04:21:11.907916 (+ 18641us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:11.907926 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:11.907962 (+ 36us) server_negotiation.cc:407] Connection header received
0807 04:21:11.908066 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:11.908074 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:11.908398 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:11.908634 (+ 236us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:21:11.909381 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:11.910750 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:11.912727 (+ 1977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:11.914167 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:11.914317 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:11.914603 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:11.914755 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 04:21:11.914939 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18433,"thread_start_us":19625,"threads_started":1}
I20260807 04:21:11.919008 29172 tablet_service.cc:1467] Processing CreateTablet for tablet 67723b1df9464cc7904f81aec8e82b12 (DEFAULT_TABLE table=test-table [id=f782f4834ca345e89c157fbfb243b803]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 04:21:11.920490 29172 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67723b1df9464cc7904f81aec8e82b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:11.930275 29535 tablet_bootstrap.cc:492] T 67723b1df9464cc7904f81aec8e82b12 P a8b436a56c49458c8ead4245806f3fcc: Bootstrap starting.
I20260807 04:21:11.931164 29536 tablet_bootstrap.cc:492] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585: Bootstrap starting.
I20260807 04:21:11.933531 29538 tablet_bootstrap.cc:492] T 67723b1df9464cc7904f81aec8e82b12 P 50b9a0fee83f4ff3b10958a4a0b71fb9: Bootstrap starting.
I20260807 04:21:11.935276 29535 tablet_bootstrap.cc:654] T 67723b1df9464cc7904f81aec8e82b12 P a8b436a56c49458c8ead4245806f3fcc: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:11.936673 29536 tablet_bootstrap.cc:654] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:11.936750 29535 log.cc:824] T 67723b1df9464cc7904f81aec8e82b12 P a8b436a56c49458c8ead4245806f3fcc: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:11.937353 29538 tablet_bootstrap.cc:654] T 67723b1df9464cc7904f81aec8e82b12 P 50b9a0fee83f4ff3b10958a4a0b71fb9: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:11.937986 29536 log.cc:824] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:11.938669 29538 log.cc:824] T 67723b1df9464cc7904f81aec8e82b12 P 50b9a0fee83f4ff3b10958a4a0b71fb9: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:11.940106 29535 tablet_bootstrap.cc:492] T 67723b1df9464cc7904f81aec8e82b12 P a8b436a56c49458c8ead4245806f3fcc: No bootstrap required, opened a new log
I20260807 04:21:11.940441 29535 ts_tablet_manager.cc:1397] T 67723b1df9464cc7904f81aec8e82b12 P a8b436a56c49458c8ead4245806f3fcc: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260807 04:21:11.940832 29536 tablet_bootstrap.cc:492] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585: No bootstrap required, opened a new log
I20260807 04:21:11.941100 29536 ts_tablet_manager.cc:1397] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.003s
I20260807 04:21:11.942680 29538 tablet_bootstrap.cc:492] T 67723b1df9464cc7904f81aec8e82b12 P 50b9a0fee83f4ff3b10958a4a0b71fb9: No bootstrap required, opened a new log
I20260807 04:21:11.942950 29538 ts_tablet_manager.cc:1397] T 67723b1df9464cc7904f81aec8e82b12 P 50b9a0fee83f4ff3b10958a4a0b71fb9: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260807 04:21:11.948909 29536 raft_consensus.cc:348] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8b436a56c49458c8ead4245806f3fcc" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 39231 } } peers { permanent_uuid: "b45f314049a34b8584e903a0377bc585" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41553 } } peers { permanent_uuid: "50b9a0fee83f4ff3b10958a4a0b71fb9" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 39633 } }
I20260807 04:21:11.949324 29536 raft_consensus.cc:374] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:11.949456 29536 raft_consensus.cc:729] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b45f314049a34b8584e903a0377bc585, State: Initialized, Role: FOLLOWER
I20260807 04:21:11.950181 29536 consensus_queue.cc:260] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8b436a56c49458c8ead4245806f3fcc" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 39231 } } peers { permanent_uuid: "b45f314049a34b8584e903a0377bc585" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41553 } } peers { permanent_uuid: "50b9a0fee83f4ff3b10958a4a0b71fb9" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 39633 } }
I20260807 04:21:11.951508 29517 heartbeater.cc:503] Master 127.7.200.254:34819 was elected leader, sending a full tablet report...
I20260807 04:21:11.951493 29535 raft_consensus.cc:348] T 67723b1df9464cc7904f81aec8e82b12 P a8b436a56c49458c8ead4245806f3fcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8b436a56c49458c8ead4245806f3fcc" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 39231 } } peers { permanent_uuid: "b45f314049a34b8584e903a0377bc585" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41553 } } peers { permanent_uuid: "50b9a0fee83f4ff3b10958a4a0b71fb9" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 39633 } }
I20260807 04:21:11.951948 29535 raft_consensus.cc:374] T 67723b1df9464cc7904f81aec8e82b12 P a8b436a56c49458c8ead4245806f3fcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:11.952044 29535 raft_consensus.cc:729] T 67723b1df9464cc7904f81aec8e82b12 P a8b436a56c49458c8ead4245806f3fcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8b436a56c49458c8ead4245806f3fcc, State: Initialized, Role: FOLLOWER
I20260807 04:21:11.952149 29536 ts_tablet_manager.cc:1428] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260807 04:21:11.952652 29535 consensus_queue.cc:260] T 67723b1df9464cc7904f81aec8e82b12 P a8b436a56c49458c8ead4245806f3fcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8b436a56c49458c8ead4245806f3fcc" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 39231 } } peers { permanent_uuid: "b45f314049a34b8584e903a0377bc585" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41553 } } peers { permanent_uuid: "50b9a0fee83f4ff3b10958a4a0b71fb9" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 39633 } }
I20260807 04:21:11.954771 29538 raft_consensus.cc:348] T 67723b1df9464cc7904f81aec8e82b12 P 50b9a0fee83f4ff3b10958a4a0b71fb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8b436a56c49458c8ead4245806f3fcc" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 39231 } } peers { permanent_uuid: "b45f314049a34b8584e903a0377bc585" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41553 } } peers { permanent_uuid: "50b9a0fee83f4ff3b10958a4a0b71fb9" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 39633 } }
I20260807 04:21:11.955369 29538 raft_consensus.cc:374] T 67723b1df9464cc7904f81aec8e82b12 P 50b9a0fee83f4ff3b10958a4a0b71fb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:11.955514 29538 raft_consensus.cc:729] T 67723b1df9464cc7904f81aec8e82b12 P 50b9a0fee83f4ff3b10958a4a0b71fb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50b9a0fee83f4ff3b10958a4a0b71fb9, State: Initialized, Role: FOLLOWER
I20260807 04:21:11.955765 29379 heartbeater.cc:503] Master 127.7.200.254:34819 was elected leader, sending a full tablet report...
I20260807 04:21:11.956231 29538 consensus_queue.cc:260] T 67723b1df9464cc7904f81aec8e82b12 P 50b9a0fee83f4ff3b10958a4a0b71fb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8b436a56c49458c8ead4245806f3fcc" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 39231 } } peers { permanent_uuid: "b45f314049a34b8584e903a0377bc585" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41553 } } peers { permanent_uuid: "50b9a0fee83f4ff3b10958a4a0b71fb9" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 39633 } }
I20260807 04:21:11.956486 29535 ts_tablet_manager.cc:1428] T 67723b1df9464cc7904f81aec8e82b12 P a8b436a56c49458c8ead4245806f3fcc: Time spent starting tablet: real 0.016s user 0.013s sys 0.004s
I20260807 04:21:11.959342 29538 ts_tablet_manager.cc:1428] T 67723b1df9464cc7904f81aec8e82b12 P 50b9a0fee83f4ff3b10958a4a0b71fb9: Time spent starting tablet: real 0.016s user 0.016s sys 0.000s
I20260807 04:21:12.006546 29542 raft_consensus.cc:482] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 04:21:12.006916 29542 raft_consensus.cc:504] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8b436a56c49458c8ead4245806f3fcc" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 39231 } } peers { permanent_uuid: "b45f314049a34b8584e903a0377bc585" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41553 } } peers { permanent_uuid: "50b9a0fee83f4ff3b10958a4a0b71fb9" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 39633 } }
I20260807 04:21:12.008790 29542 leader_election.cc:288] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8b436a56c49458c8ead4245806f3fcc (127.7.200.194:39231), 50b9a0fee83f4ff3b10958a4a0b71fb9 (127.7.200.193:39633)
I20260807 04:21:12.015651 29534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:12.009287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:59591 (local address 127.7.200.193:39633)
0807 04:21:12.009478 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:12.009484 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:12.009506 (+ 22us) server_negotiation.cc:407] Connection header received
0807 04:21:12.009715 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:12.009723 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:12.009838 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:12.009940 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:21:12.010449 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:12.011450 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:12.013526 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:12.014573 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:12.014707 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:12.014758 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:12.015226 (+ 468us) server_negotiation.cc:299] Negotiation successful
0807 04:21:12.015364 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 04:21:12.015714 29519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:12.009124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:39633 (local address 127.7.200.195:59591)
0807 04:21:12.009334 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:12.009356 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:12.009494 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:12.010005 (+ 511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:12.010009 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:12.010037 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:21:12.010274 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:12.010286 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:12.011608 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:12.011614 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:12.013343 (+ 1729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:12.013359 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:12.014755 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:12.014762 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:12.014971 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:12.015055 (+ 84us) client_negotiation.cc:769] Sending connection context
0807 04:21:12.015174 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 04:21:12.015333 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":20}
I20260807 04:21:12.016338 29530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:12.009339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.7.200.195:52461 (local address 127.7.200.194:39231)
0807 04:21:12.009568 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:12.009592 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:12.010201 (+ 609us) server_negotiation.cc:407] Connection header received
0807 04:21:12.010307 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:12.010315 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:12.010423 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:12.010552 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 04:21:12.011189 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:12.012125 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:12.014207 (+ 2082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:12.015242 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:12.015380 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:12.015489 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:12.015904 (+ 415us) server_negotiation.cc:299] Negotiation successful
0807 04:21:12.016065 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 04:21:12.016899 29545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:12.009168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.194:39231 (local address 127.7.200.195:52461)
0807 04:21:12.010063 (+ 895us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:12.010085 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:12.010205 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:12.010599 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:12.010605 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:12.010649 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 04:21:12.011031 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:12.011043 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:12.012278 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:12.012281 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:12.013990 (+ 1709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:12.014004 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:12.015418 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:12.015425 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:12.015665 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:12.015713 (+ 48us) client_negotiation.cc:769] Sending connection context
0807 04:21:12.016419 (+ 706us) client_negotiation.cc:240] Negotiation successful
0807 04:21:12.016562 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":772,"mutex_wait_us":134,"thread_start_us":397,"threads_started":1}
I20260807 04:21:12.017072 29193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67723b1df9464cc7904f81aec8e82b12" candidate_uuid: "b45f314049a34b8584e903a0377bc585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b9a0fee83f4ff3b10958a4a0b71fb9" is_pre_election: true
I20260807 04:21:12.017735 29193 raft_consensus.cc:2454] T 67723b1df9464cc7904f81aec8e82b12 P 50b9a0fee83f4ff3b10958a4a0b71fb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b45f314049a34b8584e903a0377bc585 in term 0.
I20260807 04:21:12.017953 29332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67723b1df9464cc7904f81aec8e82b12" candidate_uuid: "b45f314049a34b8584e903a0377bc585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8b436a56c49458c8ead4245806f3fcc" is_pre_election: true
I20260807 04:21:12.018559 29332 raft_consensus.cc:2454] T 67723b1df9464cc7904f81aec8e82b12 P a8b436a56c49458c8ead4245806f3fcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b45f314049a34b8584e903a0377bc585 in term 0.
I20260807 04:21:12.018533 29400 leader_election.cc:302] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b9a0fee83f4ff3b10958a4a0b71fb9, b45f314049a34b8584e903a0377bc585; no voters:
I20260807 04:21:12.019013 29542 raft_consensus.cc:2781] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 04:21:12.019212 29542 raft_consensus.cc:482] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 04:21:12.019357 29542 raft_consensus.cc:3037] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:12.022147 29542 raft_consensus.cc:504] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8b436a56c49458c8ead4245806f3fcc" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 39231 } } peers { permanent_uuid: "b45f314049a34b8584e903a0377bc585" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41553 } } peers { permanent_uuid: "50b9a0fee83f4ff3b10958a4a0b71fb9" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 39633 } }
I20260807 04:21:12.022868 29542 leader_election.cc:288] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585 [CANDIDATE]: Term 1 election: Requested vote from peers a8b436a56c49458c8ead4245806f3fcc (127.7.200.194:39231), 50b9a0fee83f4ff3b10958a4a0b71fb9 (127.7.200.193:39633)
I20260807 04:21:12.023406 29332 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67723b1df9464cc7904f81aec8e82b12" candidate_uuid: "b45f314049a34b8584e903a0377bc585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8b436a56c49458c8ead4245806f3fcc"
I20260807 04:21:12.023414 29193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67723b1df9464cc7904f81aec8e82b12" candidate_uuid: "b45f314049a34b8584e903a0377bc585" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b9a0fee83f4ff3b10958a4a0b71fb9"
I20260807 04:21:12.023629 29332 raft_consensus.cc:3037] T 67723b1df9464cc7904f81aec8e82b12 P a8b436a56c49458c8ead4245806f3fcc [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:12.023655 29193 raft_consensus.cc:3037] T 67723b1df9464cc7904f81aec8e82b12 P 50b9a0fee83f4ff3b10958a4a0b71fb9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:12.025964 29332 raft_consensus.cc:2454] T 67723b1df9464cc7904f81aec8e82b12 P a8b436a56c49458c8ead4245806f3fcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b45f314049a34b8584e903a0377bc585 in term 1.
I20260807 04:21:12.025954 29193 raft_consensus.cc:2454] T 67723b1df9464cc7904f81aec8e82b12 P 50b9a0fee83f4ff3b10958a4a0b71fb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b45f314049a34b8584e903a0377bc585 in term 1.
I20260807 04:21:12.026412 29400 leader_election.cc:302] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b9a0fee83f4ff3b10958a4a0b71fb9, b45f314049a34b8584e903a0377bc585; no voters:
I20260807 04:21:12.026748 29542 raft_consensus.cc:2781] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:21:12.027232 29542 raft_consensus.cc:686] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585 [term 1 LEADER]: Becoming Leader. State: Replica: b45f314049a34b8584e903a0377bc585, State: Running, Role: LEADER
I20260807 04:21:12.027740 29542 consensus_queue.cc:237] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8b436a56c49458c8ead4245806f3fcc" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 39231 } } peers { permanent_uuid: "b45f314049a34b8584e903a0377bc585" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41553 } } peers { permanent_uuid: "50b9a0fee83f4ff3b10958a4a0b71fb9" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 39633 } }
I20260807 04:21:12.032511 29040 catalog_manager.cc:5495] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585 reported cstate change: term changed from 0 to 1, leader changed from <none> to b45f314049a34b8584e903a0377bc585 (127.7.200.195). New cstate: current_term: 1 leader_uuid: "b45f314049a34b8584e903a0377bc585" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8b436a56c49458c8ead4245806f3fcc" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 39231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b45f314049a34b8584e903a0377bc585" member_type: VOTER last_known_addr { host: "127.7.200.195" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50b9a0fee83f4ff3b10958a4a0b71fb9" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 39633 } health_report { overall_health: UNKNOWN } } }
I20260807 04:21:12.062220 29533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:12.056825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52598 (local address 127.7.200.195:41553)
0807 04:21:12.057006 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:12.057010 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:12.057028 (+ 18us) server_negotiation.cc:407] Connection header received
0807 04:21:12.057319 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:12.057325 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:12.057409 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:12.057543 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:21:12.057883 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:12.058727 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:12.060123 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:12.060515 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:12.060608 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:12.061126 (+ 518us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:21:12.061744 (+ 618us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:21:12.061920 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:12.061968 (+ 48us) server_negotiation.cc:299] Negotiation successful
0807 04:21:12.062032 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 04:21:12.071053 29193 raft_consensus.cc:1261] T 67723b1df9464cc7904f81aec8e82b12 P 50b9a0fee83f4ff3b10958a4a0b71fb9 [term 1 FOLLOWER]: Refusing update from remote peer b45f314049a34b8584e903a0377bc585: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:21:12.071074 29332 raft_consensus.cc:1261] T 67723b1df9464cc7904f81aec8e82b12 P a8b436a56c49458c8ead4245806f3fcc [term 1 FOLLOWER]: Refusing update from remote peer b45f314049a34b8584e903a0377bc585: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:21:12.072031 29546 consensus_queue.cc:1035] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b9a0fee83f4ff3b10958a4a0b71fb9" member_type: VOTER last_known_addr { host: "127.7.200.193" port: 39633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:21:12.072417 29542 consensus_queue.cc:1035] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8b436a56c49458c8ead4245806f3fcc" member_type: VOTER last_known_addr { host: "127.7.200.194" port: 39231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 04:21:12.075747 29518 tablet.cc:2369] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:21:12.110149 29040 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:21:12.110492 29040 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 04:21:12.114686 29040 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 41ed0c6ef3a8401e8b9e8bc48e713c1d: Sending DeleteTablet for 3 replicas of tablet 67723b1df9464cc7904f81aec8e82b12
I20260807 04:21:12.116147 29445 tablet_service.cc:1514] Processing DeleteTablet for tablet 67723b1df9464cc7904f81aec8e82b12 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:21:12 UTC) from {username='slave'} at 127.0.0.1:52592
I20260807 04:21:12.116113 29311 tablet_service.cc:1514] Processing DeleteTablet for tablet 67723b1df9464cc7904f81aec8e82b12 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:21:12 UTC) from {username='slave'} at 127.0.0.1:51684
I20260807 04:21:12.116276 29172 tablet_service.cc:1514] Processing DeleteTablet for tablet 67723b1df9464cc7904f81aec8e82b12 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 04:21:12 UTC) from {username='slave'} at 127.0.0.1:57378
I20260807 04:21:12.123942 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 29104
I20260807 04:21:12.132688 29561 tablet_replica.cc:330] T 67723b1df9464cc7904f81aec8e82b12 P 50b9a0fee83f4ff3b10958a4a0b71fb9: stopping tablet replica
I20260807 04:21:12.133308 29561 raft_consensus.cc:2229] T 67723b1df9464cc7904f81aec8e82b12 P 50b9a0fee83f4ff3b10958a4a0b71fb9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:21:12.133910 29561 raft_consensus.cc:2258] T 67723b1df9464cc7904f81aec8e82b12 P 50b9a0fee83f4ff3b10958a4a0b71fb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:21:12.136833 29561 ts_tablet_manager.cc:1905] T 67723b1df9464cc7904f81aec8e82b12 P 50b9a0fee83f4ff3b10958a4a0b71fb9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:21:12.139287 29560 tablet_replica.cc:330] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585: stopping tablet replica
I20260807 04:21:12.139889 29560 raft_consensus.cc:2229] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585 [term 1 LEADER]: Raft consensus shutting down.
I20260807 04:21:12.140744 29560 raft_consensus.cc:2258] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:21:12.144145 29534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:12.125571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57390 (local address 127.7.200.193:39633)
0807 04:21:12.125823 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:12.125832 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:12.134767 (+ 8935us) server_negotiation.cc:407] Connection header received
0807 04:21:12.134987 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:12.134992 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:12.135101 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:12.135222 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:12.136006 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:12.137175 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:12.139603 (+ 2428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:12.140256 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:12.140353 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:12.142344 (+ 1991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:12.142356 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:12.142372 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:12.143200 (+ 828us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:12.143261 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:12.143287 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:12.143379 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:12.143658 (+ 279us) server_negotiation.cc:299] Negotiation successful
0807 04:21:12.143772 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260807 04:21:12.144810 29561 ts_tablet_manager.cc:1918] T 67723b1df9464cc7904f81aec8e82b12 P 50b9a0fee83f4ff3b10958a4a0b71fb9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:21:12.144991 29561 log.cc:1196] T 67723b1df9464cc7904f81aec8e82b12 P 50b9a0fee83f4ff3b10958a4a0b71fb9: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-0/wal/wals/67723b1df9464cc7904f81aec8e82b12
I20260807 04:21:12.145596 29561 ts_tablet_manager.cc:1939] T 67723b1df9464cc7904f81aec8e82b12 P 50b9a0fee83f4ff3b10958a4a0b71fb9: Deleting consensus metadata
I20260807 04:21:12.145843 29234 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:21:12.148811 29560 ts_tablet_manager.cc:1905] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:21:12.149359 29559 tablet_replica.cc:330] T 67723b1df9464cc7904f81aec8e82b12 P a8b436a56c49458c8ead4245806f3fcc: stopping tablet replica
I20260807 04:21:12.149824 29559 raft_consensus.cc:2229] T 67723b1df9464cc7904f81aec8e82b12 P a8b436a56c49458c8ead4245806f3fcc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 04:21:12.150365 29559 raft_consensus.cc:2258] T 67723b1df9464cc7904f81aec8e82b12 P a8b436a56c49458c8ead4245806f3fcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 04:21:12.153766 29559 ts_tablet_manager.cc:1905] T 67723b1df9464cc7904f81aec8e82b12 P a8b436a56c49458c8ead4245806f3fcc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 04:21:12.156948 29560 ts_tablet_manager.cc:1918] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:21:12.157171 29560 log.cc:1196] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-2/wal/wals/67723b1df9464cc7904f81aec8e82b12
I20260807 04:21:12.157878 29560 ts_tablet_manager.cc:1939] T 67723b1df9464cc7904f81aec8e82b12 P b45f314049a34b8584e903a0377bc585: Deleting consensus metadata
I20260807 04:21:12.159832 29027 catalog_manager.cc:4841] TS b45f314049a34b8584e903a0377bc585 (127.7.200.195:41553): tablet 67723b1df9464cc7904f81aec8e82b12 (table test-table [id=f782f4834ca345e89c157fbfb243b803]) successfully deleted
I20260807 04:21:12.161206 29559 ts_tablet_manager.cc:1918] T 67723b1df9464cc7904f81aec8e82b12 P a8b436a56c49458c8ead4245806f3fcc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 04:21:12.161379 29559 log.cc:1196] T 67723b1df9464cc7904f81aec8e82b12 P a8b436a56c49458c8ead4245806f3fcc: Deleting WAL directory at /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786076137270840-7971-0/minicluster-data/ts-1/wal/wals/67723b1df9464cc7904f81aec8e82b12
I20260807 04:21:12.161943 29559 ts_tablet_manager.cc:1939] T 67723b1df9464cc7904f81aec8e82b12 P a8b436a56c49458c8ead4245806f3fcc: Deleting consensus metadata
I20260807 04:21:12.163831 29025 catalog_manager.cc:4841] TS a8b436a56c49458c8ead4245806f3fcc (127.7.200.194:39231): tablet 67723b1df9464cc7904f81aec8e82b12 (table test-table [id=f782f4834ca345e89c157fbfb243b803]) successfully deleted
I20260807 04:21:12.256028 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 29104
I20260807 04:21:12.283324 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 29243
W20260807 04:21:12.283478 29028 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.200.193:39633 (error 108)
I20260807 04:21:12.285768 29529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:12.285324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:39633 (local address 127.0.0.1:57402)
0807 04:21:12.285520 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:12.285631 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:39633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260807 04:21:12.286091 29028 catalog_manager.cc:4584] TS 50b9a0fee83f4ff3b10958a4a0b71fb9 (127.7.200.193:39633): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 67723b1df9464cc7904f81aec8e82b12: Network error: Client connection negotiation failed: client connection to 127.7.200.193:39633: connect: Connection refused (error 111)
I20260807 04:21:12.296252 29530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:12.284267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51694 (local address 127.7.200.194:39231)
0807 04:21:12.284456 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:12.284462 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:12.284484 (+ 22us) server_negotiation.cc:407] Connection header received
0807 04:21:12.284704 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:12.284709 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:12.284863 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:12.284962 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:12.285603 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:12.286772 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:12.288105 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:12.288788 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:12.288918 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:12.294484 (+ 5566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:12.294497 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:12.294517 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:12.295326 (+ 809us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:12.295395 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:12.295428 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:12.295552 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:12.295682 (+ 130us) server_negotiation.cc:299] Negotiation successful
0807 04:21:12.295806 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 04:21:12.297073 29374 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:21:12.339852 29529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:12.339247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:39633 (local address 127.0.0.1:57418)
0807 04:21:12.339510 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:12.339647 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:39633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260807 04:21:12.341116 29529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:12.340683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:39633 (local address 127.0.0.1:57432)
0807 04:21:12.340878 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:12.340965 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:39633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260807 04:21:12.391388 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 29243
I20260807 04:21:12.402086 29529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:12.401441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:39633 (local address 127.0.0.1:57442)
0807 04:21:12.401717 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:12.401851 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:39633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260807 04:21:12.403489 29529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:12.402938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:39633 (local address 127.0.0.1:57458)
0807 04:21:12.403184 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:12.403281 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:39633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260807 04:21:12.413177 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 29382
I20260807 04:21:12.424692 29533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:12.414058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52604 (local address 127.7.200.195:41553)
0807 04:21:12.414238 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:12.414245 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:12.414487 (+ 242us) server_negotiation.cc:407] Connection header received
0807 04:21:12.414565 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:12.414570 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:12.414707 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:12.414812 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:12.415621 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:12.417105 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:12.419418 (+ 2313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:12.420308 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:12.420463 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:12.422225 (+ 1762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:12.422240 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:12.422264 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:12.423196 (+ 932us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:12.423256 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:12.423282 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:12.423441 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:12.424048 (+ 607us) server_negotiation.cc:299] Negotiation successful
0807 04:21:12.424174 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 04:21:12.425570 29512 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:21:12.484269 29529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:12.483762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:39633 (local address 127.0.0.1:57468)
0807 04:21:12.484002 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:12.484104 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:39633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260807 04:21:12.485549 29529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:12.485089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:39633 (local address 127.0.0.1:57480)
0807 04:21:12.485336 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:12.485427 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:39633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260807 04:21:12.612561 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 29382
I20260807 04:21:12.648494 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 29010
I20260807 04:21:12.649850 29072 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:21:12.764576 29529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:12.763937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.193:39633 (local address 127.0.0.1:57488)
0807 04:21:12.764187 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:12.764318 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.193:39633: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260807 04:21:12.765151 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 29010
2026-08-07T04:21:12Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (3093 ms)
[----------] 6 tests from EncryptionPolicyTest (23579 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:21:12 dist-test-slave-qg60 krb5kdc[29570](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:21:12 dist-test-slave-qg60 krb5kdc[29570](info): set up 2 sockets
Aug 07 04:21:12 dist-test-slave-qg60 krb5kdc[29570](info): commencing operation
krb5kdc: starting...
W20260807 04:21:13.970098 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.158s user 0.004s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:21:14 dist-test-slave-qg60 krb5kdc[29570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076474, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:21:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:21:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 04:21:14.308977 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36301
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36301
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:21:14.659452 29584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:14.659770 29584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:14.659873 29584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:14.667290 29584 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:21:14.667431 29584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:14.667479 29584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:14.667534 29584 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:21:14.667582 29584 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:21:14.677963 29584 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36301
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:14.679349 29584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:14.680645 29584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:14.693282 29589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:14.693306 29595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:14.693753 29592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:14.694762 29584 server_base.cc:1034] running on GCE node
I20260807 04:21:14.695683 29584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:14.697180 29584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:14.698421 29584 hybrid_clock.cc:648] HybridClock initialized: now 1786076474698361 us; error 37 us; skew 500 ppm
I20260807 04:21:14.698799 29584 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:21:14 dist-test-slave-qg60 krb5kdc[29570](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076474, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:21:14.702299 29584 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 04:21:14.703806 29584 webserver.cc:460] Webserver started at http://127.0.0.1:36981/ using document root <none> and password file <none>
I20260807 04:21:14.704526 29584 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:14.704685 29584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:14.705148 29584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:14.708380 29584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "e99cc1a0854f4e20a5d64b83ec4a0eb0"
format_stamp: "Formatted at 2026-08-07 04:21:14 on dist-test-slave-qg60"
server_key: "7933e480c52d86ae30e644090ed91dfd"
server_key_iv: "a05b9da57a25efcf51a64eef501aa2fe"
server_key_version: "encryptionkey@0"
I20260807 04:21:14.709221 29584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "e99cc1a0854f4e20a5d64b83ec4a0eb0"
format_stamp: "Formatted at 2026-08-07 04:21:14 on dist-test-slave-qg60"
server_key: "7933e480c52d86ae30e644090ed91dfd"
server_key_iv: "a05b9da57a25efcf51a64eef501aa2fe"
server_key_version: "encryptionkey@0"
I20260807 04:21:14.714634 29584 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 04:21:14.718225 29602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:14.719719 29584 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:21:14.719937 29584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "e99cc1a0854f4e20a5d64b83ec4a0eb0"
format_stamp: "Formatted at 2026-08-07 04:21:14 on dist-test-slave-qg60"
server_key: "7933e480c52d86ae30e644090ed91dfd"
server_key_iv: "a05b9da57a25efcf51a64eef501aa2fe"
server_key_version: "encryptionkey@0"
I20260807 04:21:14.720161 29584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:14.745915 29584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:14.751112 29584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:14.751446 29584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:14.771651 29584 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36301
I20260807 04:21:14.771706 29655 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36301 every 8 connection(s)
I20260807 04:21:14.773202 29584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:21:14.777042 29656 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:14.782595 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 29584
I20260807 04:21:14.782835 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:21:14.783543 7971 external_mini_cluster.cc:1428] Setting key 5319ceaaef07ac841acc6e2324f337d7
I20260807 04:21:14.787725 29656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e99cc1a0854f4e20a5d64b83ec4a0eb0: Bootstrap starting.
I20260807 04:21:14.791584 29656 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e99cc1a0854f4e20a5d64b83ec4a0eb0: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:14.792723 29656 log.cc:824] T 00000000000000000000000000000000 P e99cc1a0854f4e20a5d64b83ec4a0eb0: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:14.796005 29656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e99cc1a0854f4e20a5d64b83ec4a0eb0: No bootstrap required, opened a new log
Aug 07 04:21:14 dist-test-slave-qg60 krb5kdc[29570](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076474, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 04:21:14.806864 29656 raft_consensus.cc:348] T 00000000000000000000000000000000 P e99cc1a0854f4e20a5d64b83ec4a0eb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e99cc1a0854f4e20a5d64b83ec4a0eb0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36301 } }
I20260807 04:21:14.807358 29656 raft_consensus.cc:374] T 00000000000000000000000000000000 P e99cc1a0854f4e20a5d64b83ec4a0eb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:14.807504 29656 raft_consensus.cc:729] T 00000000000000000000000000000000 P e99cc1a0854f4e20a5d64b83ec4a0eb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e99cc1a0854f4e20a5d64b83ec4a0eb0, State: Initialized, Role: FOLLOWER
I20260807 04:21:14.808182 29656 consensus_queue.cc:260] T 00000000000000000000000000000000 P e99cc1a0854f4e20a5d64b83ec4a0eb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e99cc1a0854f4e20a5d64b83ec4a0eb0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36301 } }
I20260807 04:21:14.808506 29656 raft_consensus.cc:388] T 00000000000000000000000000000000 P e99cc1a0854f4e20a5d64b83ec4a0eb0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:21:14.808646 29656 raft_consensus.cc:482] T 00000000000000000000000000000000 P e99cc1a0854f4e20a5d64b83ec4a0eb0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:21:14.808854 29656 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e99cc1a0854f4e20a5d64b83ec4a0eb0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:14.809252 29659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:14.785545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56677 (local address 127.0.0.1:36301)
0807 04:21:14.786405 (+ 860us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:14.786417 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:14.786456 (+ 39us) server_negotiation.cc:407] Connection header received
0807 04:21:14.788269 (+ 1813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:14.788291 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:14.788663 (+ 372us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:14.789065 (+ 402us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:14.791092 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:14.792530 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:14.794181 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:14.794900 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:14.795060 (+ 160us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:14.800104 (+ 5044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:14.800116 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:14.800136 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:14.800198 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:14.804374 (+ 4176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:14.805295 (+ 921us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:14.805304 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:14.805313 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:14.805533 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:14.805989 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:14.805996 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:14.806001 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:14.806701 (+ 700us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:14.807048 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:14.807447 (+ 399us) server_negotiation.cc:299] Negotiation successful
0807 04:21:14.807786 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":658,"thread_start_us":437,"threads_started":1}
I20260807 04:21:14.811902 29656 raft_consensus.cc:504] T 00000000000000000000000000000000 P e99cc1a0854f4e20a5d64b83ec4a0eb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e99cc1a0854f4e20a5d64b83ec4a0eb0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36301 } }
I20260807 04:21:14.812430 29656 leader_election.cc:302] T 00000000000000000000000000000000 P e99cc1a0854f4e20a5d64b83ec4a0eb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e99cc1a0854f4e20a5d64b83ec4a0eb0; no voters:
I20260807 04:21:14.813256 29656 leader_election.cc:288] T 00000000000000000000000000000000 P e99cc1a0854f4e20a5d64b83ec4a0eb0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:21:14.813367 29661 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e99cc1a0854f4e20a5d64b83ec4a0eb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:21:14.813603 7971 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 04:21:14.814064 29661 raft_consensus.cc:686] T 00000000000000000000000000000000 P e99cc1a0854f4e20a5d64b83ec4a0eb0 [term 1 LEADER]: Becoming Leader. State: Replica: e99cc1a0854f4e20a5d64b83ec4a0eb0, State: Running, Role: LEADER
I20260807 04:21:14.814785 29661 consensus_queue.cc:237] T 00000000000000000000000000000000 P e99cc1a0854f4e20a5d64b83ec4a0eb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e99cc1a0854f4e20a5d64b83ec4a0eb0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36301 } }
I20260807 04:21:14.818379 29663 sys_catalog.cc:455] T 00000000000000000000000000000000 P e99cc1a0854f4e20a5d64b83ec4a0eb0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e99cc1a0854f4e20a5d64b83ec4a0eb0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e99cc1a0854f4e20a5d64b83ec4a0eb0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36301 } } }
I20260807 04:21:14.818864 29663 sys_catalog.cc:458] T 00000000000000000000000000000000 P e99cc1a0854f4e20a5d64b83ec4a0eb0 [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:14.823346 29661 sys_catalog.cc:455] T 00000000000000000000000000000000 P e99cc1a0854f4e20a5d64b83ec4a0eb0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e99cc1a0854f4e20a5d64b83ec4a0eb0. Latest consensus state: current_term: 1 leader_uuid: "e99cc1a0854f4e20a5d64b83ec4a0eb0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e99cc1a0854f4e20a5d64b83ec4a0eb0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36301 } } }
I20260807 04:21:14.823609 29661 sys_catalog.cc:458] T 00000000000000000000000000000000 P e99cc1a0854f4e20a5d64b83ec4a0eb0 [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:14.828559 29656 sys_catalog.cc:564] T 00000000000000000000000000000000 P e99cc1a0854f4e20a5d64b83ec4a0eb0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:21:14.828847 29667 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:21:14.834828 29667 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:21:14.856775 29659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:14.829909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36215 (local address 127.0.0.1:36301)
0807 04:21:14.830096 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:14.830102 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:14.836901 (+ 6799us) server_negotiation.cc:407] Connection header received
0807 04:21:14.838197 (+ 1296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:14.838205 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:14.838280 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:14.838346 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:14.840667 (+ 2321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:14.841933 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:14.843976 (+ 2043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:14.844678 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:14.844806 (+ 128us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:14.848554 (+ 3748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:14.848561 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:14.848566 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:14.848610 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:14.852675 (+ 4065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:14.853793 (+ 1118us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:14.853799 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:14.853803 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:14.853967 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:14.854599 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:14.854605 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:14.854608 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:14.855080 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:14.855350 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:14.856147 (+ 797us) server_negotiation.cc:299] Negotiation successful
0807 04:21:14.856355 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 04:21:14.859926 29667 catalog_manager.cc:1347] Generated new cluster ID: a83ac1337d63485a941b539ca0c6f113
I20260807 04:21:14.860059 29667 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:21:14.883090 29667 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:21:14.884708 29667 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:21:14.895093 29667 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e99cc1a0854f4e20a5d64b83ec4a0eb0: Generated new TSK 0
I20260807 04:21:14.896339 29667 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:21:14.908960 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 29584
I20260807 04:21:14.911182 29651 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:21:15.006395 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 29584
W20260807 04:21:15.024802 29568 connection.cc:535] client connection to 127.0.0.1:36301 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36301): Connection reset by peer (error 104)
2026-08-07T04:21:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2233 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:21:15 dist-test-slave-qg60 krb5kdc[29693](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:21:15 dist-test-slave-qg60 krb5kdc[29693](info): set up 2 sockets
Aug 07 04:21:15 dist-test-slave-qg60 krb5kdc[29693](info): commencing operation
krb5kdc: starting...
W20260807 04:21:16.230374 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.186s user 0.001s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:21:16 dist-test-slave-qg60 krb5kdc[29693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076476, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:21:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:21:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 04:21:16.573099 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42301
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42301
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:21:16.927248 29706 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:16.927546 29706 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:16.927747 29706 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:16.935107 29706 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:21:16.935215 29706 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:16.935328 29706 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:16.935434 29706 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:21:16.935514 29706 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:21:16.945573 29706 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42301
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:16.946962 29706 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:16.948347 29706 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:16.960491 29711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:16.960454 29714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:16.960536 29712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:16.961738 29706 server_base.cc:1034] running on GCE node
I20260807 04:21:16.962491 29706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:16.963850 29706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:16.965054 29706 hybrid_clock.cc:648] HybridClock initialized: now 1786076476965013 us; error 44 us; skew 500 ppm
I20260807 04:21:16.965360 29706 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:21:16 dist-test-slave-qg60 krb5kdc[29693](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076476, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:21:16.968544 29706 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 04:21:16.970155 29706 webserver.cc:460] Webserver started at http://127.0.0.1:43651/ using document root <none> and password file <none>
I20260807 04:21:16.970808 29706 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:16.970916 29706 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:16.971172 29706 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:16.974257 29706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "ecb236e5485848439d6431ce5bb3398d"
format_stamp: "Formatted at 2026-08-07 04:21:16 on dist-test-slave-qg60"
server_key: "1543f978a0315e9f10b3748175d10847"
server_key_iv: "bd6fe7e515c7c35a120a78fb64aa82af"
server_key_version: "encryptionkey@0"
I20260807 04:21:16.974978 29706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "ecb236e5485848439d6431ce5bb3398d"
format_stamp: "Formatted at 2026-08-07 04:21:16 on dist-test-slave-qg60"
server_key: "1543f978a0315e9f10b3748175d10847"
server_key_iv: "bd6fe7e515c7c35a120a78fb64aa82af"
server_key_version: "encryptionkey@0"
I20260807 04:21:16.980049 29706 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 04:21:16.983446 29721 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:16.984830 29706 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:21:16.984963 29706 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "ecb236e5485848439d6431ce5bb3398d"
format_stamp: "Formatted at 2026-08-07 04:21:16 on dist-test-slave-qg60"
server_key: "1543f978a0315e9f10b3748175d10847"
server_key_iv: "bd6fe7e515c7c35a120a78fb64aa82af"
server_key_version: "encryptionkey@0"
I20260807 04:21:16.985133 29706 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:17.000146 29706 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:17.004506 29706 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:17.004828 29706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:17.023566 29706 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42301
I20260807 04:21:17.023602 29777 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42301 every 8 connection(s)
I20260807 04:21:17.025039 29706 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:21:17.026595 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 29706
I20260807 04:21:17.026784 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:21:17.027261 7971 external_mini_cluster.cc:1428] Setting key 3f69d3528a1b74b53a995eab5ffb226d
I20260807 04:21:17.029752 29778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:17.043177 29781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:17.029142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48243 (local address 127.0.0.1:42301)
0807 04:21:17.029962 (+ 820us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:17.029976 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:17.030030 (+ 54us) server_negotiation.cc:407] Connection header received
0807 04:21:17.032470 (+ 2440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:17.032496 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:17.033048 (+ 552us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:17.033483 (+ 435us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:17.034033 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:17.036095 (+ 2062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:17.037596 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:17.038685 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:17.038868 (+ 183us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:17.040113 (+ 1245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:17.040123 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:17.040147 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:17.040951 (+ 804us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:17.041059 (+ 108us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:17.041097 (+ 38us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:17.041264 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:17.041550 (+ 286us) server_negotiation.cc:299] Negotiation successful
0807 04:21:17.041758 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":336,"threads_started":1}
I20260807 04:21:17.044358 29778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecb236e5485848439d6431ce5bb3398d: Bootstrap starting.
I20260807 04:21:17.047277 7971 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 04:21:17.047848 29778 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ecb236e5485848439d6431ce5bb3398d: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:17.049187 29778 log.cc:824] T 00000000000000000000000000000000 P ecb236e5485848439d6431ce5bb3398d: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:17.052703 29778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecb236e5485848439d6431ce5bb3398d: No bootstrap required, opened a new log
I20260807 04:21:17.059970 29781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:17.052721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52455 (local address 127.0.0.1:42301)
0807 04:21:17.052933 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:17.052940 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:17.053508 (+ 568us) server_negotiation.cc:407] Connection header received
0807 04:21:17.053680 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:17.053685 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:17.053759 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:17.053877 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:17.054415 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:17.055685 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:17.057098 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:17.057789 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:17.057933 (+ 144us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:17.059115 (+ 1182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:17.059121 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:17.059126 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:17.059148 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:17.059217 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:17.059242 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:17.059354 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:17.059530 (+ 176us) server_negotiation.cc:299] Negotiation successful
0807 04:21:17.059593 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 04:21:17.062551 29778 raft_consensus.cc:348] T 00000000000000000000000000000000 P ecb236e5485848439d6431ce5bb3398d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecb236e5485848439d6431ce5bb3398d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42301 } }
I20260807 04:21:17.062932 29778 raft_consensus.cc:374] T 00000000000000000000000000000000 P ecb236e5485848439d6431ce5bb3398d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:17.063007 29778 raft_consensus.cc:729] T 00000000000000000000000000000000 P ecb236e5485848439d6431ce5bb3398d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecb236e5485848439d6431ce5bb3398d, State: Initialized, Role: FOLLOWER
I20260807 04:21:17.063529 29778 consensus_queue.cc:260] T 00000000000000000000000000000000 P ecb236e5485848439d6431ce5bb3398d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecb236e5485848439d6431ce5bb3398d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42301 } }
I20260807 04:21:17.063742 29778 raft_consensus.cc:388] T 00000000000000000000000000000000 P ecb236e5485848439d6431ce5bb3398d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:21:17.063845 29778 raft_consensus.cc:482] T 00000000000000000000000000000000 P ecb236e5485848439d6431ce5bb3398d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:21:17.063964 29778 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ecb236e5485848439d6431ce5bb3398d [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:17.066388 29778 raft_consensus.cc:504] T 00000000000000000000000000000000 P ecb236e5485848439d6431ce5bb3398d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecb236e5485848439d6431ce5bb3398d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42301 } }
I20260807 04:21:17.066951 29778 leader_election.cc:302] T 00000000000000000000000000000000 P ecb236e5485848439d6431ce5bb3398d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ecb236e5485848439d6431ce5bb3398d; no voters:
I20260807 04:21:17.067569 29778 leader_election.cc:288] T 00000000000000000000000000000000 P ecb236e5485848439d6431ce5bb3398d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:21:17.067744 29788 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ecb236e5485848439d6431ce5bb3398d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:21:17.068488 29788 raft_consensus.cc:686] T 00000000000000000000000000000000 P ecb236e5485848439d6431ce5bb3398d [term 1 LEADER]: Becoming Leader. State: Replica: ecb236e5485848439d6431ce5bb3398d, State: Running, Role: LEADER
I20260807 04:21:17.069067 29788 consensus_queue.cc:237] T 00000000000000000000000000000000 P ecb236e5485848439d6431ce5bb3398d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecb236e5485848439d6431ce5bb3398d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42301 } }
I20260807 04:21:17.069772 29778 sys_catalog.cc:564] T 00000000000000000000000000000000 P ecb236e5485848439d6431ce5bb3398d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:21:17.072247 29790 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecb236e5485848439d6431ce5bb3398d [sys.catalog]: SysCatalogTable state changed. Reason: New leader ecb236e5485848439d6431ce5bb3398d. Latest consensus state: current_term: 1 leader_uuid: "ecb236e5485848439d6431ce5bb3398d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecb236e5485848439d6431ce5bb3398d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42301 } } }
I20260807 04:21:17.072753 29790 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecb236e5485848439d6431ce5bb3398d [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:17.074101 29789 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecb236e5485848439d6431ce5bb3398d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ecb236e5485848439d6431ce5bb3398d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ecb236e5485848439d6431ce5bb3398d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42301 } } }
I20260807 04:21:17.074393 29789 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecb236e5485848439d6431ce5bb3398d [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:17.081773 29796 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:21:17.086184 29796 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:21:17.095651 29796 catalog_manager.cc:1347] Generated new cluster ID: edd51a3eea824903816e3368b17ad391
I20260807 04:21:17.095758 29796 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:21:17.106568 29796 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:21:17.108304 29796 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:21:17.123939 29796 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ecb236e5485848439d6431ce5bb3398d: Generated new TSK 0
I20260807 04:21:17.125126 29796 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:21:17.137070 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 29706
W20260807 04:21:17.138830 29772 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:48243
W20260807 04:21:17.139629 7971 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 29706: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 04:21:17.139830 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 29706
W20260807 04:21:17.160657 29691 connection.cc:535] client connection to 127.0.0.1:42301 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42301): Connection reset by peer (error 104)
2026-08-07T04:21:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2135 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:21:17 dist-test-slave-qg60 krb5kdc[29810](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:21:17 dist-test-slave-qg60 krb5kdc[29810](info): set up 2 sockets
Aug 07 04:21:17 dist-test-slave-qg60 krb5kdc[29810](info): commencing operation
krb5kdc: starting...
W20260807 04:21:18.309806 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.005s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:21:18 dist-test-slave-qg60 krb5kdc[29810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076478, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:21:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:21:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 04:21:18.647919 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33929
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33929
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:21:18.998036 29823 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:18.998416 29823 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:18.998576 29823 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:19.006089 29823 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:21:19.006276 29823 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:19.006379 29823 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:19.006487 29823 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:21:19.006564 29823 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:21:19.016927 29823 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33929
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33929
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:19.018356 29823 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:19.019701 29823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:19.032061 29831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:19.032099 29829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:19.032146 29834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:19.033049 29823 server_base.cc:1034] running on GCE node
I20260807 04:21:19.033918 29823 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:19.035363 29823 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:19.036640 29823 hybrid_clock.cc:648] HybridClock initialized: now 1786076479036604 us; error 49 us; skew 500 ppm
I20260807 04:21:19.037050 29823 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:21:19 dist-test-slave-qg60 krb5kdc[29810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076479, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:21:19.044871 29823 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 04:21:19.046468 29823 webserver.cc:460] Webserver started at http://127.0.0.1:32991/ using document root <none> and password file <none>
I20260807 04:21:19.047212 29823 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:19.047376 29823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:19.047699 29823 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:19.050830 29823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "23deecbf6eda43079d8f64d75dab1a14"
format_stamp: "Formatted at 2026-08-07 04:21:19 on dist-test-slave-qg60"
server_key: "0464e322c1e2e6128b8290ad5781f2cd"
server_key_iv: "51449e2ab1d8c5ac9f6c15e03f234d40"
server_key_version: "encryptionkey@0"
I20260807 04:21:19.051625 29823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "23deecbf6eda43079d8f64d75dab1a14"
format_stamp: "Formatted at 2026-08-07 04:21:19 on dist-test-slave-qg60"
server_key: "0464e322c1e2e6128b8290ad5781f2cd"
server_key_iv: "51449e2ab1d8c5ac9f6c15e03f234d40"
server_key_version: "encryptionkey@0"
I20260807 04:21:19.056900 29823 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260807 04:21:19.060492 29842 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:19.061887 29823 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:21:19.062086 29823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "23deecbf6eda43079d8f64d75dab1a14"
format_stamp: "Formatted at 2026-08-07 04:21:19 on dist-test-slave-qg60"
server_key: "0464e322c1e2e6128b8290ad5781f2cd"
server_key_iv: "51449e2ab1d8c5ac9f6c15e03f234d40"
server_key_version: "encryptionkey@0"
I20260807 04:21:19.062294 29823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:19.068207 29823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:19.072926 29823 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:19.073241 29823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:19.092453 29823 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33929
I20260807 04:21:19.092502 29896 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33929 every 8 connection(s)
I20260807 04:21:19.093906 29823 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:21:19.097793 29897 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:19.100546 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 29823
I20260807 04:21:19.100771 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:21:19.101308 7971 external_mini_cluster.cc:1428] Setting key 2e4ec908ebc8cc38a1a8ba877dabd8e7
I20260807 04:21:19.109658 29900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:19.103441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56293 (local address 127.0.0.1:33929)
0807 04:21:19.104334 (+ 893us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:19.104346 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:19.104396 (+ 50us) server_negotiation.cc:407] Connection header received
0807 04:21:19.106158 (+ 1762us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:19.106181 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:19.106527 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:19.106853 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:19.108063 (+ 1210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:19.108070 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:19.108086 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:19.108101 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:19.108164 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:19.108191 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:19.108371 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:19.108489 (+ 118us) server_negotiation.cc:299] Negotiation successful
0807 04:21:19.108706 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":688,"thread_start_us":445,"threads_started":1}
I20260807 04:21:19.110585 29897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23deecbf6eda43079d8f64d75dab1a14: Bootstrap starting.
I20260807 04:21:19.113369 7971 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 04:21:19.114041 29897 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23deecbf6eda43079d8f64d75dab1a14: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:19.115339 29897 log.cc:824] T 00000000000000000000000000000000 P 23deecbf6eda43079d8f64d75dab1a14: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:19.118762 29897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23deecbf6eda43079d8f64d75dab1a14: No bootstrap required, opened a new log
I20260807 04:21:19.121230 29900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:19.118617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51797 (local address 127.0.0.1:33929)
0807 04:21:19.118817 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:19.118824 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:19.119255 (+ 431us) server_negotiation.cc:407] Connection header received
0807 04:21:19.119386 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:19.119391 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:19.119460 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:19.119577 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:19.120496 (+ 919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:19.120502 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:19.120506 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:19.120524 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:19.120569 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:19.120591 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:19.120780 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:19.120859 (+ 79us) server_negotiation.cc:299] Negotiation successful
0807 04:21:19.120922 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 04:21:19.127171 29897 raft_consensus.cc:348] T 00000000000000000000000000000000 P 23deecbf6eda43079d8f64d75dab1a14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23deecbf6eda43079d8f64d75dab1a14" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33929 } }
I20260807 04:21:19.127578 29897 raft_consensus.cc:374] T 00000000000000000000000000000000 P 23deecbf6eda43079d8f64d75dab1a14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:19.127702 29897 raft_consensus.cc:729] T 00000000000000000000000000000000 P 23deecbf6eda43079d8f64d75dab1a14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23deecbf6eda43079d8f64d75dab1a14, State: Initialized, Role: FOLLOWER
I20260807 04:21:19.128360 29897 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23deecbf6eda43079d8f64d75dab1a14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23deecbf6eda43079d8f64d75dab1a14" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33929 } }
I20260807 04:21:19.128598 29897 raft_consensus.cc:388] T 00000000000000000000000000000000 P 23deecbf6eda43079d8f64d75dab1a14 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:21:19.128791 29897 raft_consensus.cc:482] T 00000000000000000000000000000000 P 23deecbf6eda43079d8f64d75dab1a14 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:21:19.128986 29897 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 23deecbf6eda43079d8f64d75dab1a14 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:19.131220 29897 raft_consensus.cc:504] T 00000000000000000000000000000000 P 23deecbf6eda43079d8f64d75dab1a14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23deecbf6eda43079d8f64d75dab1a14" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33929 } }
I20260807 04:21:19.131734 29897 leader_election.cc:302] T 00000000000000000000000000000000 P 23deecbf6eda43079d8f64d75dab1a14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 23deecbf6eda43079d8f64d75dab1a14; no voters:
I20260807 04:21:19.132308 29897 leader_election.cc:288] T 00000000000000000000000000000000 P 23deecbf6eda43079d8f64d75dab1a14 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:21:19.132459 29909 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 23deecbf6eda43079d8f64d75dab1a14 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:21:19.133674 29909 raft_consensus.cc:686] T 00000000000000000000000000000000 P 23deecbf6eda43079d8f64d75dab1a14 [term 1 LEADER]: Becoming Leader. State: Replica: 23deecbf6eda43079d8f64d75dab1a14, State: Running, Role: LEADER
I20260807 04:21:19.134270 29909 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23deecbf6eda43079d8f64d75dab1a14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23deecbf6eda43079d8f64d75dab1a14" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33929 } }
I20260807 04:21:19.134626 29897 sys_catalog.cc:564] T 00000000000000000000000000000000 P 23deecbf6eda43079d8f64d75dab1a14 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:21:19.143142 29912 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23deecbf6eda43079d8f64d75dab1a14 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23deecbf6eda43079d8f64d75dab1a14. Latest consensus state: current_term: 1 leader_uuid: "23deecbf6eda43079d8f64d75dab1a14" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23deecbf6eda43079d8f64d75dab1a14" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33929 } } }
I20260807 04:21:19.143714 29912 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23deecbf6eda43079d8f64d75dab1a14 [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:19.144688 29911 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23deecbf6eda43079d8f64d75dab1a14 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "23deecbf6eda43079d8f64d75dab1a14" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23deecbf6eda43079d8f64d75dab1a14" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33929 } } }
I20260807 04:21:19.145144 29911 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23deecbf6eda43079d8f64d75dab1a14 [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:19.144694 29919 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:21:19.153755 29919 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:21:19.163708 29919 catalog_manager.cc:1347] Generated new cluster ID: 5eeb6910560a4d99870b96c36e607a1f
I20260807 04:21:19.163864 29919 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:21:19.194108 29919 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:21:19.194585 29919 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:21:19.217605 29919 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 23deecbf6eda43079d8f64d75dab1a14: Generated new TSK 0
I20260807 04:21:19.218526 29919 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:21:19.233671 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 29823
W20260807 04:21:19.235105 29892 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:56293
W20260807 04:21:19.235878 7971 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 29823: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 04:21:19.236078 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 29823
2026-08-07T04:21:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2095 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:21:19 dist-test-slave-qg60 krb5kdc[29932](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:21:19 dist-test-slave-qg60 krb5kdc[29932](info): set up 2 sockets
Aug 07 04:21:19 dist-test-slave-qg60 krb5kdc[29932](info): commencing operation
krb5kdc: starting...
W20260807 04:21:20.469671 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.193s user 0.002s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:21:20 dist-test-slave-qg60 krb5kdc[29932](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076480, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:21:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:21:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 04:21:20.827896 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46193
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46193
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:21:21.171787 29946 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:21.172147 29946 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:21.172335 29946 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:21.179677 29946 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:21:21.179852 29946 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:21.179961 29946 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:21.180079 29946 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:21:21.180150 29946 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:21:21.190439 29946 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46193
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46193
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:21.191864 29946 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:21.193238 29946 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:21.204970 29951 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:21.205006 29952 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:21.204970 29954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:21.205960 29946 server_base.cc:1034] running on GCE node
I20260807 04:21:21.206719 29946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:21.208108 29946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:21.209349 29946 hybrid_clock.cc:648] HybridClock initialized: now 1786076481209312 us; error 44 us; skew 500 ppm
I20260807 04:21:21.209712 29946 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:21:21 dist-test-slave-qg60 krb5kdc[29932](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076481, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:21:21.212863 29946 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 04:21:21.214389 29946 webserver.cc:460] Webserver started at http://127.0.0.1:43431/ using document root <none> and password file <none>
I20260807 04:21:21.215094 29946 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:21.215265 29946 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:21.215603 29946 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:21.218755 29946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "7db44e140446424da2817a5bd243a356"
format_stamp: "Formatted at 2026-08-07 04:21:21 on dist-test-slave-qg60"
server_key: "966488a63010a59a43e46ea28610720e"
server_key_iv: "4f0f245ff0b7b3a0fcb373901331305c"
server_key_version: "encryptionkey@0"
I20260807 04:21:21.219554 29946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "7db44e140446424da2817a5bd243a356"
format_stamp: "Formatted at 2026-08-07 04:21:21 on dist-test-slave-qg60"
server_key: "966488a63010a59a43e46ea28610720e"
server_key_iv: "4f0f245ff0b7b3a0fcb373901331305c"
server_key_version: "encryptionkey@0"
I20260807 04:21:21.225252 29946 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 04:21:21.228570 29961 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:21.229889 29946 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:21:21.230087 29946 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "7db44e140446424da2817a5bd243a356"
format_stamp: "Formatted at 2026-08-07 04:21:21 on dist-test-slave-qg60"
server_key: "966488a63010a59a43e46ea28610720e"
server_key_iv: "4f0f245ff0b7b3a0fcb373901331305c"
server_key_version: "encryptionkey@0"
I20260807 04:21:21.230306 29946 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:21.245944 29946 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:21.250676 29946 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:21.251008 29946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:21.270823 29946 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46193
I20260807 04:21:21.270855 30019 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46193 every 8 connection(s)
I20260807 04:21:21.272372 29946 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:21:21.276121 30020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:21.281334 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 29946
I20260807 04:21:21.281565 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:21:21.281996 7971 external_mini_cluster.cc:1428] Setting key bc4ea28c1a3a8fb069ce4488ac3a5824
I20260807 04:21:21.287098 30020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7db44e140446424da2817a5bd243a356: Bootstrap starting.
I20260807 04:21:21.290889 30020 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7db44e140446424da2817a5bd243a356: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:21.292181 30020 log.cc:824] T 00000000000000000000000000000000 P 7db44e140446424da2817a5bd243a356: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:21.295745 30020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7db44e140446424da2817a5bd243a356: No bootstrap required, opened a new log
Aug 07 04:21:21 dist-test-slave-qg60 krb5kdc[29932](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076480, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 04:21:21.304493 30020 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7db44e140446424da2817a5bd243a356 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7db44e140446424da2817a5bd243a356" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46193 } }
I20260807 04:21:21.305013 30020 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7db44e140446424da2817a5bd243a356 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:21.305146 30020 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7db44e140446424da2817a5bd243a356 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7db44e140446424da2817a5bd243a356, State: Initialized, Role: FOLLOWER
I20260807 04:21:21.305851 30020 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7db44e140446424da2817a5bd243a356 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7db44e140446424da2817a5bd243a356" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46193 } }
I20260807 04:21:21.306207 30020 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7db44e140446424da2817a5bd243a356 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:21:21.306389 30020 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7db44e140446424da2817a5bd243a356 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:21:21.306573 30020 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7db44e140446424da2817a5bd243a356 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:21.307515 30023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:21.283950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58307 (local address 127.0.0.1:46193)
0807 04:21:21.284934 (+ 984us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:21.284945 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:21.284988 (+ 43us) server_negotiation.cc:407] Connection header received
0807 04:21:21.286725 (+ 1737us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:21.286752 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:21.287140 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:21.287514 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:21.289528 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:21.290834 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:21.292699 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:21.293893 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:21.294029 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:21.299109 (+ 5080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:21.299132 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:21.299147 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:21.299188 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:21.302746 (+ 3558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:21.303530 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:21.303537 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:21.303544 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:21.303739 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:21.304167 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:21.304172 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:21.304175 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:21.304850 (+ 675us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:21.305181 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:21.305714 (+ 533us) server_negotiation.cc:299] Negotiation successful
0807 04:21:21.306263 (+ 549us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":710,"thread_start_us":440,"threads_started":1}
I20260807 04:21:21.309229 30020 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7db44e140446424da2817a5bd243a356 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7db44e140446424da2817a5bd243a356" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46193 } }
I20260807 04:21:21.309765 30020 leader_election.cc:302] T 00000000000000000000000000000000 P 7db44e140446424da2817a5bd243a356 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7db44e140446424da2817a5bd243a356; no voters:
I20260807 04:21:21.310501 30020 leader_election.cc:288] T 00000000000000000000000000000000 P 7db44e140446424da2817a5bd243a356 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:21:21.310627 30025 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7db44e140446424da2817a5bd243a356 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:21:21.311723 7971 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 04:21:21.311862 30025 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7db44e140446424da2817a5bd243a356 [term 1 LEADER]: Becoming Leader. State: Replica: 7db44e140446424da2817a5bd243a356, State: Running, Role: LEADER
I20260807 04:21:21.312440 30025 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7db44e140446424da2817a5bd243a356 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7db44e140446424da2817a5bd243a356" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46193 } }
I20260807 04:21:21.312980 30020 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7db44e140446424da2817a5bd243a356 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:21:21.315495 30026 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7db44e140446424da2817a5bd243a356 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7db44e140446424da2817a5bd243a356" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7db44e140446424da2817a5bd243a356" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46193 } } }
I20260807 04:21:21.315999 30026 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7db44e140446424da2817a5bd243a356 [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:21.316777 30028 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7db44e140446424da2817a5bd243a356 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7db44e140446424da2817a5bd243a356. Latest consensus state: current_term: 1 leader_uuid: "7db44e140446424da2817a5bd243a356" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7db44e140446424da2817a5bd243a356" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46193 } } }
I20260807 04:21:21.317183 30028 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7db44e140446424da2817a5bd243a356 [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:21.328483 30032 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:21:21.341156 30032 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:21:21.349110 30023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:21.331203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53421 (local address 127.0.0.1:46193)
0807 04:21:21.331391 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:21.331396 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:21.331418 (+ 22us) server_negotiation.cc:407] Connection header received
0807 04:21:21.331635 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:21.331642 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:21.331734 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:21.331794 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:21.333688 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:21.334531 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:21.335834 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:21.336617 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:21.336783 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:21.340394 (+ 3611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:21.340402 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:21.340409 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:21.340455 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:21.344784 (+ 4329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:21.345763 (+ 979us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:21.345773 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:21.345777 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:21.345935 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:21.346460 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:21.346466 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:21.346469 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:21.346905 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:21.347158 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:21.348411 (+ 1253us) server_negotiation.cc:299] Negotiation successful
0807 04:21:21.348653 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 04:21:21.358443 30032 catalog_manager.cc:1347] Generated new cluster ID: fea5513560a04da795feca38af2d0a45
I20260807 04:21:21.358600 30032 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:21:21.380286 30032 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:21:21.381718 30032 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:21:21.389205 30032 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7db44e140446424da2817a5bd243a356: Generated new TSK 0
I20260807 04:21:21.390002 30032 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:21:21.400270 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 29946
I20260807 04:21:21.401436 30014 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:21:21.495967 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 29946
2026-08-07T04:21:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2257 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:21:21 dist-test-slave-qg60 krb5kdc[30055](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:21:21 dist-test-slave-qg60 krb5kdc[30055](info): set up 2 sockets
Aug 07 04:21:21 dist-test-slave-qg60 krb5kdc[30055](info): commencing operation
krb5kdc: starting...
W20260807 04:21:22.666131 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.132s user 0.000s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:21:22 dist-test-slave-qg60 krb5kdc[30055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076482, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:21:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:21:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 04:21:23.018725 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33651
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33651
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:21:23.385457 30068 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:23.385826 30068 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:23.386016 30068 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:23.394613 30068 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:21:23.394742 30068 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:23.394856 30068 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:23.394968 30068 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:21:23.395057 30068 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:21:23.405360 30068 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33651
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:23.406714 30068 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:23.408074 30068 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:23.421061 30073 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:23.421011 30076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:23.420976 30074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:23.422046 30068 server_base.cc:1034] running on GCE node
I20260807 04:21:23.422940 30068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:23.424435 30068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:23.425645 30068 hybrid_clock.cc:648] HybridClock initialized: now 1786076483425566 us; error 67 us; skew 500 ppm
I20260807 04:21:23.426013 30068 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:21:23 dist-test-slave-qg60 krb5kdc[30055](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076483, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:21:23.429303 30068 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 04:21:23.430891 30068 webserver.cc:460] Webserver started at http://127.0.0.1:44317/ using document root <none> and password file <none>
I20260807 04:21:23.431627 30068 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:23.431763 30068 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:23.432106 30068 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:23.435225 30068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "2b190825745343ca9535fce68a8ff30b"
format_stamp: "Formatted at 2026-08-07 04:21:23 on dist-test-slave-qg60"
server_key: "fd5bb37d602a9cd7a3b273c03a9badb5"
server_key_iv: "af1a14a37367cea3b3c4cfc0798c0da8"
server_key_version: "encryptionkey@0"
I20260807 04:21:23.436013 30068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "2b190825745343ca9535fce68a8ff30b"
format_stamp: "Formatted at 2026-08-07 04:21:23 on dist-test-slave-qg60"
server_key: "fd5bb37d602a9cd7a3b273c03a9badb5"
server_key_iv: "af1a14a37367cea3b3c4cfc0798c0da8"
server_key_version: "encryptionkey@0"
I20260807 04:21:23.441416 30068 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260807 04:21:23.445060 30083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:23.446455 30068 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:21:23.446611 30068 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "2b190825745343ca9535fce68a8ff30b"
format_stamp: "Formatted at 2026-08-07 04:21:23 on dist-test-slave-qg60"
server_key: "fd5bb37d602a9cd7a3b273c03a9badb5"
server_key_iv: "af1a14a37367cea3b3c4cfc0798c0da8"
server_key_version: "encryptionkey@0"
I20260807 04:21:23.446785 30068 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:23.464291 30068 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:23.468523 30068 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:23.468830 30068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:23.487964 30068 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33651
I20260807 04:21:23.487995 30139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33651 every 8 connection(s)
I20260807 04:21:23.489560 30068 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:21:23.492774 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 30068
I20260807 04:21:23.492959 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:21:23.493450 7971 external_mini_cluster.cc:1428] Setting key d77199574a00b6fd899859ea10b1879f
I20260807 04:21:23.493767 30140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:23.508852 30143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:23.495196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35419 (local address 127.0.0.1:33651)
0807 04:21:23.495998 (+ 802us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:23.496014 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:23.496062 (+ 48us) server_negotiation.cc:407] Connection header received
0807 04:21:23.498700 (+ 2638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:23.498729 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:23.499263 (+ 534us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:23.499696 (+ 433us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:23.500242 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:23.502281 (+ 2039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:23.503589 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:23.504635 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:23.504879 (+ 244us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:23.506028 (+ 1149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:23.506039 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:23.506063 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:23.506823 (+ 760us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:23.506928 (+ 105us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:23.506960 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:23.507088 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:23.507269 (+ 181us) server_negotiation.cc:299] Negotiation successful
0807 04:21:23.507534 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":346,"threads_started":1}
I20260807 04:21:23.509603 30140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b190825745343ca9535fce68a8ff30b: Bootstrap starting.
I20260807 04:21:23.512645 7971 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 04:21:23.513013 30140 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2b190825745343ca9535fce68a8ff30b: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:23.514302 30140 log.cc:824] T 00000000000000000000000000000000 P 2b190825745343ca9535fce68a8ff30b: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:23.517774 30140 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b190825745343ca9535fce68a8ff30b: No bootstrap required, opened a new log
I20260807 04:21:23.525063 30143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:23.518007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56739 (local address 127.0.0.1:33651)
0807 04:21:23.518282 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:23.518292 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:23.518778 (+ 486us) server_negotiation.cc:407] Connection header received
0807 04:21:23.518957 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:23.518961 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:23.519020 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:23.519104 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:23.519768 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:23.520524 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:23.522504 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:23.522951 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:23.523054 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:23.524279 (+ 1225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:23.524284 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:23.524287 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:23.524303 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:23.524342 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:23.524357 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:23.524430 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:23.524601 (+ 171us) server_negotiation.cc:299] Negotiation successful
0807 04:21:23.524677 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 04:21:23.527765 30140 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2b190825745343ca9535fce68a8ff30b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b190825745343ca9535fce68a8ff30b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33651 } }
I20260807 04:21:23.528198 30140 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2b190825745343ca9535fce68a8ff30b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:23.528314 30140 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2b190825745343ca9535fce68a8ff30b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b190825745343ca9535fce68a8ff30b, State: Initialized, Role: FOLLOWER
I20260807 04:21:23.529023 30140 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2b190825745343ca9535fce68a8ff30b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b190825745343ca9535fce68a8ff30b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33651 } }
I20260807 04:21:23.529284 30140 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2b190825745343ca9535fce68a8ff30b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:21:23.529445 30140 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b190825745343ca9535fce68a8ff30b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:21:23.529631 30140 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b190825745343ca9535fce68a8ff30b [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:23.531888 30140 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b190825745343ca9535fce68a8ff30b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b190825745343ca9535fce68a8ff30b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33651 } }
I20260807 04:21:23.532415 30140 leader_election.cc:302] T 00000000000000000000000000000000 P 2b190825745343ca9535fce68a8ff30b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2b190825745343ca9535fce68a8ff30b; no voters:
I20260807 04:21:23.533118 30140 leader_election.cc:288] T 00000000000000000000000000000000 P 2b190825745343ca9535fce68a8ff30b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:21:23.533270 30150 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2b190825745343ca9535fce68a8ff30b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:21:23.534017 30150 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2b190825745343ca9535fce68a8ff30b [term 1 LEADER]: Becoming Leader. State: Replica: 2b190825745343ca9535fce68a8ff30b, State: Running, Role: LEADER
I20260807 04:21:23.534655 30150 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b190825745343ca9535fce68a8ff30b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b190825745343ca9535fce68a8ff30b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33651 } }
I20260807 04:21:23.535307 30140 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2b190825745343ca9535fce68a8ff30b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:21:23.537983 30152 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b190825745343ca9535fce68a8ff30b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2b190825745343ca9535fce68a8ff30b. Latest consensus state: current_term: 1 leader_uuid: "2b190825745343ca9535fce68a8ff30b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b190825745343ca9535fce68a8ff30b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33651 } } }
I20260807 04:21:23.538409 30152 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b190825745343ca9535fce68a8ff30b [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:23.538875 30151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b190825745343ca9535fce68a8ff30b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2b190825745343ca9535fce68a8ff30b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b190825745343ca9535fce68a8ff30b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33651 } } }
I20260807 04:21:23.539156 30151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b190825745343ca9535fce68a8ff30b [sys.catalog]: This master's current role is: LEADER
W20260807 04:21:23.547925 30168 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2b190825745343ca9535fce68a8ff30b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 04:21:23.548072 30168 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 04:21:23.548215 30156 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:21:23.549973 30156 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:21:23.557941 30156 catalog_manager.cc:1347] Generated new cluster ID: fa4aa4fbe9f6469f86bcd1885b8d0034
I20260807 04:21:23.558056 30156 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:21:23.585254 30156 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:21:23.586719 30156 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:21:23.596853 30156 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2b190825745343ca9535fce68a8ff30b: Generated new TSK 0
I20260807 04:21:23.597903 30156 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:21:23.617736 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 30068
W20260807 04:21:23.618957 30135 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:35419
W20260807 04:21:23.619933 7971 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 30068: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 04:21:23.620116 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 30068
2026-08-07T04:21:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2122 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:21:23 dist-test-slave-qg60 krb5kdc[30173](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:21:23 dist-test-slave-qg60 krb5kdc[30173](info): set up 2 sockets
Aug 07 04:21:23 dist-test-slave-qg60 krb5kdc[30173](info): commencing operation
krb5kdc: starting...
W20260807 04:21:24.861975 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.205s user 0.002s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:21:25 dist-test-slave-qg60 krb5kdc[30173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076485, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:21:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:21:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 04:21:25.199985 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45811
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45811
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:21:25.551164 30188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:25.551533 30188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:25.551716 30188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:25.559216 30188 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:21:25.559343 30188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:25.559444 30188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:25.559538 30188 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:21:25.559621 30188 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:21:25.570266 30188 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45811
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45811
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:25.571684 30188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:25.573163 30188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:25.585590 30197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:25.585731 30195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:25.585731 30194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:25.586752 30188 server_base.cc:1034] running on GCE node
I20260807 04:21:25.587602 30188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:25.589148 30188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:25.590415 30188 hybrid_clock.cc:648] HybridClock initialized: now 1786076485590361 us; error 37 us; skew 500 ppm
I20260807 04:21:25.590819 30188 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:21:25 dist-test-slave-qg60 krb5kdc[30173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076485, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:21:25.601265 30188 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 04:21:25.603065 30188 webserver.cc:460] Webserver started at http://127.0.0.1:37411/ using document root <none> and password file <none>
I20260807 04:21:25.603816 30188 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:25.603973 30188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:25.604310 30188 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:25.607502 30188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "c229351ed4994d23924f8b8999c12fd3"
format_stamp: "Formatted at 2026-08-07 04:21:25 on dist-test-slave-qg60"
server_key: "6918b4d8f24c1f8ba485536756a374c1"
server_key_iv: "eead98d3bf103a5a8371be5c132c0ee1"
server_key_version: "encryptionkey@0"
I20260807 04:21:25.608296 30188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "c229351ed4994d23924f8b8999c12fd3"
format_stamp: "Formatted at 2026-08-07 04:21:25 on dist-test-slave-qg60"
server_key: "6918b4d8f24c1f8ba485536756a374c1"
server_key_iv: "eead98d3bf103a5a8371be5c132c0ee1"
server_key_version: "encryptionkey@0"
I20260807 04:21:25.613965 30188 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260807 04:21:25.617717 30204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:25.619217 30188 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 04:21:25.619407 30188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "c229351ed4994d23924f8b8999c12fd3"
format_stamp: "Formatted at 2026-08-07 04:21:25 on dist-test-slave-qg60"
server_key: "6918b4d8f24c1f8ba485536756a374c1"
server_key_iv: "eead98d3bf103a5a8371be5c132c0ee1"
server_key_version: "encryptionkey@0"
I20260807 04:21:25.619647 30188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:25.625677 30188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:25.630291 30188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:25.630611 30188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:25.650027 30188 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45811
I20260807 04:21:25.650086 30260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45811 every 8 connection(s)
I20260807 04:21:25.651541 30188 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:21:25.653558 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 30188
I20260807 04:21:25.653766 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:21:25.654356 7971 external_mini_cluster.cc:1428] Setting key 43329ef2d86635a18eaf794d7c895eeb
I20260807 04:21:25.656368 30261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:25.662374 30264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:25.656183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33405 (local address 127.0.0.1:45811)
0807 04:21:25.657082 (+ 899us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:25.657094 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:25.657136 (+ 42us) server_negotiation.cc:407] Connection header received
0807 04:21:25.658818 (+ 1682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:25.658840 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:25.659191 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:25.659526 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:25.660662 (+ 1136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:25.660671 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:25.660684 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:25.660699 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:25.660829 (+ 130us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:25.660856 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:25.661051 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:25.661157 (+ 106us) server_negotiation.cc:299] Negotiation successful
0807 04:21:25.661383 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":684,"thread_start_us":427,"threads_started":1}
I20260807 04:21:25.666241 7971 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 04:21:25.668990 30261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c229351ed4994d23924f8b8999c12fd3: Bootstrap starting.
I20260807 04:21:25.672490 30261 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c229351ed4994d23924f8b8999c12fd3: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:25.673615 30264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:25.670996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46137 (local address 127.0.0.1:45811)
0807 04:21:25.671188 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:25.671194 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:25.671561 (+ 367us) server_negotiation.cc:407] Connection header received
0807 04:21:25.671717 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:25.671722 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:25.671786 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:25.671890 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:25.672938 (+ 1048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:25.672945 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:25.672952 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:25.672979 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:25.673036 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:25.673067 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:25.673190 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:25.673268 (+ 78us) server_negotiation.cc:299] Negotiation successful
0807 04:21:25.673324 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 04:21:25.673952 30261 log.cc:824] T 00000000000000000000000000000000 P c229351ed4994d23924f8b8999c12fd3: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:25.676885 30261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c229351ed4994d23924f8b8999c12fd3: No bootstrap required, opened a new log
I20260807 04:21:25.684554 30261 raft_consensus.cc:348] T 00000000000000000000000000000000 P c229351ed4994d23924f8b8999c12fd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c229351ed4994d23924f8b8999c12fd3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45811 } }
I20260807 04:21:25.684990 30261 raft_consensus.cc:374] T 00000000000000000000000000000000 P c229351ed4994d23924f8b8999c12fd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:25.685083 30261 raft_consensus.cc:729] T 00000000000000000000000000000000 P c229351ed4994d23924f8b8999c12fd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c229351ed4994d23924f8b8999c12fd3, State: Initialized, Role: FOLLOWER
I20260807 04:21:25.685583 30261 consensus_queue.cc:260] T 00000000000000000000000000000000 P c229351ed4994d23924f8b8999c12fd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c229351ed4994d23924f8b8999c12fd3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45811 } }
I20260807 04:21:25.685778 30261 raft_consensus.cc:388] T 00000000000000000000000000000000 P c229351ed4994d23924f8b8999c12fd3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:21:25.685925 30261 raft_consensus.cc:482] T 00000000000000000000000000000000 P c229351ed4994d23924f8b8999c12fd3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:21:25.686116 30261 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c229351ed4994d23924f8b8999c12fd3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:25.688606 30261 raft_consensus.cc:504] T 00000000000000000000000000000000 P c229351ed4994d23924f8b8999c12fd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c229351ed4994d23924f8b8999c12fd3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45811 } }
I20260807 04:21:25.689153 30261 leader_election.cc:302] T 00000000000000000000000000000000 P c229351ed4994d23924f8b8999c12fd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c229351ed4994d23924f8b8999c12fd3; no voters:
I20260807 04:21:25.689771 30261 leader_election.cc:288] T 00000000000000000000000000000000 P c229351ed4994d23924f8b8999c12fd3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:21:25.689934 30271 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c229351ed4994d23924f8b8999c12fd3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:21:25.690685 30271 raft_consensus.cc:686] T 00000000000000000000000000000000 P c229351ed4994d23924f8b8999c12fd3 [term 1 LEADER]: Becoming Leader. State: Replica: c229351ed4994d23924f8b8999c12fd3, State: Running, Role: LEADER
I20260807 04:21:25.691226 30271 consensus_queue.cc:237] T 00000000000000000000000000000000 P c229351ed4994d23924f8b8999c12fd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c229351ed4994d23924f8b8999c12fd3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45811 } }
I20260807 04:21:25.692195 30261 sys_catalog.cc:564] T 00000000000000000000000000000000 P c229351ed4994d23924f8b8999c12fd3 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:21:25.694686 30272 sys_catalog.cc:455] T 00000000000000000000000000000000 P c229351ed4994d23924f8b8999c12fd3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c229351ed4994d23924f8b8999c12fd3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c229351ed4994d23924f8b8999c12fd3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45811 } } }
I20260807 04:21:25.694556 30273 sys_catalog.cc:455] T 00000000000000000000000000000000 P c229351ed4994d23924f8b8999c12fd3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c229351ed4994d23924f8b8999c12fd3. Latest consensus state: current_term: 1 leader_uuid: "c229351ed4994d23924f8b8999c12fd3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c229351ed4994d23924f8b8999c12fd3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45811 } } }
I20260807 04:21:25.695636 30273 sys_catalog.cc:458] T 00000000000000000000000000000000 P c229351ed4994d23924f8b8999c12fd3 [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:25.696496 30272 sys_catalog.cc:458] T 00000000000000000000000000000000 P c229351ed4994d23924f8b8999c12fd3 [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:25.698503 30280 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:21:25.703877 30280 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:21:25.713629 30280 catalog_manager.cc:1347] Generated new cluster ID: c01d5aeeb73941608242135b5d126cac
I20260807 04:21:25.713762 30280 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:21:25.728353 30280 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:21:25.728847 30280 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:21:25.739313 30280 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c229351ed4994d23924f8b8999c12fd3: Generated new TSK 0
I20260807 04:21:25.740372 30280 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:21:25.757184 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 30188
W20260807 04:21:25.758440 30256 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:33405
W20260807 04:21:25.759284 7971 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 30188: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 04:21:25.759469 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 30188
2026-08-07T04:21:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2142 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:21:25 dist-test-slave-qg60 krb5kdc[30296](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:21:25 dist-test-slave-qg60 krb5kdc[30296](info): set up 2 sockets
Aug 07 04:21:25 dist-test-slave-qg60 krb5kdc[30296](info): commencing operation
krb5kdc: starting...
W20260807 04:21:26.967151 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.001s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:21:27 dist-test-slave-qg60 krb5kdc[30296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076487, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:21:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:21:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 04:21:27.310499 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46301
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46301
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:21:27.660146 30309 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:27.660517 30309 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:27.660696 30309 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:27.668036 30309 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:21:27.668202 30309 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:27.668313 30309 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:27.668423 30309 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:21:27.668507 30309 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:21:27.678812 30309 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46301
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:27.680274 30309 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:27.681663 30309 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:27.694487 30317 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:27.694577 30315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:27.694561 30314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:27.695874 30309 server_base.cc:1034] running on GCE node
I20260807 04:21:27.696695 30309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:27.698223 30309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:27.699424 30309 hybrid_clock.cc:648] HybridClock initialized: now 1786076487699369 us; error 42 us; skew 500 ppm
I20260807 04:21:27.699795 30309 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:21:27 dist-test-slave-qg60 krb5kdc[30296](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076487, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:21:27.703224 30309 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 04:21:27.704824 30309 webserver.cc:460] Webserver started at http://127.0.0.1:37421/ using document root <none> and password file <none>
I20260807 04:21:27.705556 30309 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:27.705667 30309 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:27.705955 30309 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:27.709224 30309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "962c53d0d1414807b543b73d5c21803e"
format_stamp: "Formatted at 2026-08-07 04:21:27 on dist-test-slave-qg60"
server_key: "b9775fc8911019ed4cf03b1df6adf5d5"
server_key_iv: "8039a4cfb18e63c64708d09f011fedaf"
server_key_version: "encryptionkey@0"
I20260807 04:21:27.709981 30309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "962c53d0d1414807b543b73d5c21803e"
format_stamp: "Formatted at 2026-08-07 04:21:27 on dist-test-slave-qg60"
server_key: "b9775fc8911019ed4cf03b1df6adf5d5"
server_key_iv: "8039a4cfb18e63c64708d09f011fedaf"
server_key_version: "encryptionkey@0"
I20260807 04:21:27.715721 30309 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 04:21:27.719789 30327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:27.721392 30309 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 04:21:27.721554 30309 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "962c53d0d1414807b543b73d5c21803e"
format_stamp: "Formatted at 2026-08-07 04:21:27 on dist-test-slave-qg60"
server_key: "b9775fc8911019ed4cf03b1df6adf5d5"
server_key_iv: "8039a4cfb18e63c64708d09f011fedaf"
server_key_version: "encryptionkey@0"
I20260807 04:21:27.721732 30309 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:27.741041 30309 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:27.746050 30309 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:27.746340 30309 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:27.767323 30309 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46301
I20260807 04:21:27.767347 30379 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46301 every 8 connection(s)
I20260807 04:21:27.768996 30309 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:21:27.772965 30380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:27.774292 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 30309
I20260807 04:21:27.774492 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:21:27.774981 7971 external_mini_cluster.cc:1428] Setting key 935d75e2bb3a33c766da1137dc87dfff
I20260807 04:21:27.788007 30380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 962c53d0d1414807b543b73d5c21803e: Bootstrap starting.
Aug 07 04:21:27 dist-test-slave-qg60 krb5kdc[30296](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076487, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 04:21:27.791587 30380 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 962c53d0d1414807b543b73d5c21803e: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:27.793042 30380 log.cc:824] T 00000000000000000000000000000000 P 962c53d0d1414807b543b73d5c21803e: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:27.796506 30380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 962c53d0d1414807b543b73d5c21803e: No bootstrap required, opened a new log
I20260807 04:21:27.800518 30383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:27.777026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:55451 (local address 127.0.0.1:46301)
0807 04:21:27.777841 (+ 815us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:27.777857 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:27.777911 (+ 54us) server_negotiation.cc:407] Connection header received
0807 04:21:27.780009 (+ 2098us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:27.780037 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:27.780593 (+ 556us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:27.781080 (+ 487us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:27.782389 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:27.784462 (+ 2073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:27.785998 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:27.787067 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:27.787254 (+ 187us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:27.791642 (+ 4388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:27.791655 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:27.791676 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:27.791732 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:27.795831 (+ 4099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:27.796797 (+ 966us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:27.796806 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:27.796815 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:27.797043 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:27.797514 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:27.797521 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:27.797524 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:27.798298 (+ 774us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:27.798717 (+ 419us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:27.799077 (+ 360us) server_negotiation.cc:299] Negotiation successful
0807 04:21:27.799441 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":325,"threads_started":1}
I20260807 04:21:27.804483 7971 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 04:21:27.805727 30380 raft_consensus.cc:348] T 00000000000000000000000000000000 P 962c53d0d1414807b543b73d5c21803e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "962c53d0d1414807b543b73d5c21803e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46301 } }
I20260807 04:21:27.806098 30380 raft_consensus.cc:374] T 00000000000000000000000000000000 P 962c53d0d1414807b543b73d5c21803e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:27.806206 30380 raft_consensus.cc:729] T 00000000000000000000000000000000 P 962c53d0d1414807b543b73d5c21803e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 962c53d0d1414807b543b73d5c21803e, State: Initialized, Role: FOLLOWER
I20260807 04:21:27.806749 30380 consensus_queue.cc:260] T 00000000000000000000000000000000 P 962c53d0d1414807b543b73d5c21803e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "962c53d0d1414807b543b73d5c21803e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46301 } }
I20260807 04:21:27.806995 30380 raft_consensus.cc:388] T 00000000000000000000000000000000 P 962c53d0d1414807b543b73d5c21803e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:21:27.807164 30380 raft_consensus.cc:482] T 00000000000000000000000000000000 P 962c53d0d1414807b543b73d5c21803e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:21:27.807359 30380 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 962c53d0d1414807b543b73d5c21803e [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:27.810065 30380 raft_consensus.cc:504] T 00000000000000000000000000000000 P 962c53d0d1414807b543b73d5c21803e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "962c53d0d1414807b543b73d5c21803e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46301 } }
I20260807 04:21:27.810676 30380 leader_election.cc:302] T 00000000000000000000000000000000 P 962c53d0d1414807b543b73d5c21803e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 962c53d0d1414807b543b73d5c21803e; no voters:
I20260807 04:21:27.811353 30380 leader_election.cc:288] T 00000000000000000000000000000000 P 962c53d0d1414807b543b73d5c21803e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:21:27.811460 30391 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 962c53d0d1414807b543b73d5c21803e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:21:27.813678 30380 sys_catalog.cc:564] T 00000000000000000000000000000000 P 962c53d0d1414807b543b73d5c21803e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:21:27.815685 30391 raft_consensus.cc:686] T 00000000000000000000000000000000 P 962c53d0d1414807b543b73d5c21803e [term 1 LEADER]: Becoming Leader. State: Replica: 962c53d0d1414807b543b73d5c21803e, State: Running, Role: LEADER
I20260807 04:21:27.816380 30391 consensus_queue.cc:237] T 00000000000000000000000000000000 P 962c53d0d1414807b543b73d5c21803e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "962c53d0d1414807b543b73d5c21803e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46301 } }
I20260807 04:21:27.819485 30392 sys_catalog.cc:455] T 00000000000000000000000000000000 P 962c53d0d1414807b543b73d5c21803e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "962c53d0d1414807b543b73d5c21803e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "962c53d0d1414807b543b73d5c21803e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46301 } } }
I20260807 04:21:27.819912 30392 sys_catalog.cc:458] T 00000000000000000000000000000000 P 962c53d0d1414807b543b73d5c21803e [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:27.823011 30393 sys_catalog.cc:455] T 00000000000000000000000000000000 P 962c53d0d1414807b543b73d5c21803e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 962c53d0d1414807b543b73d5c21803e. Latest consensus state: current_term: 1 leader_uuid: "962c53d0d1414807b543b73d5c21803e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "962c53d0d1414807b543b73d5c21803e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46301 } } }
I20260807 04:21:27.823880 30393 sys_catalog.cc:458] T 00000000000000000000000000000000 P 962c53d0d1414807b543b73d5c21803e [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:27.825646 30401 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:21:27.832073 30383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:27.809198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:44483 (local address 127.0.0.1:46301)
0807 04:21:27.809427 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:27.809437 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:27.809885 (+ 448us) server_negotiation.cc:407] Connection header received
0807 04:21:27.810059 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:27.810062 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:27.810137 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:27.810218 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:27.812314 (+ 2096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:27.813466 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:27.815396 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:27.816158 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:27.816314 (+ 156us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:27.820178 (+ 3864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:27.820188 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:27.820197 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:27.820246 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:27.824873 (+ 4627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:27.826028 (+ 1155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:27.826034 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:27.826037 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:27.826181 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:27.826787 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:27.826792 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:27.826796 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:27.827199 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:27.827504 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:27.827910 (+ 406us) server_negotiation.cc:299] Negotiation successful
0807 04:21:27.828110 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 04:21:27.835845 30401 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:21:27.845644 30401 catalog_manager.cc:1347] Generated new cluster ID: 36c8d61093204d948c545804f2800287
I20260807 04:21:27.845794 30401 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:21:27.853489 30401 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:21:27.854791 30401 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:21:27.863557 30401 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 962c53d0d1414807b543b73d5c21803e: Generated new TSK 0
I20260807 04:21:27.864562 30401 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:21:27.881158 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 30309
I20260807 04:21:27.882521 30375 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:21:27.977790 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 30309
W20260807 04:21:27.997973 30294 connection.cc:535] client connection to 127.0.0.1:46301 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46301): Connection reset by peer (error 104)
2026-08-07T04:21:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2218 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:21:28 dist-test-slave-qg60 krb5kdc[30414](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:21:28 dist-test-slave-qg60 krb5kdc[30414](info): set up 2 sockets
Aug 07 04:21:28 dist-test-slave-qg60 krb5kdc[30414](info): commencing operation
krb5kdc: starting...
W20260807 04:21:29.173950 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.156s user 0.007s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:21:29 dist-test-slave-qg60 krb5kdc[30414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076489, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:21:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:21:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 04:21:29.518172 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41791
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41791
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:21:29.864068 30429 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:29.864374 30429 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:29.864481 30429 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:29.871939 30429 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:21:29.872068 30429 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:29.872120 30429 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:29.872185 30429 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:21:29.872233 30429 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:21:29.882485 30429 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41791
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41791
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:29.883798 30429 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:29.885295 30429 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:29.897841 30439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:29.897890 30437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:29.897923 30436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:29.898699 30429 server_base.cc:1034] running on GCE node
I20260807 04:21:29.899428 30429 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:29.900939 30429 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:29.902175 30429 hybrid_clock.cc:648] HybridClock initialized: now 1786076489902121 us; error 61 us; skew 500 ppm
I20260807 04:21:29.902536 30429 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:21:29 dist-test-slave-qg60 krb5kdc[30414](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076489, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:21:29.905957 30429 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 04:21:29.907483 30429 webserver.cc:460] Webserver started at http://127.0.0.1:34041/ using document root <none> and password file <none>
I20260807 04:21:29.908151 30429 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:29.908263 30429 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:29.908532 30429 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:29.911666 30429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "69e6d4c7d34c431290ff019ed157417f"
format_stamp: "Formatted at 2026-08-07 04:21:29 on dist-test-slave-qg60"
server_key: "597bfbc4bb561c23a28a697ca2c167ea"
server_key_iv: "df3c886d2be28e76d69212c81cbc62e6"
server_key_version: "encryptionkey@0"
I20260807 04:21:29.912401 30429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "69e6d4c7d34c431290ff019ed157417f"
format_stamp: "Formatted at 2026-08-07 04:21:29 on dist-test-slave-qg60"
server_key: "597bfbc4bb561c23a28a697ca2c167ea"
server_key_iv: "df3c886d2be28e76d69212c81cbc62e6"
server_key_version: "encryptionkey@0"
I20260807 04:21:29.917829 30429 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260807 04:21:29.921682 30446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:29.923221 30429 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:21:29.923425 30429 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "69e6d4c7d34c431290ff019ed157417f"
format_stamp: "Formatted at 2026-08-07 04:21:29 on dist-test-slave-qg60"
server_key: "597bfbc4bb561c23a28a697ca2c167ea"
server_key_iv: "df3c886d2be28e76d69212c81cbc62e6"
server_key_version: "encryptionkey@0"
I20260807 04:21:29.923647 30429 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:29.946254 30429 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:29.950461 30429 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:29.950758 30429 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:29.971228 30429 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41791
I20260807 04:21:29.971252 30499 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41791 every 8 connection(s)
I20260807 04:21:29.972805 30429 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:21:29.976866 30500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:29.981268 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 30429
I20260807 04:21:29.981480 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:21:29.981933 7971 external_mini_cluster.cc:1428] Setting key 7351d1ee917c360988a0435688eb4dc0
I20260807 04:21:29.988394 30500 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69e6d4c7d34c431290ff019ed157417f: Bootstrap starting.
I20260807 04:21:29.992096 30500 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 69e6d4c7d34c431290ff019ed157417f: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:29.993435 30500 log.cc:824] T 00000000000000000000000000000000 P 69e6d4c7d34c431290ff019ed157417f: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:29.996676 30500 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69e6d4c7d34c431290ff019ed157417f: No bootstrap required, opened a new log
I20260807 04:21:29.996871 30503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:29.983872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:37781 (local address 127.0.0.1:41791)
0807 04:21:29.984717 (+ 845us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:29.984781 (+ 64us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:29.984839 (+ 58us) server_negotiation.cc:407] Connection header received
0807 04:21:29.986872 (+ 2033us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:29.986896 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:29.987287 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:29.987601 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:29.988276 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:29.989737 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:29.991720 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:29.992513 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:29.992685 (+ 172us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:29.994238 (+ 1553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:29.994251 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:29.994272 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:29.995080 (+ 808us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:29.995160 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:29.995186 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:29.995312 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:29.995596 (+ 284us) server_negotiation.cc:299] Negotiation successful
0807 04:21:29.995849 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":614,"thread_start_us":389,"threads_started":1}
I20260807 04:21:30.000967 7971 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 04:21:30.005604 30500 raft_consensus.cc:348] T 00000000000000000000000000000000 P 69e6d4c7d34c431290ff019ed157417f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69e6d4c7d34c431290ff019ed157417f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41791 } }
I20260807 04:21:30.006161 30500 raft_consensus.cc:374] T 00000000000000000000000000000000 P 69e6d4c7d34c431290ff019ed157417f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:30.006287 30500 raft_consensus.cc:729] T 00000000000000000000000000000000 P 69e6d4c7d34c431290ff019ed157417f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69e6d4c7d34c431290ff019ed157417f, State: Initialized, Role: FOLLOWER
I20260807 04:21:30.007063 30500 consensus_queue.cc:260] T 00000000000000000000000000000000 P 69e6d4c7d34c431290ff019ed157417f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69e6d4c7d34c431290ff019ed157417f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41791 } }
I20260807 04:21:30.007388 30500 raft_consensus.cc:388] T 00000000000000000000000000000000 P 69e6d4c7d34c431290ff019ed157417f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:21:30.007567 30500 raft_consensus.cc:482] T 00000000000000000000000000000000 P 69e6d4c7d34c431290ff019ed157417f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:21:30.007838 30500 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 69e6d4c7d34c431290ff019ed157417f [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:30.011154 30500 raft_consensus.cc:504] T 00000000000000000000000000000000 P 69e6d4c7d34c431290ff019ed157417f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69e6d4c7d34c431290ff019ed157417f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41791 } }
I20260807 04:21:30.011859 30500 leader_election.cc:302] T 00000000000000000000000000000000 P 69e6d4c7d34c431290ff019ed157417f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 69e6d4c7d34c431290ff019ed157417f; no voters:
I20260807 04:21:30.012627 30500 leader_election.cc:288] T 00000000000000000000000000000000 P 69e6d4c7d34c431290ff019ed157417f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:21:30.012781 30510 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 69e6d4c7d34c431290ff019ed157417f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:21:30.014047 30503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:30.005865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:60509 (local address 127.0.0.1:41791)
0807 04:21:30.006103 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:30.006109 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:30.006560 (+ 451us) server_negotiation.cc:407] Connection header received
0807 04:21:30.006817 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:30.006822 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:30.006892 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:30.006977 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:30.007721 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:30.008602 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:30.010653 (+ 2051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:30.011158 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:30.011262 (+ 104us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:30.012688 (+ 1426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:30.012693 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:30.012696 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:30.012774 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:30.012832 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:30.012855 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:30.013013 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:30.013677 (+ 664us) server_negotiation.cc:299] Negotiation successful
0807 04:21:30.013737 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260807 04:21:30.015182 30510 raft_consensus.cc:686] T 00000000000000000000000000000000 P 69e6d4c7d34c431290ff019ed157417f [term 1 LEADER]: Becoming Leader. State: Replica: 69e6d4c7d34c431290ff019ed157417f, State: Running, Role: LEADER
I20260807 04:21:30.015488 30500 sys_catalog.cc:564] T 00000000000000000000000000000000 P 69e6d4c7d34c431290ff019ed157417f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:21:30.015774 30510 consensus_queue.cc:237] T 00000000000000000000000000000000 P 69e6d4c7d34c431290ff019ed157417f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69e6d4c7d34c431290ff019ed157417f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41791 } }
I20260807 04:21:30.019309 30512 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69e6d4c7d34c431290ff019ed157417f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 69e6d4c7d34c431290ff019ed157417f. Latest consensus state: current_term: 1 leader_uuid: "69e6d4c7d34c431290ff019ed157417f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69e6d4c7d34c431290ff019ed157417f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41791 } } }
I20260807 04:21:30.019776 30512 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69e6d4c7d34c431290ff019ed157417f [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:30.019713 30511 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69e6d4c7d34c431290ff019ed157417f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "69e6d4c7d34c431290ff019ed157417f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69e6d4c7d34c431290ff019ed157417f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41791 } } }
I20260807 04:21:30.020004 30511 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69e6d4c7d34c431290ff019ed157417f [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:30.023802 30520 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:21:30.028546 30520 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:21:30.037750 30520 catalog_manager.cc:1347] Generated new cluster ID: 602485c956ec476ca9173c6d7a258bec
I20260807 04:21:30.037895 30520 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:21:30.054816 30520 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:21:30.056358 30520 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:21:30.066248 30520 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 69e6d4c7d34c431290ff019ed157417f: Generated new TSK 0
I20260807 04:21:30.067175 30520 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:21:30.081616 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 30429
W20260807 04:21:30.083205 30495 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.24:37781
W20260807 04:21:30.084000 7971 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 30429: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 04:21:30.084172 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 30429
W20260807 04:21:30.106942 30412 connection.cc:535] client connection to 127.0.0.1:41791 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41791): Connection reset by peer (error 104)
2026-08-07T04:21:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2108 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:21:30 dist-test-slave-qg60 krb5kdc[30534](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:21:30 dist-test-slave-qg60 krb5kdc[30534](info): set up 2 sockets
Aug 07 04:21:30 dist-test-slave-qg60 krb5kdc[30534](info): commencing operation
krb5kdc: starting...
W20260807 04:21:31.301751 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.175s user 0.001s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:21:31 dist-test-slave-qg60 krb5kdc[30534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076491, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:21:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:21:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 04:21:31.642004 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45205
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45205
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:21:31.993871 30547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:31.994158 30547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:31.994352 30547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:32.001829 30547 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:21:32.001972 30547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:32.002058 30547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:32.002144 30547 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:21:32.002206 30547 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:21:32.012723 30547 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45205
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45205
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:32.014286 30547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:32.015657 30547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:32.028522 30554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:32.028651 30556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:32.028631 30553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:32.029246 30547 server_base.cc:1034] running on GCE node
I20260807 04:21:32.030160 30547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:32.031625 30547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:32.032830 30547 hybrid_clock.cc:648] HybridClock initialized: now 1786076492032775 us; error 41 us; skew 500 ppm
I20260807 04:21:32.033223 30547 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:21:32 dist-test-slave-qg60 krb5kdc[30534](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076492, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:21:32.036535 30547 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 04:21:32.038033 30547 webserver.cc:460] Webserver started at http://127.0.0.1:36887/ using document root <none> and password file <none>
I20260807 04:21:32.038686 30547 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:32.038794 30547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:32.039065 30547 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:32.042054 30547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "d9fc8660ad344406b5e583a87b6b711e"
format_stamp: "Formatted at 2026-08-07 04:21:32 on dist-test-slave-qg60"
server_key: "436b65924427f82d6ef53d26b3c1ed81"
server_key_iv: "94845236f090e40ba29b44ae96cea812"
server_key_version: "encryptionkey@0"
I20260807 04:21:32.042786 30547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "d9fc8660ad344406b5e583a87b6b711e"
format_stamp: "Formatted at 2026-08-07 04:21:32 on dist-test-slave-qg60"
server_key: "436b65924427f82d6ef53d26b3c1ed81"
server_key_iv: "94845236f090e40ba29b44ae96cea812"
server_key_version: "encryptionkey@0"
I20260807 04:21:32.048054 30547 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 04:21:32.051491 30563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:32.052994 30547 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 04:21:32.053203 30547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "d9fc8660ad344406b5e583a87b6b711e"
format_stamp: "Formatted at 2026-08-07 04:21:32 on dist-test-slave-qg60"
server_key: "436b65924427f82d6ef53d26b3c1ed81"
server_key_iv: "94845236f090e40ba29b44ae96cea812"
server_key_version: "encryptionkey@0"
I20260807 04:21:32.053398 30547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:32.059194 30547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:32.063469 30547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:32.063802 30547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:32.083604 30547 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45205
I20260807 04:21:32.083698 30619 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45205 every 8 connection(s)
I20260807 04:21:32.085084 30547 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:21:32.088997 30620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:32.095332 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 30547
I20260807 04:21:32.095556 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:21:32.096081 7971 external_mini_cluster.cc:1428] Setting key 69414fb86e0dd20744df170c99ebc7ab
I20260807 04:21:32.100250 30620 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9fc8660ad344406b5e583a87b6b711e: Bootstrap starting.
I20260807 04:21:32.104192 30620 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d9fc8660ad344406b5e583a87b6b711e: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:32.105031 30624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:32.098283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:49225 (local address 127.0.0.1:45205)
0807 04:21:32.099178 (+ 895us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:32.099190 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:32.099233 (+ 43us) server_negotiation.cc:407] Connection header received
0807 04:21:32.101176 (+ 1943us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:32.101201 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:32.101566 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:32.101946 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:32.103183 (+ 1237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:32.103190 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:32.103202 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:32.103223 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:32.103289 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:32.103311 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:32.103457 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:32.103669 (+ 212us) server_negotiation.cc:299] Negotiation successful
0807 04:21:32.103895 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":667,"thread_start_us":379,"threads_started":1}
I20260807 04:21:32.105518 30620 log.cc:824] T 00000000000000000000000000000000 P d9fc8660ad344406b5e583a87b6b711e: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:32.108916 30620 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9fc8660ad344406b5e583a87b6b711e: No bootstrap required, opened a new log
I20260807 04:21:32.109248 7971 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 04:21:32.116720 30624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:32.113845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:43339 (local address 127.0.0.1:45205)
0807 04:21:32.114100 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:32.114114 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:32.114659 (+ 545us) server_negotiation.cc:407] Connection header received
0807 04:21:32.114867 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:32.114872 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:32.114937 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:32.115048 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:32.116053 (+ 1005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:32.116058 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:32.116067 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:32.116086 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:32.116133 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:32.116149 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:32.116291 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:32.116373 (+ 82us) server_negotiation.cc:299] Negotiation successful
0807 04:21:32.116439 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 04:21:32.117652 30620 raft_consensus.cc:348] T 00000000000000000000000000000000 P d9fc8660ad344406b5e583a87b6b711e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9fc8660ad344406b5e583a87b6b711e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45205 } }
I20260807 04:21:32.118068 30620 raft_consensus.cc:374] T 00000000000000000000000000000000 P d9fc8660ad344406b5e583a87b6b711e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:32.118182 30620 raft_consensus.cc:729] T 00000000000000000000000000000000 P d9fc8660ad344406b5e583a87b6b711e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9fc8660ad344406b5e583a87b6b711e, State: Initialized, Role: FOLLOWER
I20260807 04:21:32.118767 30620 consensus_queue.cc:260] T 00000000000000000000000000000000 P d9fc8660ad344406b5e583a87b6b711e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9fc8660ad344406b5e583a87b6b711e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45205 } }
I20260807 04:21:32.118997 30620 raft_consensus.cc:388] T 00000000000000000000000000000000 P d9fc8660ad344406b5e583a87b6b711e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:21:32.119107 30620 raft_consensus.cc:482] T 00000000000000000000000000000000 P d9fc8660ad344406b5e583a87b6b711e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:21:32.119246 30620 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d9fc8660ad344406b5e583a87b6b711e [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:32.121928 30620 raft_consensus.cc:504] T 00000000000000000000000000000000 P d9fc8660ad344406b5e583a87b6b711e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9fc8660ad344406b5e583a87b6b711e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45205 } }
I20260807 04:21:32.122440 30620 leader_election.cc:302] T 00000000000000000000000000000000 P d9fc8660ad344406b5e583a87b6b711e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d9fc8660ad344406b5e583a87b6b711e; no voters:
I20260807 04:21:32.122995 30620 leader_election.cc:288] T 00000000000000000000000000000000 P d9fc8660ad344406b5e583a87b6b711e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:21:32.123168 30632 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d9fc8660ad344406b5e583a87b6b711e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:21:32.124146 30632 raft_consensus.cc:686] T 00000000000000000000000000000000 P d9fc8660ad344406b5e583a87b6b711e [term 1 LEADER]: Becoming Leader. State: Replica: d9fc8660ad344406b5e583a87b6b711e, State: Running, Role: LEADER
I20260807 04:21:32.124902 30632 consensus_queue.cc:237] T 00000000000000000000000000000000 P d9fc8660ad344406b5e583a87b6b711e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9fc8660ad344406b5e583a87b6b711e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45205 } }
I20260807 04:21:32.125437 30620 sys_catalog.cc:564] T 00000000000000000000000000000000 P d9fc8660ad344406b5e583a87b6b711e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:21:32.127662 30634 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9fc8660ad344406b5e583a87b6b711e [sys.catalog]: SysCatalogTable state changed. Reason: New leader d9fc8660ad344406b5e583a87b6b711e. Latest consensus state: current_term: 1 leader_uuid: "d9fc8660ad344406b5e583a87b6b711e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9fc8660ad344406b5e583a87b6b711e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45205 } } }
I20260807 04:21:32.128414 30633 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9fc8660ad344406b5e583a87b6b711e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d9fc8660ad344406b5e583a87b6b711e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9fc8660ad344406b5e583a87b6b711e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45205 } } }
I20260807 04:21:32.128707 30634 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9fc8660ad344406b5e583a87b6b711e [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:32.128779 30633 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9fc8660ad344406b5e583a87b6b711e [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:32.133633 30644 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:21:32.138067 30644 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:21:32.147433 30644 catalog_manager.cc:1347] Generated new cluster ID: 26a2480e2a3845818bd2856eb23a5c4c
I20260807 04:21:32.147573 30644 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:21:32.186564 30644 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:21:32.187111 30644 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:21:32.203863 30644 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d9fc8660ad344406b5e583a87b6b711e: Generated new TSK 0
I20260807 04:21:32.204852 30644 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:21:32.211776 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 30547
W20260807 04:21:32.213416 30614 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.24:49225
W20260807 04:21:32.214115 7971 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 30547: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 04:21:32.214272 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 30547
2026-08-07T04:21:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2127 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:21:32 dist-test-slave-qg60 krb5kdc[30656](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:21:32 dist-test-slave-qg60 krb5kdc[30656](info): set up 2 sockets
Aug 07 04:21:32 dist-test-slave-qg60 krb5kdc[30656](info): commencing operation
krb5kdc: starting...
W20260807 04:21:33.410132 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.156s user 0.001s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:21:33 dist-test-slave-qg60 krb5kdc[30656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076493, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:21:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:21:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 04:21:33.767930 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32943
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32943
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:21:34.125186 30669 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:34.125484 30669 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:34.125644 30669 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:34.133189 30669 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:21:34.133312 30669 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:34.133420 30669 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:34.133533 30669 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:21:34.133621 30669 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:21:34.143712 30669 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32943
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:34.145116 30669 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:34.146512 30669 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:34.158897 30678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:34.158821 30675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:34.158942 30674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:34.159955 30669 server_base.cc:1034] running on GCE node
I20260807 04:21:34.160770 30669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:34.162242 30669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:34.163443 30669 hybrid_clock.cc:648] HybridClock initialized: now 1786076494163390 us; error 53 us; skew 500 ppm
I20260807 04:21:34.163827 30669 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:21:34 dist-test-slave-qg60 krb5kdc[30656](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076494, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:21:34.167168 30669 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 04:21:34.168895 30669 webserver.cc:460] Webserver started at http://127.0.0.1:34963/ using document root <none> and password file <none>
I20260807 04:21:34.169651 30669 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:34.169802 30669 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:34.170130 30669 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:34.173431 30669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "c6c7bf8a499c49cba3efb35c141916d6"
format_stamp: "Formatted at 2026-08-07 04:21:34 on dist-test-slave-qg60"
server_key: "0d335ec07f9cda4452e2f2c6bfdd5f4d"
server_key_iv: "148ace51afb795e5b9d7ebc55fee2055"
server_key_version: "encryptionkey@0"
I20260807 04:21:34.174278 30669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "c6c7bf8a499c49cba3efb35c141916d6"
format_stamp: "Formatted at 2026-08-07 04:21:34 on dist-test-slave-qg60"
server_key: "0d335ec07f9cda4452e2f2c6bfdd5f4d"
server_key_iv: "148ace51afb795e5b9d7ebc55fee2055"
server_key_version: "encryptionkey@0"
I20260807 04:21:34.180156 30669 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 04:21:34.184091 30686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:34.185580 30669 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:21:34.185804 30669 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "c6c7bf8a499c49cba3efb35c141916d6"
format_stamp: "Formatted at 2026-08-07 04:21:34 on dist-test-slave-qg60"
server_key: "0d335ec07f9cda4452e2f2c6bfdd5f4d"
server_key_iv: "148ace51afb795e5b9d7ebc55fee2055"
server_key_version: "encryptionkey@0"
I20260807 04:21:34.186026 30669 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:34.206270 30669 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:34.210876 30669 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:34.211195 30669 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:34.231323 30669 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32943
I20260807 04:21:34.231369 30741 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32943 every 8 connection(s)
I20260807 04:21:34.232821 30669 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:21:34.233450 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 30669
I20260807 04:21:34.233664 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:21:34.234303 7971 external_mini_cluster.cc:1428] Setting key 271974ea55b6f06e78c8d8ec95f77567
I20260807 04:21:34.237353 30742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 04:21:34 dist-test-slave-qg60 krb5kdc[30656](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076493, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 04:21:34.250960 30742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6c7bf8a499c49cba3efb35c141916d6: Bootstrap starting.
I20260807 04:21:34.254590 30742 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c6c7bf8a499c49cba3efb35c141916d6: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:34.255765 30742 log.cc:824] T 00000000000000000000000000000000 P c6c7bf8a499c49cba3efb35c141916d6: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:34.258917 30742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6c7bf8a499c49cba3efb35c141916d6: No bootstrap required, opened a new log
I20260807 04:21:34.259783 30745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:34.236299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:35559 (local address 127.0.0.1:32943)
0807 04:21:34.237161 (+ 862us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:34.237173 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:34.237214 (+ 41us) server_negotiation.cc:407] Connection header received
0807 04:21:34.238931 (+ 1717us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:34.238956 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:34.239330 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:34.239676 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:34.241670 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:34.243113 (+ 1443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:34.244960 (+ 1847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:34.245657 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:34.245789 (+ 132us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:34.251077 (+ 5288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:34.251090 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:34.251110 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:34.251167 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:34.254743 (+ 3576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:34.255844 (+ 1101us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:34.255874 (+ 30us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:34.255896 (+ 22us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:34.256107 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:34.256677 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:34.256681 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:34.256683 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:34.257318 (+ 635us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:34.257678 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:34.258289 (+ 611us) server_negotiation.cc:299] Negotiation successful
0807 04:21:34.258656 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":624,"thread_start_us":409,"threads_started":1}
I20260807 04:21:34.264381 7971 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 04:21:34.267761 30742 raft_consensus.cc:348] T 00000000000000000000000000000000 P c6c7bf8a499c49cba3efb35c141916d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6c7bf8a499c49cba3efb35c141916d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32943 } }
I20260807 04:21:34.268188 30742 raft_consensus.cc:374] T 00000000000000000000000000000000 P c6c7bf8a499c49cba3efb35c141916d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:34.268311 30742 raft_consensus.cc:729] T 00000000000000000000000000000000 P c6c7bf8a499c49cba3efb35c141916d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6c7bf8a499c49cba3efb35c141916d6, State: Initialized, Role: FOLLOWER
I20260807 04:21:34.269068 30742 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6c7bf8a499c49cba3efb35c141916d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6c7bf8a499c49cba3efb35c141916d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32943 } }
I20260807 04:21:34.269405 30742 raft_consensus.cc:388] T 00000000000000000000000000000000 P c6c7bf8a499c49cba3efb35c141916d6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:21:34.269601 30742 raft_consensus.cc:482] T 00000000000000000000000000000000 P c6c7bf8a499c49cba3efb35c141916d6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:21:34.269853 30742 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c6c7bf8a499c49cba3efb35c141916d6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:34.272326 30742 raft_consensus.cc:504] T 00000000000000000000000000000000 P c6c7bf8a499c49cba3efb35c141916d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6c7bf8a499c49cba3efb35c141916d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32943 } }
I20260807 04:21:34.272953 30742 leader_election.cc:302] T 00000000000000000000000000000000 P c6c7bf8a499c49cba3efb35c141916d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c6c7bf8a499c49cba3efb35c141916d6; no voters:
I20260807 04:21:34.273747 30742 leader_election.cc:288] T 00000000000000000000000000000000 P c6c7bf8a499c49cba3efb35c141916d6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:21:34.273855 30752 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c6c7bf8a499c49cba3efb35c141916d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:21:34.275110 30752 raft_consensus.cc:686] T 00000000000000000000000000000000 P c6c7bf8a499c49cba3efb35c141916d6 [term 1 LEADER]: Becoming Leader. State: Replica: c6c7bf8a499c49cba3efb35c141916d6, State: Running, Role: LEADER
I20260807 04:21:34.275826 30752 consensus_queue.cc:237] T 00000000000000000000000000000000 P c6c7bf8a499c49cba3efb35c141916d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6c7bf8a499c49cba3efb35c141916d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32943 } }
I20260807 04:21:34.276408 30742 sys_catalog.cc:564] T 00000000000000000000000000000000 P c6c7bf8a499c49cba3efb35c141916d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:21:34.279165 30754 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6c7bf8a499c49cba3efb35c141916d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6c7bf8a499c49cba3efb35c141916d6. Latest consensus state: current_term: 1 leader_uuid: "c6c7bf8a499c49cba3efb35c141916d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6c7bf8a499c49cba3efb35c141916d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32943 } } }
I20260807 04:21:34.279206 30753 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6c7bf8a499c49cba3efb35c141916d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c6c7bf8a499c49cba3efb35c141916d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6c7bf8a499c49cba3efb35c141916d6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32943 } } }
I20260807 04:21:34.279668 30754 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6c7bf8a499c49cba3efb35c141916d6 [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:34.279695 30753 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6c7bf8a499c49cba3efb35c141916d6 [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:34.280820 30759 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:21:34.291574 30745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:34.269683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:54245 (local address 127.0.0.1:32943)
0807 04:21:34.270052 (+ 369us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:34.270061 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:34.270321 (+ 260us) server_negotiation.cc:407] Connection header received
0807 04:21:34.270566 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:34.270572 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:34.270659 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:34.270795 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:34.272443 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:34.273527 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:34.275651 (+ 2124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:34.276362 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:34.276519 (+ 157us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:34.280469 (+ 3950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:34.280476 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:34.280481 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:34.280525 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:34.285696 (+ 5171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:34.287174 (+ 1478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:34.287185 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:34.287192 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:34.287421 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:34.288232 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:34.288242 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:34.288248 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:34.288849 (+ 601us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:34.289297 (+ 448us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:34.290594 (+ 1297us) server_negotiation.cc:299] Negotiation successful
0807 04:21:34.290927 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260807 04:21:34.303601 30759 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:21:34.314555 30773 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 04:21:34.315860 30759 catalog_manager.cc:1347] Generated new cluster ID: 04a96f158ede4947b2c9b1164ae69669
I20260807 04:21:34.315979 30759 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:21:34.326509 30759 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:21:34.328712 30759 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:21:34.336161 30759 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c6c7bf8a499c49cba3efb35c141916d6: Generated new TSK 0
I20260807 04:21:34.337198 30759 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:21:34.347980 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 30669
I20260807 04:21:34.349543 30737 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:21:34.441205 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 30669
W20260807 04:21:34.461685 30654 connection.cc:535] client connection to 127.0.0.1:32943 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:32943): Connection reset by peer (error 104)
2026-08-07T04:21:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2226 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:21:34 dist-test-slave-qg60 krb5kdc[30777](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:21:34 dist-test-slave-qg60 krb5kdc[30777](info): set up 2 sockets
Aug 07 04:21:34 dist-test-slave-qg60 krb5kdc[30777](info): commencing operation
krb5kdc: starting...
W20260807 04:21:35.610116 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.005s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:21:35 dist-test-slave-qg60 krb5kdc[30777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076495, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:21:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:21:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 04:21:35.955701 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42557
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42557
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:21:36.308825 30790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:36.309198 30790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:36.309377 30790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:36.316581 30790 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:21:36.316740 30790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:36.316898 30790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:36.316974 30790 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:21:36.317013 30790 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:21:36.327242 30790 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42557
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42557
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:36.328650 30790 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:36.330096 30790 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:36.342073 30795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:36.342161 30796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:36.342110 30798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:36.346278 30790 server_base.cc:1034] running on GCE node
I20260807 04:21:36.347147 30790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:36.348691 30790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:36.349988 30790 hybrid_clock.cc:648] HybridClock initialized: now 1786076496349892 us; error 99 us; skew 500 ppm
I20260807 04:21:36.350355 30790 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:21:36 dist-test-slave-qg60 krb5kdc[30777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076496, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:21:36.358188 30790 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 04:21:36.359879 30790 webserver.cc:460] Webserver started at http://127.0.0.1:45997/ using document root <none> and password file <none>
I20260807 04:21:36.360639 30790 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:36.360824 30790 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:36.361173 30790 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:36.364288 30790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "b4f896f68b504870b16f1c8b3ec9b5f4"
format_stamp: "Formatted at 2026-08-07 04:21:36 on dist-test-slave-qg60"
server_key: "a11ee9e318ed62d025165aadcfbfd3f2"
server_key_iv: "0e16984e2b343e4068ae1292d8b32a8b"
server_key_version: "encryptionkey@0"
I20260807 04:21:36.365168 30790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "b4f896f68b504870b16f1c8b3ec9b5f4"
format_stamp: "Formatted at 2026-08-07 04:21:36 on dist-test-slave-qg60"
server_key: "a11ee9e318ed62d025165aadcfbfd3f2"
server_key_iv: "0e16984e2b343e4068ae1292d8b32a8b"
server_key_version: "encryptionkey@0"
I20260807 04:21:36.370685 30790 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260807 04:21:36.374650 30807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:36.376091 30790 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 04:21:36.376318 30790 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "b4f896f68b504870b16f1c8b3ec9b5f4"
format_stamp: "Formatted at 2026-08-07 04:21:36 on dist-test-slave-qg60"
server_key: "a11ee9e318ed62d025165aadcfbfd3f2"
server_key_iv: "0e16984e2b343e4068ae1292d8b32a8b"
server_key_version: "encryptionkey@0"
I20260807 04:21:36.376536 30790 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:36.394784 30790 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:36.399046 30790 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:36.399365 30790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:36.419245 30790 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42557
I20260807 04:21:36.419293 30862 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42557 every 8 connection(s)
I20260807 04:21:36.420799 30790 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:21:36.424671 30863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:36.430568 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 30790
I20260807 04:21:36.430748 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:21:36.431363 7971 external_mini_cluster.cc:1428] Setting key 8b34c3c932c748fa0f3c7087e595f9d8
I20260807 04:21:36.437204 30863 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4f896f68b504870b16f1c8b3ec9b5f4: Bootstrap starting.
I20260807 04:21:36.440505 30863 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b4f896f68b504870b16f1c8b3ec9b5f4: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:36.441941 30863 log.cc:824] T 00000000000000000000000000000000 P b4f896f68b504870b16f1c8b3ec9b5f4: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:36.445783 30863 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4f896f68b504870b16f1c8b3ec9b5f4: No bootstrap required, opened a new log
I20260807 04:21:36.446302 30867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:36.433514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:42951 (local address 127.0.0.1:42557)
0807 04:21:36.434384 (+ 870us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:36.434401 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:36.434443 (+ 42us) server_negotiation.cc:407] Connection header received
0807 04:21:36.436255 (+ 1812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:36.436285 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:36.436814 (+ 529us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:36.437251 (+ 437us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:36.437920 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:36.439277 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:36.440716 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:36.441836 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:36.442054 (+ 218us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:36.443397 (+ 1343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:36.443405 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:36.443420 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:36.444205 (+ 785us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:36.444301 (+ 96us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:36.444335 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:36.444561 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:36.444832 (+ 271us) server_negotiation.cc:299] Negotiation successful
0807 04:21:36.445011 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":624,"thread_start_us":369,"threads_started":1}
I20260807 04:21:36.450259 7971 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 04:21:36.455943 30863 raft_consensus.cc:348] T 00000000000000000000000000000000 P b4f896f68b504870b16f1c8b3ec9b5f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4f896f68b504870b16f1c8b3ec9b5f4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42557 } }
I20260807 04:21:36.456446 30863 raft_consensus.cc:374] T 00000000000000000000000000000000 P b4f896f68b504870b16f1c8b3ec9b5f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:36.456585 30863 raft_consensus.cc:729] T 00000000000000000000000000000000 P b4f896f68b504870b16f1c8b3ec9b5f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4f896f68b504870b16f1c8b3ec9b5f4, State: Initialized, Role: FOLLOWER
I20260807 04:21:36.457363 30863 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4f896f68b504870b16f1c8b3ec9b5f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4f896f68b504870b16f1c8b3ec9b5f4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42557 } }
I20260807 04:21:36.457660 30863 raft_consensus.cc:388] T 00000000000000000000000000000000 P b4f896f68b504870b16f1c8b3ec9b5f4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:21:36.457824 30863 raft_consensus.cc:482] T 00000000000000000000000000000000 P b4f896f68b504870b16f1c8b3ec9b5f4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:21:36.458129 30863 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b4f896f68b504870b16f1c8b3ec9b5f4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:36.461122 30863 raft_consensus.cc:504] T 00000000000000000000000000000000 P b4f896f68b504870b16f1c8b3ec9b5f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4f896f68b504870b16f1c8b3ec9b5f4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42557 } }
I20260807 04:21:36.461735 30863 leader_election.cc:302] T 00000000000000000000000000000000 P b4f896f68b504870b16f1c8b3ec9b5f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b4f896f68b504870b16f1c8b3ec9b5f4; no voters:
I20260807 04:21:36.462572 30863 leader_election.cc:288] T 00000000000000000000000000000000 P b4f896f68b504870b16f1c8b3ec9b5f4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:21:36.462682 30876 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b4f896f68b504870b16f1c8b3ec9b5f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:21:36.462965 30867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:36.455721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:44851 (local address 127.0.0.1:42557)
0807 04:21:36.455900 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:36.455912 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:36.456199 (+ 287us) server_negotiation.cc:407] Connection header received
0807 04:21:36.456359 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:36.456365 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:36.456469 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:36.456586 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:36.457176 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:36.458481 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:36.459870 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:36.460602 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:36.460778 (+ 176us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:36.461890 (+ 1112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:36.461895 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:36.461900 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:36.461924 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:36.461995 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:36.462025 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:36.462154 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:36.462366 (+ 212us) server_negotiation.cc:299] Negotiation successful
0807 04:21:36.462425 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 04:21:36.463728 30876 raft_consensus.cc:686] T 00000000000000000000000000000000 P b4f896f68b504870b16f1c8b3ec9b5f4 [term 1 LEADER]: Becoming Leader. State: Replica: b4f896f68b504870b16f1c8b3ec9b5f4, State: Running, Role: LEADER
I20260807 04:21:36.464359 30876 consensus_queue.cc:237] T 00000000000000000000000000000000 P b4f896f68b504870b16f1c8b3ec9b5f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4f896f68b504870b16f1c8b3ec9b5f4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42557 } }
I20260807 04:21:36.465436 30863 sys_catalog.cc:564] T 00000000000000000000000000000000 P b4f896f68b504870b16f1c8b3ec9b5f4 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:21:36.467243 30878 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4f896f68b504870b16f1c8b3ec9b5f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4f896f68b504870b16f1c8b3ec9b5f4. Latest consensus state: current_term: 1 leader_uuid: "b4f896f68b504870b16f1c8b3ec9b5f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4f896f68b504870b16f1c8b3ec9b5f4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42557 } } }
I20260807 04:21:36.467648 30878 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4f896f68b504870b16f1c8b3ec9b5f4 [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:36.468917 30877 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4f896f68b504870b16f1c8b3ec9b5f4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b4f896f68b504870b16f1c8b3ec9b5f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4f896f68b504870b16f1c8b3ec9b5f4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42557 } } }
I20260807 04:21:36.469317 30877 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4f896f68b504870b16f1c8b3ec9b5f4 [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:36.469702 30882 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:21:36.475586 30882 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:21:36.485270 30882 catalog_manager.cc:1347] Generated new cluster ID: 7e6801ba1ce64acfb1f6271a707b116b
I20260807 04:21:36.485401 30882 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:21:36.505478 30882 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:21:36.506918 30882 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:21:36.518977 30882 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b4f896f68b504870b16f1c8b3ec9b5f4: Generated new TSK 0
I20260807 04:21:36.519945 30882 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:21:36.532408 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 30790
W20260807 04:21:36.534240 30858 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.24:42951
W20260807 04:21:36.535115 7971 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 30790: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 04:21:36.535287 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 30790
W20260807 04:21:36.556685 30775 connection.cc:535] client connection to 127.0.0.1:42557 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42557): Connection reset by peer (error 104)
2026-08-07T04:21:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2095 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:21:36 dist-test-slave-qg60 krb5kdc[30899](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:21:36 dist-test-slave-qg60 krb5kdc[30899](info): set up 2 sockets
Aug 07 04:21:36 dist-test-slave-qg60 krb5kdc[30899](info): commencing operation
krb5kdc: starting...
W20260807 04:21:37.715909 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.139s user 0.005s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:21:37 dist-test-slave-qg60 krb5kdc[30899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076497, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:21:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:21:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 04:21:38.056228 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33423
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33423
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:21:38.418776 30913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:38.419143 30913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:38.419296 30913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:38.426955 30913 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:21:38.427101 30913 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:38.427150 30913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:38.427214 30913 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:21:38.427259 30913 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:21:38.437876 30913 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33423
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786076137270840-7971-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33423
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:38.439275 30913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:38.440685 30913 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:38.452684 30918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:38.453372 30919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:38.453382 30921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:38.454290 30913 server_base.cc:1034] running on GCE node
I20260807 04:21:38.455140 30913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:38.456713 30913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:38.458055 30913 hybrid_clock.cc:648] HybridClock initialized: now 1786076498457998 us; error 54 us; skew 500 ppm
I20260807 04:21:38.458464 30913 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:21:38 dist-test-slave-qg60 krb5kdc[30899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076498, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:21:38.462062 30913 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 04:21:38.463551 30913 webserver.cc:460] Webserver started at http://127.0.0.1:42673/ using document root <none> and password file <none>
I20260807 04:21:38.464298 30913 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:38.464407 30913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:38.464668 30913 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:38.467841 30913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "1f6e224626734b0390bcef003b4cdfea"
format_stamp: "Formatted at 2026-08-07 04:21:38 on dist-test-slave-qg60"
server_key: "4dca307f92d4d9560d17d10cf6f0d0a9"
server_key_iv: "221f9be0b80abb9cea008c8404bd85e1"
server_key_version: "encryptionkey@0"
I20260807 04:21:38.468598 30913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "1f6e224626734b0390bcef003b4cdfea"
format_stamp: "Formatted at 2026-08-07 04:21:38 on dist-test-slave-qg60"
server_key: "4dca307f92d4d9560d17d10cf6f0d0a9"
server_key_iv: "221f9be0b80abb9cea008c8404bd85e1"
server_key_version: "encryptionkey@0"
I20260807 04:21:38.474380 30913 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260807 04:21:38.478163 30929 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:38.479642 30913 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:21:38.479861 30913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "1f6e224626734b0390bcef003b4cdfea"
format_stamp: "Formatted at 2026-08-07 04:21:38 on dist-test-slave-qg60"
server_key: "4dca307f92d4d9560d17d10cf6f0d0a9"
server_key_iv: "221f9be0b80abb9cea008c8404bd85e1"
server_key_version: "encryptionkey@0"
I20260807 04:21:38.480094 30913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:38.486055 30913 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:38.490409 30913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:38.490773 30913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:38.510733 30913 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33423
I20260807 04:21:38.510785 30987 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33423 every 8 connection(s)
I20260807 04:21:38.512317 30913 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:21:38.516184 30988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:38.521486 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 30913
I20260807 04:21:38.521692 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:21:38.522279 7971 external_mini_cluster.cc:1428] Setting key 67e01a55b8fef37c273dfb26dcdafa83
I20260807 04:21:38.527726 30988 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f6e224626734b0390bcef003b4cdfea: Bootstrap starting.
I20260807 04:21:38.530514 30992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:38.524298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:44789 (local address 127.0.0.1:33423)
0807 04:21:38.525254 (+ 956us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:38.525266 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:38.525306 (+ 40us) server_negotiation.cc:407] Connection header received
0807 04:21:38.527031 (+ 1725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:38.527053 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:38.527396 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:38.527724 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:38.528903 (+ 1179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:38.528909 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:38.528921 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:38.528938 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:38.529003 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:38.529023 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:38.529193 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:38.529339 (+ 146us) server_negotiation.cc:299] Negotiation successful
0807 04:21:38.529569 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":725,"thread_start_us":430,"threads_started":1}
I20260807 04:21:38.531522 30988 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f6e224626734b0390bcef003b4cdfea: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:38.532860 30988 log.cc:824] T 00000000000000000000000000000000 P 1f6e224626734b0390bcef003b4cdfea: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:38.534397 7971 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 04:21:38.535904 30988 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f6e224626734b0390bcef003b4cdfea: No bootstrap required, opened a new log
I20260807 04:21:38.541746 30992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:38.538910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:46701 (local address 127.0.0.1:33423)
0807 04:21:38.539146 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:38.539155 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:38.539633 (+ 478us) server_negotiation.cc:407] Connection header received
0807 04:21:38.539812 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:38.539816 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:38.539867 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:38.539963 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:38.541013 (+ 1050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:38.541017 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:38.541021 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:38.541039 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:38.541083 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:38.541098 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:38.541191 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:38.541338 (+ 147us) server_negotiation.cc:299] Negotiation successful
0807 04:21:38.541395 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 04:21:38.545603 30988 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f6e224626734b0390bcef003b4cdfea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f6e224626734b0390bcef003b4cdfea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33423 } }
I20260807 04:21:38.545993 30988 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1f6e224626734b0390bcef003b4cdfea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:38.546090 30988 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f6e224626734b0390bcef003b4cdfea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f6e224626734b0390bcef003b4cdfea, State: Initialized, Role: FOLLOWER
I20260807 04:21:38.546705 30988 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f6e224626734b0390bcef003b4cdfea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f6e224626734b0390bcef003b4cdfea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33423 } }
I20260807 04:21:38.546958 30988 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1f6e224626734b0390bcef003b4cdfea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:21:38.547122 30988 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f6e224626734b0390bcef003b4cdfea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:21:38.547339 30988 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f6e224626734b0390bcef003b4cdfea [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:38.550184 30988 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f6e224626734b0390bcef003b4cdfea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f6e224626734b0390bcef003b4cdfea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33423 } }
I20260807 04:21:38.550731 30988 leader_election.cc:302] T 00000000000000000000000000000000 P 1f6e224626734b0390bcef003b4cdfea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f6e224626734b0390bcef003b4cdfea; no voters:
I20260807 04:21:38.551342 30988 leader_election.cc:288] T 00000000000000000000000000000000 P 1f6e224626734b0390bcef003b4cdfea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:21:38.551530 30999 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f6e224626734b0390bcef003b4cdfea [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:21:38.552256 30999 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1f6e224626734b0390bcef003b4cdfea [term 1 LEADER]: Becoming Leader. State: Replica: 1f6e224626734b0390bcef003b4cdfea, State: Running, Role: LEADER
I20260807 04:21:38.552853 30999 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f6e224626734b0390bcef003b4cdfea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f6e224626734b0390bcef003b4cdfea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33423 } }
I20260807 04:21:38.553716 30988 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f6e224626734b0390bcef003b4cdfea [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:21:38.555827 31000 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f6e224626734b0390bcef003b4cdfea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1f6e224626734b0390bcef003b4cdfea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f6e224626734b0390bcef003b4cdfea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33423 } } }
I20260807 04:21:38.556375 31000 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f6e224626734b0390bcef003b4cdfea [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:38.556612 31001 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f6e224626734b0390bcef003b4cdfea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f6e224626734b0390bcef003b4cdfea. Latest consensus state: current_term: 1 leader_uuid: "1f6e224626734b0390bcef003b4cdfea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f6e224626734b0390bcef003b4cdfea" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33423 } } }
I20260807 04:21:38.558413 31001 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f6e224626734b0390bcef003b4cdfea [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:38.561432 31006 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:21:38.567534 31006 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:21:38.578270 31006 catalog_manager.cc:1347] Generated new cluster ID: 0cf6e01186aa47f6aaf570bed769dced
I20260807 04:21:38.578465 31006 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:21:38.601820 31006 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:21:38.602404 31006 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:21:38.608771 31006 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1f6e224626734b0390bcef003b4cdfea: Generated new TSK 0
I20260807 04:21:38.609681 31006 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:21:38.619057 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 30913
W20260807 04:21:38.620265 30983 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.24:44789
W20260807 04:21:38.621122 7971 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 30913: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 04:21:38.621295 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 30913
2026-08-07T04:21:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2086 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:21:38 dist-test-slave-qg60 krb5kdc[31022](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:21:38 dist-test-slave-qg60 krb5kdc[31022](info): set up 2 sockets
Aug 07 04:21:38 dist-test-slave-qg60 krb5kdc[31022](info): commencing operation
krb5kdc: starting...
W20260807 04:21:39.834143 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.000s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:21:40 dist-test-slave-qg60 krb5kdc[31022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076500, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:21:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:21:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
I20260807 04:21:40.180136 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:43435
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:46401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:43435
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:21:40.529366 31035 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:40.529731 31035 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:40.529889 31035 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:40.538183 31035 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:21:40.538352 31035 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:40.538470 31035 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:40.538583 31035 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:21:40.538662 31035 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:21:40.549257 31035 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:46401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:43435
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:43435
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:40.550671 31035 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:40.552111 31035 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:40.564888 31040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:40.564832 31041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:40.564857 31043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:40.565796 31035 server_base.cc:1034] running on GCE node
I20260807 04:21:40.566651 31035 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:40.568208 31035 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:40.569478 31035 hybrid_clock.cc:648] HybridClock initialized: now 1786076500569437 us; error 53 us; skew 500 ppm
I20260807 04:21:40.569902 31035 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:21:40 dist-test-slave-qg60 krb5kdc[31022](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076500, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:21:40.573480 31035 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:21:40.575237 31035 webserver.cc:460] Webserver started at http://127.7.200.254:38633/ using document root <none> and password file <none>
I20260807 04:21:40.575995 31035 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:40.576159 31035 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:40.576498 31035 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:40.579849 31035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "7a88c23474c74889b99210bd616ca3f3"
format_stamp: "Formatted at 2026-08-07 04:21:40 on dist-test-slave-qg60"
server_key: "230b71af8f0277904a01907820ca1299"
server_key_iv: "e9a2476d628aa453e2f348409f4fe0da"
server_key_version: "encryptionkey@0"
I20260807 04:21:40.580917 31035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "7a88c23474c74889b99210bd616ca3f3"
format_stamp: "Formatted at 2026-08-07 04:21:40 on dist-test-slave-qg60"
server_key: "230b71af8f0277904a01907820ca1299"
server_key_iv: "e9a2476d628aa453e2f348409f4fe0da"
server_key_version: "encryptionkey@0"
I20260807 04:21:40.586393 31035 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 04:21:40.590082 31051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:40.591442 31035 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 04:21:40.591632 31035 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "7a88c23474c74889b99210bd616ca3f3"
format_stamp: "Formatted at 2026-08-07 04:21:40 on dist-test-slave-qg60"
server_key: "230b71af8f0277904a01907820ca1299"
server_key_iv: "e9a2476d628aa453e2f348409f4fe0da"
server_key_version: "encryptionkey@0"
I20260807 04:21:40.591838 31035 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:40.607211 31035 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:40.611654 31035 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:40.611984 31035 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:40.632004 31035 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:43435
I20260807 04:21:40.632037 31108 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:43435 every 8 connection(s)
I20260807 04:21:40.633605 31035 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:21:40.637543 31109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:40.643996 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 31035
I20260807 04:21:40.644220 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:21:40.644797 7971 external_mini_cluster.cc:1428] Setting key 09215b85a5285dba602bba520ae038b3
I20260807 04:21:40.648989 31109 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a88c23474c74889b99210bd616ca3f3: Bootstrap starting.
I20260807 04:21:40.652196 31109 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7a88c23474c74889b99210bd616ca3f3: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:40.653395 31109 log.cc:824] T 00000000000000000000000000000000 P 7a88c23474c74889b99210bd616ca3f3: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:40.656827 31109 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a88c23474c74889b99210bd616ca3f3: No bootstrap required, opened a new log
Aug 07 04:21:40 dist-test-slave-qg60 krb5kdc[31022](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076500, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:21:40.666580 31109 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7a88c23474c74889b99210bd616ca3f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a88c23474c74889b99210bd616ca3f3" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43435 } }
I20260807 04:21:40.667007 31109 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7a88c23474c74889b99210bd616ca3f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:40.667122 31109 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7a88c23474c74889b99210bd616ca3f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a88c23474c74889b99210bd616ca3f3, State: Initialized, Role: FOLLOWER
I20260807 04:21:40.667804 31109 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7a88c23474c74889b99210bd616ca3f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a88c23474c74889b99210bd616ca3f3" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43435 } }
I20260807 04:21:40.668144 31109 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7a88c23474c74889b99210bd616ca3f3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:21:40.668306 31109 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7a88c23474c74889b99210bd616ca3f3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:21:40.668485 31109 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7a88c23474c74889b99210bd616ca3f3 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:40.672117 31112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:40.646745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40699 (local address 127.7.200.254:43435)
0807 04:21:40.647605 (+ 860us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:40.647619 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:40.647663 (+ 44us) server_negotiation.cc:407] Connection header received
0807 04:21:40.649841 (+ 2178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:40.649865 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:40.650309 (+ 444us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:40.650760 (+ 451us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:40.652542 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:40.654354 (+ 1812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:40.656172 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:40.657039 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:40.657179 (+ 140us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:40.662496 (+ 5317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:40.662507 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:40.662530 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:40.662591 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:40.666542 (+ 3951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:40.667676 (+ 1134us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:40.667684 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:40.667694 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:40.667910 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:40.668582 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:40.668588 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:40.668591 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:40.669435 (+ 844us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:40.669789 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:40.670220 (+ 431us) server_negotiation.cc:299] Negotiation successful
0807 04:21:40.670617 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":393,"threads_started":1}
I20260807 04:21:40.672143 31109 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7a88c23474c74889b99210bd616ca3f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a88c23474c74889b99210bd616ca3f3" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43435 } }
I20260807 04:21:40.672860 31109 leader_election.cc:302] T 00000000000000000000000000000000 P 7a88c23474c74889b99210bd616ca3f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7a88c23474c74889b99210bd616ca3f3; no voters:
I20260807 04:21:40.673637 31109 leader_election.cc:288] T 00000000000000000000000000000000 P 7a88c23474c74889b99210bd616ca3f3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:21:40.673792 31116 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7a88c23474c74889b99210bd616ca3f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:21:40.675894 31109 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7a88c23474c74889b99210bd616ca3f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:21:40.677016 31116 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7a88c23474c74889b99210bd616ca3f3 [term 1 LEADER]: Becoming Leader. State: Replica: 7a88c23474c74889b99210bd616ca3f3, State: Running, Role: LEADER
I20260807 04:21:40.678023 7971 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 04:21:40.677906 31116 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7a88c23474c74889b99210bd616ca3f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a88c23474c74889b99210bd616ca3f3" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43435 } }
I20260807 04:21:40.681025 31118 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a88c23474c74889b99210bd616ca3f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7a88c23474c74889b99210bd616ca3f3. Latest consensus state: current_term: 1 leader_uuid: "7a88c23474c74889b99210bd616ca3f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a88c23474c74889b99210bd616ca3f3" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43435 } } }
I20260807 04:21:40.681519 31118 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a88c23474c74889b99210bd616ca3f3 [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:40.682229 31117 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a88c23474c74889b99210bd616ca3f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7a88c23474c74889b99210bd616ca3f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a88c23474c74889b99210bd616ca3f3" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43435 } } }
I20260807 04:21:40.682667 31117 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a88c23474c74889b99210bd616ca3f3 [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:40.688915 31128 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:21:40.696419 31128 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:21:40.714581 31112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:40.692411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50397 (local address 127.7.200.254:43435)
0807 04:21:40.692607 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:40.692616 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:40.692644 (+ 28us) server_negotiation.cc:407] Connection header received
0807 04:21:40.692962 (+ 318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:40.692968 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:40.693068 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:40.693192 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:40.695524 (+ 2332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:40.696940 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:40.698992 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:40.699713 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:40.699829 (+ 116us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:40.703485 (+ 3656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:40.703494 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:40.703498 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:40.703538 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:40.709395 (+ 5857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:40.710992 (+ 1597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:40.710997 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:40.711000 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:40.711236 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:40.711894 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:40.711906 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:40.711911 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:40.712395 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:40.712677 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:40.713684 (+ 1007us) server_negotiation.cc:299] Negotiation successful
0807 04:21:40.713891 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 04:21:40.723349 31128 catalog_manager.cc:1347] Generated new cluster ID: 27d9fee0128e4ab1818ce2443bfe8777
I20260807 04:21:40.723493 31128 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:21:40.756539 31128 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:21:40.758807 31128 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:21:40.769994 31128 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7a88c23474c74889b99210bd616ca3f3: Generated new TSK 0
I20260807 04:21:40.770856 31128 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:21:40.783773 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 31035
I20260807 04:21:40.785100 31104 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:21:40.903769 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 31035
W20260807 04:21:40.924870 31019 connection.cc:535] client connection to 127.7.200.254:43435 recv error: Network error: failed to read from TLS socket (remote: 127.7.200.254:43435): Connection reset by peer (error 104)
2026-08-07T04:21:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2281 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:21:41 dist-test-slave-qg60 krb5kdc[31145](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:21:41 dist-test-slave-qg60 krb5kdc[31145](info): set up 2 sockets
Aug 07 04:21:41 dist-test-slave-qg60 krb5kdc[31145](info): commencing operation
krb5kdc: starting...
W20260807 04:21:42.081918 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.138s user 0.000s sys 0.053s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:21:42 dist-test-slave-qg60 krb5kdc[31145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076502, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:21:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:21:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
I20260807 04:21:42.417893 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:45167
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:43273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:45167
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:21:42.769640 31160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:42.769934 31160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:42.770030 31160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:42.777333 31160 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:21:42.777449 31160 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:42.777498 31160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:42.777565 31160 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:21:42.777611 31160 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:21:42.788177 31160 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:43273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:45167
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:45167
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:42.789537 31160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:42.790874 31160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:42.803699 31169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:42.803743 31166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:42.803785 31167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:42.804440 31160 server_base.cc:1034] running on GCE node
I20260807 04:21:42.805277 31160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:42.806680 31160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:42.807893 31160 hybrid_clock.cc:648] HybridClock initialized: now 1786076502807854 us; error 105 us; skew 500 ppm
I20260807 04:21:42.808312 31160 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:21:42 dist-test-slave-qg60 krb5kdc[31145](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076502, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:21:42.818233 31160 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:21:42.820004 31160 webserver.cc:460] Webserver started at http://127.7.200.254:34107/ using document root <none> and password file <none>
I20260807 04:21:42.820803 31160 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:42.820957 31160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:42.821286 31160 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:42.824358 31160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "f9406c57871f41599e6889afb5b67765"
format_stamp: "Formatted at 2026-08-07 04:21:42 on dist-test-slave-qg60"
server_key: "6a5e23ff0b577b0bfa51f7fe968cd96f"
server_key_iv: "fa16b033c9f4e2004858c38d390b5b5e"
server_key_version: "encryptionkey@0"
I20260807 04:21:42.825171 31160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "f9406c57871f41599e6889afb5b67765"
format_stamp: "Formatted at 2026-08-07 04:21:42 on dist-test-slave-qg60"
server_key: "6a5e23ff0b577b0bfa51f7fe968cd96f"
server_key_iv: "fa16b033c9f4e2004858c38d390b5b5e"
server_key_version: "encryptionkey@0"
I20260807 04:21:42.830334 31160 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 04:21:42.833774 31176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:42.835134 31160 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 04:21:42.835336 31160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "f9406c57871f41599e6889afb5b67765"
format_stamp: "Formatted at 2026-08-07 04:21:42 on dist-test-slave-qg60"
server_key: "6a5e23ff0b577b0bfa51f7fe968cd96f"
server_key_iv: "fa16b033c9f4e2004858c38d390b5b5e"
server_key_version: "encryptionkey@0"
I20260807 04:21:42.835551 31160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:42.866562 31160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:42.871105 31160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:42.871474 31160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:42.892158 31160 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:45167
I20260807 04:21:42.892207 31230 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:45167 every 8 connection(s)
I20260807 04:21:42.893676 31160 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:21:42.897490 31231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:42.901989 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 31160
I20260807 04:21:42.902201 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:21:42.902750 7971 external_mini_cluster.cc:1428] Setting key 407409d5217d5121d07bddd4bca6f345
I20260807 04:21:42.909369 31231 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9406c57871f41599e6889afb5b67765: Bootstrap starting.
I20260807 04:21:42.913218 31231 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f9406c57871f41599e6889afb5b67765: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:42.914448 31231 log.cc:824] T 00000000000000000000000000000000 P f9406c57871f41599e6889afb5b67765: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:42.918169 31231 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9406c57871f41599e6889afb5b67765: No bootstrap required, opened a new log
I20260807 04:21:42.918232 31235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:42.904904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55545 (local address 127.7.200.254:45167)
0807 04:21:42.905894 (+ 990us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:42.905907 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:42.905961 (+ 54us) server_negotiation.cc:407] Connection header received
0807 04:21:42.908002 (+ 2041us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:42.908026 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:42.908464 (+ 438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:42.908922 (+ 458us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:42.909580 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:42.911221 (+ 1641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:42.913210 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:42.914111 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:42.914259 (+ 148us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:42.915865 (+ 1606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:42.915874 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:42.915889 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:42.916436 (+ 547us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:42.916511 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:42.916545 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:42.916726 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:42.917054 (+ 328us) server_negotiation.cc:299] Negotiation successful
0807 04:21:42.917228 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":743,"thread_start_us":506,"threads_started":1}
I20260807 04:21:42.922765 7971 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 04:21:42.926983 31231 raft_consensus.cc:348] T 00000000000000000000000000000000 P f9406c57871f41599e6889afb5b67765 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9406c57871f41599e6889afb5b67765" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 45167 } }
I20260807 04:21:42.927394 31231 raft_consensus.cc:374] T 00000000000000000000000000000000 P f9406c57871f41599e6889afb5b67765 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:42.927501 31231 raft_consensus.cc:729] T 00000000000000000000000000000000 P f9406c57871f41599e6889afb5b67765 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9406c57871f41599e6889afb5b67765, State: Initialized, Role: FOLLOWER
I20260807 04:21:42.928246 31231 consensus_queue.cc:260] T 00000000000000000000000000000000 P f9406c57871f41599e6889afb5b67765 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9406c57871f41599e6889afb5b67765" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 45167 } }
I20260807 04:21:42.928584 31231 raft_consensus.cc:388] T 00000000000000000000000000000000 P f9406c57871f41599e6889afb5b67765 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:21:42.928772 31231 raft_consensus.cc:482] T 00000000000000000000000000000000 P f9406c57871f41599e6889afb5b67765 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:21:42.929028 31231 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f9406c57871f41599e6889afb5b67765 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:42.932271 31231 raft_consensus.cc:504] T 00000000000000000000000000000000 P f9406c57871f41599e6889afb5b67765 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9406c57871f41599e6889afb5b67765" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 45167 } }
I20260807 04:21:42.932957 31231 leader_election.cc:302] T 00000000000000000000000000000000 P f9406c57871f41599e6889afb5b67765 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f9406c57871f41599e6889afb5b67765; no voters:
I20260807 04:21:42.933676 31231 leader_election.cc:288] T 00000000000000000000000000000000 P f9406c57871f41599e6889afb5b67765 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:21:42.933804 31242 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f9406c57871f41599e6889afb5b67765 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:21:42.934736 31242 raft_consensus.cc:686] T 00000000000000000000000000000000 P f9406c57871f41599e6889afb5b67765 [term 1 LEADER]: Becoming Leader. State: Replica: f9406c57871f41599e6889afb5b67765, State: Running, Role: LEADER
I20260807 04:21:42.935460 31242 consensus_queue.cc:237] T 00000000000000000000000000000000 P f9406c57871f41599e6889afb5b67765 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9406c57871f41599e6889afb5b67765" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 45167 } }
I20260807 04:21:42.936509 31235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:42.928118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50763 (local address 127.7.200.254:45167)
0807 04:21:42.928369 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:42.928379 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:42.928979 (+ 600us) server_negotiation.cc:407] Connection header received
0807 04:21:42.929301 (+ 322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:42.929305 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:42.929386 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:42.929488 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:42.930172 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:42.930968 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:42.932915 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:42.933528 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:42.933692 (+ 164us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:42.935338 (+ 1646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:42.935344 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:42.935348 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:42.935371 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:42.935432 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:42.935462 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:42.935600 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:42.936121 (+ 521us) server_negotiation.cc:299] Negotiation successful
0807 04:21:42.936187 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 04:21:42.936471 31231 sys_catalog.cc:564] T 00000000000000000000000000000000 P f9406c57871f41599e6889afb5b67765 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:21:42.938757 31244 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9406c57871f41599e6889afb5b67765 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f9406c57871f41599e6889afb5b67765. Latest consensus state: current_term: 1 leader_uuid: "f9406c57871f41599e6889afb5b67765" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9406c57871f41599e6889afb5b67765" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 45167 } } }
I20260807 04:21:42.938855 31243 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9406c57871f41599e6889afb5b67765 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f9406c57871f41599e6889afb5b67765" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9406c57871f41599e6889afb5b67765" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 45167 } } }
I20260807 04:21:42.939208 31244 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9406c57871f41599e6889afb5b67765 [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:42.939266 31243 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9406c57871f41599e6889afb5b67765 [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:42.940194 31247 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:21:42.946700 31247 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:21:42.956401 31247 catalog_manager.cc:1347] Generated new cluster ID: 3e9af181a0bc4aad966a7ce31ad293b1
I20260807 04:21:42.956534 31247 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:21:42.966501 31247 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:21:42.968019 31247 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:21:42.975252 31247 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f9406c57871f41599e6889afb5b67765: Generated new TSK 0
I20260807 04:21:42.976119 31247 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:21:42.982992 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 31160
W20260807 04:21:42.984318 31226 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:55545
W20260807 04:21:42.985170 7971 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 31160: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 04:21:42.985337 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 31160
W20260807 04:21:43.005553 31143 connection.cc:535] client connection to 127.7.200.254:45167 recv error: Network error: failed to read from TLS socket (remote: 127.7.200.254:45167): Connection reset by peer (error 104)
2026-08-07T04:21:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2081 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:21:43 dist-test-slave-qg60 krb5kdc[31264](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:21:43 dist-test-slave-qg60 krb5kdc[31264](info): set up 2 sockets
Aug 07 04:21:43 dist-test-slave-qg60 krb5kdc[31264](info): commencing operation
krb5kdc: starting...
W20260807 04:21:44.260637 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.234s user 0.000s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:21:44 dist-test-slave-qg60 krb5kdc[31264](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076504, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:21:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:21:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
I20260807 04:21:44.630268 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:43915
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:41179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:43915
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:21:44.984401 31279 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:44.984699 31279 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:44.984884 31279 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:44.992420 31279 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:21:44.992544 31279 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:44.992641 31279 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:44.992769 31279 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:21:44.992851 31279 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:21:45.003000 31279 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:41179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:43915
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:43915
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:45.004415 31279 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:45.005832 31279 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:45.019644 31286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:45.019737 31288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:45.019690 31285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:45.022401 31279 server_base.cc:1034] running on GCE node
I20260807 04:21:45.023307 31279 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:45.024921 31279 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:45.026173 31279 hybrid_clock.cc:648] HybridClock initialized: now 1786076505026092 us; error 75 us; skew 500 ppm
I20260807 04:21:45.026618 31279 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:21:45 dist-test-slave-qg60 krb5kdc[31264](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076505, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:21:45.029922 31279 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:21:45.031504 31279 webserver.cc:460] Webserver started at http://127.7.200.254:39345/ using document root <none> and password file <none>
I20260807 04:21:45.032380 31279 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:45.032557 31279 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:45.032961 31279 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:45.036073 31279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "4ed33cc24c4b400cbbe21f8e158cce84"
format_stamp: "Formatted at 2026-08-07 04:21:45 on dist-test-slave-qg60"
server_key: "d6235d9bf0fd441c1132710a4ec7c071"
server_key_iv: "156116ccb8fe27cff5c63c3686d8f313"
server_key_version: "encryptionkey@0"
I20260807 04:21:45.036943 31279 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "4ed33cc24c4b400cbbe21f8e158cce84"
format_stamp: "Formatted at 2026-08-07 04:21:45 on dist-test-slave-qg60"
server_key: "d6235d9bf0fd441c1132710a4ec7c071"
server_key_iv: "156116ccb8fe27cff5c63c3686d8f313"
server_key_version: "encryptionkey@0"
I20260807 04:21:45.042369 31279 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260807 04:21:45.046069 31297 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:45.047536 31279 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:21:45.047760 31279 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "4ed33cc24c4b400cbbe21f8e158cce84"
format_stamp: "Formatted at 2026-08-07 04:21:45 on dist-test-slave-qg60"
server_key: "d6235d9bf0fd441c1132710a4ec7c071"
server_key_iv: "156116ccb8fe27cff5c63c3686d8f313"
server_key_version: "encryptionkey@0"
I20260807 04:21:45.048000 31279 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:45.054538 31279 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:45.059237 31279 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:45.059599 31279 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:45.080947 31279 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:43915
I20260807 04:21:45.081039 31352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:43915 every 8 connection(s)
I20260807 04:21:45.082525 31279 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:21:45.086634 31353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:45.089066 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 31279
I20260807 04:21:45.089264 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:21:45.089712 7971 external_mini_cluster.cc:1428] Setting key fc0977b1dad76e363b185b2064edea5b
I20260807 04:21:45.098256 31356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:45.091677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50793 (local address 127.7.200.254:43915)
0807 04:21:45.092552 (+ 875us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:45.092565 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:45.092615 (+ 50us) server_negotiation.cc:407] Connection header received
0807 04:21:45.094416 (+ 1801us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:45.094441 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:45.094799 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:45.095288 (+ 489us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:45.096432 (+ 1144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:45.096438 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:45.096454 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:45.096474 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:45.096532 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:45.096553 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:45.096841 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:45.097012 (+ 171us) server_negotiation.cc:299] Negotiation successful
0807 04:21:45.097212 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":628,"thread_start_us":401,"threads_started":1}
I20260807 04:21:45.099300 31353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ed33cc24c4b400cbbe21f8e158cce84: Bootstrap starting.
I20260807 04:21:45.102288 7971 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 04:21:45.102887 31353 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ed33cc24c4b400cbbe21f8e158cce84: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:45.103945 31353 log.cc:824] T 00000000000000000000000000000000 P 4ed33cc24c4b400cbbe21f8e158cce84: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:45.107223 31353 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ed33cc24c4b400cbbe21f8e158cce84: No bootstrap required, opened a new log
I20260807 04:21:45.110036 31356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:45.107230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41091 (local address 127.7.200.254:43915)
0807 04:21:45.107422 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:45.107430 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:45.107763 (+ 333us) server_negotiation.cc:407] Connection header received
0807 04:21:45.107978 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:45.107990 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:45.108044 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:45.108187 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:45.109294 (+ 1107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:45.109303 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:45.109307 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:45.109326 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:45.109374 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:45.109400 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:45.109541 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:45.109680 (+ 139us) server_negotiation.cc:299] Negotiation successful
0807 04:21:45.109746 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 04:21:45.116115 31353 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ed33cc24c4b400cbbe21f8e158cce84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ed33cc24c4b400cbbe21f8e158cce84" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43915 } }
I20260807 04:21:45.116542 31353 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ed33cc24c4b400cbbe21f8e158cce84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:45.116655 31353 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ed33cc24c4b400cbbe21f8e158cce84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ed33cc24c4b400cbbe21f8e158cce84, State: Initialized, Role: FOLLOWER
I20260807 04:21:45.117307 31353 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ed33cc24c4b400cbbe21f8e158cce84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ed33cc24c4b400cbbe21f8e158cce84" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43915 } }
I20260807 04:21:45.117565 31353 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ed33cc24c4b400cbbe21f8e158cce84 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:21:45.117719 31353 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ed33cc24c4b400cbbe21f8e158cce84 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:21:45.117888 31353 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ed33cc24c4b400cbbe21f8e158cce84 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:45.120548 31353 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ed33cc24c4b400cbbe21f8e158cce84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ed33cc24c4b400cbbe21f8e158cce84" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43915 } }
I20260807 04:21:45.121117 31353 leader_election.cc:302] T 00000000000000000000000000000000 P 4ed33cc24c4b400cbbe21f8e158cce84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ed33cc24c4b400cbbe21f8e158cce84; no voters:
I20260807 04:21:45.121784 31353 leader_election.cc:288] T 00000000000000000000000000000000 P 4ed33cc24c4b400cbbe21f8e158cce84 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:21:45.121914 31363 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ed33cc24c4b400cbbe21f8e158cce84 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:21:45.122668 31363 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ed33cc24c4b400cbbe21f8e158cce84 [term 1 LEADER]: Becoming Leader. State: Replica: 4ed33cc24c4b400cbbe21f8e158cce84, State: Running, Role: LEADER
I20260807 04:21:45.123256 31363 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ed33cc24c4b400cbbe21f8e158cce84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ed33cc24c4b400cbbe21f8e158cce84" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43915 } }
I20260807 04:21:45.124029 31353 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ed33cc24c4b400cbbe21f8e158cce84 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:21:45.126118 31365 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ed33cc24c4b400cbbe21f8e158cce84 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ed33cc24c4b400cbbe21f8e158cce84. Latest consensus state: current_term: 1 leader_uuid: "4ed33cc24c4b400cbbe21f8e158cce84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ed33cc24c4b400cbbe21f8e158cce84" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43915 } } }
I20260807 04:21:45.126580 31365 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ed33cc24c4b400cbbe21f8e158cce84 [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:45.127511 31364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ed33cc24c4b400cbbe21f8e158cce84 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ed33cc24c4b400cbbe21f8e158cce84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ed33cc24c4b400cbbe21f8e158cce84" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43915 } } }
I20260807 04:21:45.127791 31364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ed33cc24c4b400cbbe21f8e158cce84 [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:45.129616 31373 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:21:45.134668 31373 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:21:45.145072 31373 catalog_manager.cc:1347] Generated new cluster ID: b061b709646f4ec19ed828434866a1c5
I20260807 04:21:45.145237 31373 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:21:45.163988 31373 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:21:45.164498 31373 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:21:45.173961 31373 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ed33cc24c4b400cbbe21f8e158cce84: Generated new TSK 0
I20260807 04:21:45.174873 31373 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:21:45.189242 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 31279
W20260807 04:21:45.190451 31348 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:50793
W20260807 04:21:45.191279 7971 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 31279: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 04:21:45.191442 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 31279
2026-08-07T04:21:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2203 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:21:45 dist-test-slave-qg60 krb5kdc[31386](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:21:45 dist-test-slave-qg60 krb5kdc[31386](info): set up 2 sockets
Aug 07 04:21:45 dist-test-slave-qg60 krb5kdc[31386](info): commencing operation
krb5kdc: starting...
W20260807 04:21:46.470067 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.241s user 0.002s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:21:46 dist-test-slave-qg60 krb5kdc[31386](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076506, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:21:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:21:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
I20260807 04:21:46.822069 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:45885
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:46205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:45885
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:21:47.173966 31400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:47.174260 31400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:47.174435 31400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:47.181807 31400 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:21:47.181962 31400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:47.182055 31400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:47.182170 31400 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:21:47.182248 31400 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:21:47.192392 31400 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:46205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:45885
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:45885
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:47.193789 31400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:47.195154 31400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:47.207638 31408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:47.207701 31406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:47.207715 31405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:47.208662 31400 server_base.cc:1034] running on GCE node
I20260807 04:21:47.209481 31400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:47.210970 31400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:47.212226 31400 hybrid_clock.cc:648] HybridClock initialized: now 1786076507212180 us; error 37 us; skew 500 ppm
I20260807 04:21:47.212592 31400 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:21:47 dist-test-slave-qg60 krb5kdc[31386](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076507, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:21:47.215873 31400 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:21:47.217576 31400 webserver.cc:460] Webserver started at http://127.7.200.254:41187/ using document root <none> and password file <none>
I20260807 04:21:47.218297 31400 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:47.218446 31400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:47.218763 31400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:47.221870 31400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "274d749cd3564f6d9e3ed387dac14f3f"
format_stamp: "Formatted at 2026-08-07 04:21:47 on dist-test-slave-qg60"
server_key: "acebd436f9f8f275b0632c197671e664"
server_key_iv: "4aeb195678d6d07e363cb45a294955b0"
server_key_version: "encryptionkey@0"
I20260807 04:21:47.222664 31400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "274d749cd3564f6d9e3ed387dac14f3f"
format_stamp: "Formatted at 2026-08-07 04:21:47 on dist-test-slave-qg60"
server_key: "acebd436f9f8f275b0632c197671e664"
server_key_iv: "4aeb195678d6d07e363cb45a294955b0"
server_key_version: "encryptionkey@0"
I20260807 04:21:47.227833 31400 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 04:21:47.231544 31416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:47.232894 31400 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 04:21:47.233104 31400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "274d749cd3564f6d9e3ed387dac14f3f"
format_stamp: "Formatted at 2026-08-07 04:21:47 on dist-test-slave-qg60"
server_key: "acebd436f9f8f275b0632c197671e664"
server_key_iv: "4aeb195678d6d07e363cb45a294955b0"
server_key_version: "encryptionkey@0"
I20260807 04:21:47.233305 31400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:47.260120 31400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:47.264621 31400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:47.264956 31400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:47.284992 31400 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:45885
I20260807 04:21:47.285040 31470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:45885 every 8 connection(s)
I20260807 04:21:47.286423 31400 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:21:47.290606 31471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:47.296257 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 31400
I20260807 04:21:47.296479 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:21:47.297122 7971 external_mini_cluster.cc:1428] Setting key 86c1fe1cd3d2d85f9a4906335c5bcc4e
I20260807 04:21:47.303460 31471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 274d749cd3564f6d9e3ed387dac14f3f: Bootstrap starting.
I20260807 04:21:47.307519 31471 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 274d749cd3564f6d9e3ed387dac14f3f: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:47.308853 31471 log.cc:824] T 00000000000000000000000000000000 P 274d749cd3564f6d9e3ed387dac14f3f: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:47.312644 31471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 274d749cd3564f6d9e3ed387dac14f3f: No bootstrap required, opened a new log
Aug 07 04:21:47 dist-test-slave-qg60 krb5kdc[31386](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076506, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:21:47.321523 31471 raft_consensus.cc:348] T 00000000000000000000000000000000 P 274d749cd3564f6d9e3ed387dac14f3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "274d749cd3564f6d9e3ed387dac14f3f" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 45885 } }
I20260807 04:21:47.321908 31474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:47.299106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47811 (local address 127.7.200.254:45885)
0807 04:21:47.299971 (+ 865us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:47.299982 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:47.300023 (+ 41us) server_negotiation.cc:407] Connection header received
0807 04:21:47.301866 (+ 1843us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:47.301889 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:47.302283 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:47.302603 (+ 320us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:47.304642 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:47.306046 (+ 1404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:47.308060 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:47.308812 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:47.308957 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:47.314213 (+ 5256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:47.314220 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:47.314237 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:47.314280 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:47.317663 (+ 3383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:47.318402 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:47.318409 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:47.318415 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:47.318599 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:47.319035 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:47.319041 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:47.319044 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:47.319599 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:47.319916 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:47.320387 (+ 471us) server_negotiation.cc:299] Negotiation successful
0807 04:21:47.320883 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":647,"thread_start_us":426,"threads_started":1}
I20260807 04:21:47.322093 31471 raft_consensus.cc:374] T 00000000000000000000000000000000 P 274d749cd3564f6d9e3ed387dac14f3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:47.322234 31471 raft_consensus.cc:729] T 00000000000000000000000000000000 P 274d749cd3564f6d9e3ed387dac14f3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 274d749cd3564f6d9e3ed387dac14f3f, State: Initialized, Role: FOLLOWER
I20260807 04:21:47.322954 31471 consensus_queue.cc:260] T 00000000000000000000000000000000 P 274d749cd3564f6d9e3ed387dac14f3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "274d749cd3564f6d9e3ed387dac14f3f" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 45885 } }
I20260807 04:21:47.323256 31471 raft_consensus.cc:388] T 00000000000000000000000000000000 P 274d749cd3564f6d9e3ed387dac14f3f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:21:47.323428 31471 raft_consensus.cc:482] T 00000000000000000000000000000000 P 274d749cd3564f6d9e3ed387dac14f3f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:21:47.323632 31471 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 274d749cd3564f6d9e3ed387dac14f3f [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:47.326023 7971 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 04:21:47.326807 31471 raft_consensus.cc:504] T 00000000000000000000000000000000 P 274d749cd3564f6d9e3ed387dac14f3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "274d749cd3564f6d9e3ed387dac14f3f" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 45885 } }
I20260807 04:21:47.327365 31471 leader_election.cc:302] T 00000000000000000000000000000000 P 274d749cd3564f6d9e3ed387dac14f3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 274d749cd3564f6d9e3ed387dac14f3f; no voters:
I20260807 04:21:47.328118 31471 leader_election.cc:288] T 00000000000000000000000000000000 P 274d749cd3564f6d9e3ed387dac14f3f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:21:47.328230 31476 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 274d749cd3564f6d9e3ed387dac14f3f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:21:47.330041 31476 raft_consensus.cc:686] T 00000000000000000000000000000000 P 274d749cd3564f6d9e3ed387dac14f3f [term 1 LEADER]: Becoming Leader. State: Replica: 274d749cd3564f6d9e3ed387dac14f3f, State: Running, Role: LEADER
I20260807 04:21:47.330777 31476 consensus_queue.cc:237] T 00000000000000000000000000000000 P 274d749cd3564f6d9e3ed387dac14f3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "274d749cd3564f6d9e3ed387dac14f3f" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 45885 } }
I20260807 04:21:47.331082 31471 sys_catalog.cc:564] T 00000000000000000000000000000000 P 274d749cd3564f6d9e3ed387dac14f3f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:21:47.334106 31479 sys_catalog.cc:455] T 00000000000000000000000000000000 P 274d749cd3564f6d9e3ed387dac14f3f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 274d749cd3564f6d9e3ed387dac14f3f. Latest consensus state: current_term: 1 leader_uuid: "274d749cd3564f6d9e3ed387dac14f3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "274d749cd3564f6d9e3ed387dac14f3f" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 45885 } } }
I20260807 04:21:47.334177 31478 sys_catalog.cc:455] T 00000000000000000000000000000000 P 274d749cd3564f6d9e3ed387dac14f3f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "274d749cd3564f6d9e3ed387dac14f3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "274d749cd3564f6d9e3ed387dac14f3f" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 45885 } } }
I20260807 04:21:47.334620 31479 sys_catalog.cc:458] T 00000000000000000000000000000000 P 274d749cd3564f6d9e3ed387dac14f3f [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:47.334630 31478 sys_catalog.cc:458] T 00000000000000000000000000000000 P 274d749cd3564f6d9e3ed387dac14f3f [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:47.340368 31487 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:21:47.347710 31487 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:21:47.359529 31474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:47.339603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43271 (local address 127.7.200.254:45885)
0807 04:21:47.339851 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:47.339860 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:47.341349 (+ 1489us) server_negotiation.cc:407] Connection header received
0807 04:21:47.341568 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:47.341573 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:47.341653 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:47.341781 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:47.343441 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:47.344627 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:47.346556 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:47.347295 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:47.347434 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:47.351011 (+ 3577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:47.351019 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:47.351024 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:47.351066 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:47.355435 (+ 4369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:47.356381 (+ 946us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:47.356387 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:47.356391 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:47.356556 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:47.357087 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:47.357097 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:47.357101 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:47.357516 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:47.357776 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:47.358937 (+ 1161us) server_negotiation.cc:299] Negotiation successful
0807 04:21:47.359154 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 04:21:47.370993 31487 catalog_manager.cc:1347] Generated new cluster ID: 3805b432a102412e8ddf61aeb9a20506
I20260807 04:21:47.371141 31487 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:21:47.400364 31487 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:21:47.402176 31487 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:21:47.408777 31487 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 274d749cd3564f6d9e3ed387dac14f3f: Generated new TSK 0
I20260807 04:21:47.409605 31487 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:21:47.417723 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 31400
I20260807 04:21:47.419284 31466 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:21:47.517751 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 31400
2026-08-07T04:21:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2328 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:21:47 dist-test-slave-qg60 krb5kdc[31505](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:21:47 dist-test-slave-qg60 krb5kdc[31505](info): set up 2 sockets
Aug 07 04:21:47 dist-test-slave-qg60 krb5kdc[31505](info): commencing operation
krb5kdc: starting...
W20260807 04:21:48.728108 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.001s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:21:48 dist-test-slave-qg60 krb5kdc[31505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:21:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:21:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
I20260807 04:21:49.093631 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:44927
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:41551
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:44927
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:21:49.443750 31519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:49.444056 31519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:49.444223 31519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:49.451781 31519 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:21:49.451910 31519 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:49.452025 31519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:49.452128 31519 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:21:49.452208 31519 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:21:49.462466 31519 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:41551
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:44927
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:44927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:49.463814 31519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:49.465114 31519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:49.477327 31524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:49.477401 31528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:49.477362 31526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:49.478138 31519 server_base.cc:1034] running on GCE node
I20260807 04:21:49.478942 31519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:49.480420 31519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:49.481657 31519 hybrid_clock.cc:648] HybridClock initialized: now 1786076509481614 us; error 70 us; skew 500 ppm
I20260807 04:21:49.482012 31519 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:21:49 dist-test-slave-qg60 krb5kdc[31505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076509, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:21:49.489976 31519 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:21:49.491644 31519 webserver.cc:460] Webserver started at http://127.7.200.254:34013/ using document root <none> and password file <none>
I20260807 04:21:49.492345 31519 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:49.492496 31519 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:49.492883 31519 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:49.496347 31519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "19f8c3af2204460992f59f1c08bd48c8"
format_stamp: "Formatted at 2026-08-07 04:21:49 on dist-test-slave-qg60"
server_key: "2b96c060676d5e92135f6503ada2a5d2"
server_key_iv: "115a80c3f1bc0e4dd3d782da4c1cb05a"
server_key_version: "encryptionkey@0"
I20260807 04:21:49.497362 31519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "19f8c3af2204460992f59f1c08bd48c8"
format_stamp: "Formatted at 2026-08-07 04:21:49 on dist-test-slave-qg60"
server_key: "2b96c060676d5e92135f6503ada2a5d2"
server_key_iv: "115a80c3f1bc0e4dd3d782da4c1cb05a"
server_key_version: "encryptionkey@0"
I20260807 04:21:49.503625 31519 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260807 04:21:49.507390 31537 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:49.508951 31519 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 04:21:49.509159 31519 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "19f8c3af2204460992f59f1c08bd48c8"
format_stamp: "Formatted at 2026-08-07 04:21:49 on dist-test-slave-qg60"
server_key: "2b96c060676d5e92135f6503ada2a5d2"
server_key_iv: "115a80c3f1bc0e4dd3d782da4c1cb05a"
server_key_version: "encryptionkey@0"
I20260807 04:21:49.509382 31519 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:49.543079 31519 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:49.548033 31519 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:49.548388 31519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:49.569399 31519 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:44927
I20260807 04:21:49.569433 31590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:44927 every 8 connection(s)
I20260807 04:21:49.570868 31519 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:21:49.574816 31591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:49.577867 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 31519
I20260807 04:21:49.578064 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:21:49.578621 7971 external_mini_cluster.cc:1428] Setting key 01bcea4a4d4774b839754f2987888ff8
I20260807 04:21:49.587590 31591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19f8c3af2204460992f59f1c08bd48c8: Bootstrap starting.
I20260807 04:21:49.591480 31591 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 19f8c3af2204460992f59f1c08bd48c8: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:49.592864 31591 log.cc:824] T 00000000000000000000000000000000 P 19f8c3af2204460992f59f1c08bd48c8: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:49.593986 31595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:49.580677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38645 (local address 127.7.200.254:44927)
0807 04:21:49.581678 (+ 1001us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:49.581690 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:49.581735 (+ 45us) server_negotiation.cc:407] Connection header received
0807 04:21:49.583584 (+ 1849us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:49.583607 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:49.584060 (+ 453us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:49.584402 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:49.585216 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:49.586581 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:49.588494 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:49.589426 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:49.589584 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:49.591029 (+ 1445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:49.591039 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:49.591054 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:49.591715 (+ 661us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:49.591813 (+ 98us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:49.591842 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:49.591953 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:49.592195 (+ 242us) server_negotiation.cc:299] Negotiation successful
0807 04:21:49.592477 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":778,"thread_start_us":462,"threads_started":1}
I20260807 04:21:49.595938 31591 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19f8c3af2204460992f59f1c08bd48c8: No bootstrap required, opened a new log
I20260807 04:21:49.597900 7971 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 04:21:49.604646 31591 raft_consensus.cc:348] T 00000000000000000000000000000000 P 19f8c3af2204460992f59f1c08bd48c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19f8c3af2204460992f59f1c08bd48c8" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44927 } }
I20260807 04:21:49.605223 31591 raft_consensus.cc:374] T 00000000000000000000000000000000 P 19f8c3af2204460992f59f1c08bd48c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:49.605356 31591 raft_consensus.cc:729] T 00000000000000000000000000000000 P 19f8c3af2204460992f59f1c08bd48c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19f8c3af2204460992f59f1c08bd48c8, State: Initialized, Role: FOLLOWER
I20260807 04:21:49.605991 31591 consensus_queue.cc:260] T 00000000000000000000000000000000 P 19f8c3af2204460992f59f1c08bd48c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19f8c3af2204460992f59f1c08bd48c8" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44927 } }
I20260807 04:21:49.606248 31591 raft_consensus.cc:388] T 00000000000000000000000000000000 P 19f8c3af2204460992f59f1c08bd48c8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:21:49.606426 31591 raft_consensus.cc:482] T 00000000000000000000000000000000 P 19f8c3af2204460992f59f1c08bd48c8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:21:49.606616 31591 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 19f8c3af2204460992f59f1c08bd48c8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:49.610189 31595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:49.602539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46755 (local address 127.7.200.254:44927)
0807 04:21:49.602751 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:49.602758 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:49.603249 (+ 491us) server_negotiation.cc:407] Connection header received
0807 04:21:49.603432 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:49.603438 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:49.603531 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:49.603642 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:49.604159 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:49.605248 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:49.607076 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:49.608013 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:49.608182 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:49.609341 (+ 1159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:49.609348 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:49.609353 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:49.609380 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:49.609434 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:49.609469 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:49.609576 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:49.609728 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 04:21:49.609829 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 04:21:49.610548 31591 raft_consensus.cc:504] T 00000000000000000000000000000000 P 19f8c3af2204460992f59f1c08bd48c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19f8c3af2204460992f59f1c08bd48c8" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44927 } }
I20260807 04:21:49.611167 31591 leader_election.cc:302] T 00000000000000000000000000000000 P 19f8c3af2204460992f59f1c08bd48c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 19f8c3af2204460992f59f1c08bd48c8; no voters:
I20260807 04:21:49.611910 31591 leader_election.cc:288] T 00000000000000000000000000000000 P 19f8c3af2204460992f59f1c08bd48c8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:21:49.612071 31602 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 19f8c3af2204460992f59f1c08bd48c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:21:49.614509 31591 sys_catalog.cc:564] T 00000000000000000000000000000000 P 19f8c3af2204460992f59f1c08bd48c8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:21:49.619249 31602 raft_consensus.cc:686] T 00000000000000000000000000000000 P 19f8c3af2204460992f59f1c08bd48c8 [term 1 LEADER]: Becoming Leader. State: Replica: 19f8c3af2204460992f59f1c08bd48c8, State: Running, Role: LEADER
I20260807 04:21:49.619990 31602 consensus_queue.cc:237] T 00000000000000000000000000000000 P 19f8c3af2204460992f59f1c08bd48c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19f8c3af2204460992f59f1c08bd48c8" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44927 } }
I20260807 04:21:49.623183 31604 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19f8c3af2204460992f59f1c08bd48c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19f8c3af2204460992f59f1c08bd48c8. Latest consensus state: current_term: 1 leader_uuid: "19f8c3af2204460992f59f1c08bd48c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19f8c3af2204460992f59f1c08bd48c8" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44927 } } }
I20260807 04:21:49.623550 31604 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19f8c3af2204460992f59f1c08bd48c8 [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:49.624078 31603 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19f8c3af2204460992f59f1c08bd48c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "19f8c3af2204460992f59f1c08bd48c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19f8c3af2204460992f59f1c08bd48c8" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 44927 } } }
I20260807 04:21:49.624420 31603 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19f8c3af2204460992f59f1c08bd48c8 [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:49.625368 31619 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:21:49.630417 31619 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:21:49.639684 31619 catalog_manager.cc:1347] Generated new cluster ID: 90b8f05fb0574be08707a7f23f45647b
I20260807 04:21:49.639818 31619 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:21:49.659322 31619 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:21:49.660974 31619 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:21:49.669844 31619 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 19f8c3af2204460992f59f1c08bd48c8: Generated new TSK 0
I20260807 04:21:49.670984 31619 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:21:49.680966 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 31519
W20260807 04:21:49.682222 31586 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:38645
W20260807 04:21:49.683032 7971 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 31519: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 04:21:49.683197 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 31519
2026-08-07T04:21:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2164 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:21:49 dist-test-slave-qg60 krb5kdc[31626](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:21:49 dist-test-slave-qg60 krb5kdc[31626](info): set up 2 sockets
Aug 07 04:21:49 dist-test-slave-qg60 krb5kdc[31626](info): commencing operation
krb5kdc: starting...
W20260807 04:21:50.893360 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.002s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:21:51 dist-test-slave-qg60 krb5kdc[31626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076511, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:21:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:21:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
I20260807 04:21:51.240221 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:46031
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:34147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:46031
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:21:51.590808 31639 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:51.591171 31639 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:51.591353 31639 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:51.598582 31639 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:21:51.598742 31639 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:51.598850 31639 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:51.598965 31639 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:21:51.599054 31639 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:21:51.609413 31639 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:34147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:46031
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:46031
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:51.610777 31639 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:51.612131 31639 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:51.624353 31644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:51.624267 31648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:51.624310 31645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:51.625226 31639 server_base.cc:1034] running on GCE node
I20260807 04:21:51.626017 31639 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:51.627432 31639 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:51.628677 31639 hybrid_clock.cc:648] HybridClock initialized: now 1786076511628639 us; error 68 us; skew 500 ppm
I20260807 04:21:51.629074 31639 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:21:51 dist-test-slave-qg60 krb5kdc[31626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076511, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:21:51.632390 31639 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:21:51.634033 31639 webserver.cc:460] Webserver started at http://127.7.200.254:35843/ using document root <none> and password file <none>
I20260807 04:21:51.634662 31639 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:51.634764 31639 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:51.635046 31639 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:51.638087 31639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "10bc203ba30846e6b1f63fa1d2850b3e"
format_stamp: "Formatted at 2026-08-07 04:21:51 on dist-test-slave-qg60"
server_key: "8924422d95a6c9fcbdeaafaef27b6629"
server_key_iv: "e3cc58967d1be6fda1fb157b829d302e"
server_key_version: "encryptionkey@0"
I20260807 04:21:51.638818 31639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "10bc203ba30846e6b1f63fa1d2850b3e"
format_stamp: "Formatted at 2026-08-07 04:21:51 on dist-test-slave-qg60"
server_key: "8924422d95a6c9fcbdeaafaef27b6629"
server_key_iv: "e3cc58967d1be6fda1fb157b829d302e"
server_key_version: "encryptionkey@0"
I20260807 04:21:51.644203 31639 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260807 04:21:51.647761 31655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:51.649224 31639 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 04:21:51.649416 31639 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "10bc203ba30846e6b1f63fa1d2850b3e"
format_stamp: "Formatted at 2026-08-07 04:21:51 on dist-test-slave-qg60"
server_key: "8924422d95a6c9fcbdeaafaef27b6629"
server_key_iv: "e3cc58967d1be6fda1fb157b829d302e"
server_key_version: "encryptionkey@0"
I20260807 04:21:51.649621 31639 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:51.655616 31639 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:51.660182 31639 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:51.660522 31639 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:51.680390 31639 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:46031
I20260807 04:21:51.680431 31708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:46031 every 8 connection(s)
I20260807 04:21:51.681916 31639 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:21:51.684775 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 31639
I20260807 04:21:51.684967 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:21:51.685427 7971 external_mini_cluster.cc:1428] Setting key a30e6807bf8ce3d697c08584d8514c03
I20260807 04:21:51.685876 31709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:51.693917 31712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:51.687259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59165 (local address 127.7.200.254:46031)
0807 04:21:51.688048 (+ 789us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:51.688059 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:51.688101 (+ 42us) server_negotiation.cc:407] Connection header received
0807 04:21:51.690428 (+ 2327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:51.690449 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:51.690789 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:51.691123 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:51.692267 (+ 1144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:51.692274 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:51.692290 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:51.692303 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:51.692363 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:51.692391 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:51.692568 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:51.692717 (+ 149us) server_negotiation.cc:299] Negotiation successful
0807 04:21:51.693008 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":355,"threads_started":1}
I20260807 04:21:51.697814 7971 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 04:21:51.699465 31709 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10bc203ba30846e6b1f63fa1d2850b3e: Bootstrap starting.
I20260807 04:21:51.702973 31709 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10bc203ba30846e6b1f63fa1d2850b3e: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:51.704206 31709 log.cc:824] T 00000000000000000000000000000000 P 10bc203ba30846e6b1f63fa1d2850b3e: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:51.705363 31712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:51.702423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55545 (local address 127.7.200.254:46031)
0807 04:21:51.702636 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:51.702645 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:51.703016 (+ 371us) server_negotiation.cc:407] Connection header received
0807 04:21:51.703232 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:51.703240 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:51.703298 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:51.703422 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:51.704445 (+ 1023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:51.704452 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:51.704457 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 04:21:51.704475 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:51.704519 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 04:21:51.704551 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:51.704690 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:51.704974 (+ 284us) server_negotiation.cc:299] Negotiation successful
0807 04:21:51.705045 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 04:21:51.707399 31709 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10bc203ba30846e6b1f63fa1d2850b3e: No bootstrap required, opened a new log
I20260807 04:21:51.714993 31709 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10bc203ba30846e6b1f63fa1d2850b3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10bc203ba30846e6b1f63fa1d2850b3e" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 46031 } }
I20260807 04:21:51.715415 31709 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10bc203ba30846e6b1f63fa1d2850b3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 04:21:51.715540 31709 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10bc203ba30846e6b1f63fa1d2850b3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10bc203ba30846e6b1f63fa1d2850b3e, State: Initialized, Role: FOLLOWER
I20260807 04:21:51.716192 31709 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10bc203ba30846e6b1f63fa1d2850b3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10bc203ba30846e6b1f63fa1d2850b3e" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 46031 } }
I20260807 04:21:51.716434 31709 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10bc203ba30846e6b1f63fa1d2850b3e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 04:21:51.716611 31709 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10bc203ba30846e6b1f63fa1d2850b3e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 04:21:51.716831 31709 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10bc203ba30846e6b1f63fa1d2850b3e [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:51.719198 31709 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10bc203ba30846e6b1f63fa1d2850b3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10bc203ba30846e6b1f63fa1d2850b3e" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 46031 } }
I20260807 04:21:51.719755 31709 leader_election.cc:302] T 00000000000000000000000000000000 P 10bc203ba30846e6b1f63fa1d2850b3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10bc203ba30846e6b1f63fa1d2850b3e; no voters:
I20260807 04:21:51.720392 31709 leader_election.cc:288] T 00000000000000000000000000000000 P 10bc203ba30846e6b1f63fa1d2850b3e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 04:21:51.720543 31719 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10bc203ba30846e6b1f63fa1d2850b3e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:21:51.721271 31719 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10bc203ba30846e6b1f63fa1d2850b3e [term 1 LEADER]: Becoming Leader. State: Replica: 10bc203ba30846e6b1f63fa1d2850b3e, State: Running, Role: LEADER
I20260807 04:21:51.721884 31719 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10bc203ba30846e6b1f63fa1d2850b3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10bc203ba30846e6b1f63fa1d2850b3e" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 46031 } }
I20260807 04:21:51.722738 31709 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10bc203ba30846e6b1f63fa1d2850b3e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:21:51.724946 31721 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10bc203ba30846e6b1f63fa1d2850b3e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10bc203ba30846e6b1f63fa1d2850b3e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10bc203ba30846e6b1f63fa1d2850b3e" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 46031 } } }
I20260807 04:21:51.725428 31721 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10bc203ba30846e6b1f63fa1d2850b3e [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:51.725440 31722 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10bc203ba30846e6b1f63fa1d2850b3e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10bc203ba30846e6b1f63fa1d2850b3e. Latest consensus state: current_term: 1 leader_uuid: "10bc203ba30846e6b1f63fa1d2850b3e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10bc203ba30846e6b1f63fa1d2850b3e" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 46031 } } }
I20260807 04:21:51.725944 31722 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10bc203ba30846e6b1f63fa1d2850b3e [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:51.727615 31727 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:21:51.732901 31727 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:21:51.742573 31727 catalog_manager.cc:1347] Generated new cluster ID: 664ecfebec1d4128ae35a6c563ab726d
I20260807 04:21:51.742729 31727 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:21:51.779078 31727 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:21:51.779583 31727 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:21:51.796525 31727 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10bc203ba30846e6b1f63fa1d2850b3e: Generated new TSK 0
I20260807 04:21:51.797499 31727 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:21:51.811463 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 31639
W20260807 04:21:51.812659 31704 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:59165
W20260807 04:21:51.813540 7971 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 31639: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 04:21:51.813700 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 31639
2026-08-07T04:21:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2131 ms)
[----------] 18 tests from AuthTokenIssuingTest (39042 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:21:51 dist-test-slave-qg60 krb5kdc[31742](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:21:51 dist-test-slave-qg60 krb5kdc[31742](info): set up 2 sockets
Aug 07 04:21:51 dist-test-slave-qg60 krb5kdc[31742](info): commencing operation
krb5kdc: starting...
W20260807 04:21:53.014184 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.001s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:21:53 dist-test-slave-qg60 krb5kdc[31742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076513, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:21:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:21:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
I20260807 04:21:53.384387 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:34459
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:38139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:34459,127.7.200.253:42235,127.7.200.252:38289
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:21:53.741343 31756 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 04:21:53.741721 31756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:53.741854 31756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:53.741981 31756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:53.749787 31756 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:21:53.749892 31756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:53.749993 31756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:53.750072 31756 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:21:53.750164 31756 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:21:53.760506 31756 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:38139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:34459,127.7.200.253:42235,127.7.200.252:38289
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:34459
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:53.761941 31756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:53.763366 31756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:53.775717 31763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:53.775646 31764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:53.775694 31766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:53.776706 31756 server_base.cc:1034] running on GCE node
I20260807 04:21:53.777558 31756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:53.778981 31756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:53.780242 31756 hybrid_clock.cc:648] HybridClock initialized: now 1786076513780179 us; error 42 us; skew 500 ppm
I20260807 04:21:53.780623 31756 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:21:53 dist-test-slave-qg60 krb5kdc[31742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076513, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:21:53.783947 31756 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:21:53.785548 31756 webserver.cc:460] Webserver started at http://127.7.200.254:44737/ using document root <none> and password file <none>
I20260807 04:21:53.786262 31756 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:53.786394 31756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:53.786732 31756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:53.789918 31756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "c563a282e0ec41ee93650e614be23708"
format_stamp: "Formatted at 2026-08-07 04:21:53 on dist-test-slave-qg60"
server_key: "b25f525fb226a8cbe0dce42b860e7da9"
server_key_iv: "85bd18255811e690ae559c48daf6cf8c"
server_key_version: "encryptionkey@0"
I20260807 04:21:53.790762 31756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "c563a282e0ec41ee93650e614be23708"
format_stamp: "Formatted at 2026-08-07 04:21:53 on dist-test-slave-qg60"
server_key: "b25f525fb226a8cbe0dce42b860e7da9"
server_key_iv: "85bd18255811e690ae559c48daf6cf8c"
server_key_version: "encryptionkey@0"
I20260807 04:21:53.796141 31756 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 04:21:53.799742 31773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:53.801218 31756 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:21:53.801415 31756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "c563a282e0ec41ee93650e614be23708"
format_stamp: "Formatted at 2026-08-07 04:21:53 on dist-test-slave-qg60"
server_key: "b25f525fb226a8cbe0dce42b860e7da9"
server_key_iv: "85bd18255811e690ae559c48daf6cf8c"
server_key_version: "encryptionkey@0"
I20260807 04:21:53.801661 31756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:53.829619 31756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:53.833920 31756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:53.834216 31756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:53.854319 31756 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:34459
I20260807 04:21:53.854343 31827 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:34459 every 8 connection(s)
I20260807 04:21:53.855751 31756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:21:53.859722 31829 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:53.859814 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 31756
I20260807 04:21:53.860121 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:21:53.860814 7971 external_mini_cluster.cc:1428] Setting key 98757875980c82e1caf6ce01ac245783
I20260807 04:21:53.866639 31829 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.254" port: 34459 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 04:21:53 dist-test-slave-qg60 krb5kdc[31742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076513, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:21:53.889328 31831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:53.869987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:34459 (local address 127.0.0.1:33640)
0807 04:21:53.870859 (+ 872us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:53.870920 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:53.873020 (+ 2100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:53.873862 (+ 842us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:53.873869 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:53.874609 (+ 740us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:21:53.874940 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:53.874958 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:53.876512 (+ 1554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:53.876519 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:53.877628 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:53.877640 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:53.878557 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:53.878564 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:53.878744 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:53.879490 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:21:53.879513 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:21:53.881975 (+ 2462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:21:53.885118 (+ 3143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:53.885132 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:53.885143 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:53.885516 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:53.886008 (+ 492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:53.886011 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:53.886014 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:53.886167 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:53.886924 (+ 757us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:21:53.886932 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:21:53.887140 (+ 208us) client_negotiation.cc:769] Sending connection context
0807 04:21:53.887371 (+ 231us) client_negotiation.cc:240] Negotiation successful
0807 04:21:53.887978 (+ 607us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":605,"mutex_wait_us":149,"thread_start_us":380,"threads_started":1}
I20260807 04:21:53.889359 31832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:53.869987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33640 (local address 127.7.200.254:34459)
0807 04:21:53.871710 (+ 1723us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:53.871723 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:53.871773 (+ 50us) server_negotiation.cc:407] Connection header received
0807 04:21:53.873396 (+ 1623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:53.873402 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:53.873633 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:53.873840 (+ 207us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:53.875150 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:53.876360 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:53.877761 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:53.878314 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:53.878515 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:53.882190 (+ 3675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:53.882198 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:53.882209 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:53.882236 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:53.885003 (+ 2767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:53.885689 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:53.885695 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:53.885697 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:53.885829 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:53.886283 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:53.886292 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:53.886294 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:53.886780 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:53.886993 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:53.887515 (+ 522us) server_negotiation.cc:299] Negotiation successful
0807 04:21:53.887817 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1499,"thread_start_us":1248,"threads_started":1}
I20260807 04:21:53.892692 31829 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.253" port: 42235 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.7.200.253@KRBTEST.COM; defaulting to no policy
I20260807 04:21:53.893834 31831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:53.893434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:42235 (local address 127.0.0.1:41884)
0807 04:21:53.893595 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:53.893708 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.253:42235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 04:21:53.894073 31777 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.200.253:42235: connect: Connection refused (error 111)
I20260807 04:21:53.895625 31831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:53.895249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:42235 (local address 127.0.0.1:41896)
0807 04:21:53.895430 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:53.895499 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.253:42235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 04:21:53.895836 31829 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.253:42235: Network error: Client connection negotiation failed: client connection to 127.7.200.253:42235: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.253.keytab.
Entry for principal kudu/127.7.200.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.253.keytab.
I20260807 04:21:53.937610 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.253:42235
--webserver_interface=127.7.200.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.253.keytab
--principal=kudu/127.7.200.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:38139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:34459,127.7.200.253:42235,127.7.200.252:38289
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 04:21:53.945254 31829 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.253" port: 42235 } attempt: 1
I20260807 04:21:53.946606 31831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:53.946074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:42235 (local address 127.0.0.1:41908)
0807 04:21:53.946308 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:53.946454 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.253:42235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260807 04:21:53.947744 31831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:53.947352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:42235 (local address 127.0.0.1:41920)
0807 04:21:53.947518 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:53.947603 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.253:42235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 04:21:53.947945 31829 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.253:42235: Network error: Client connection negotiation failed: client connection to 127.7.200.253:42235: connect: Connection refused (error 111)
I20260807 04:21:54.016219 31829 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.253" port: 42235 } attempt: 2
I20260807 04:21:54.017551 31831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.017051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:42235 (local address 127.0.0.1:41934)
0807 04:21:54.017292 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:54.017385 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.253:42235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260807 04:21:54.020164 31831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.019720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:42235 (local address 127.0.0.1:41950)
0807 04:21:54.019889 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:54.020003 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.253:42235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260807 04:21:54.020395 31829 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.253:42235: Network error: Client connection negotiation failed: client connection to 127.7.200.253:42235: connect: Connection refused (error 111)
I20260807 04:21:54.111644 31829 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.253" port: 42235 } attempt: 3
I20260807 04:21:54.112902 31831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.112379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:42235 (local address 127.0.0.1:41958)
0807 04:21:54.112591 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:54.112687 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.253:42235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260807 04:21:54.113911 31831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.113560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:42235 (local address 127.0.0.1:41970)
0807 04:21:54.113710 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:54.113783 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.253:42235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 04:21:54.114171 31829 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.253:42235: Network error: Client connection negotiation failed: client connection to 127.7.200.253:42235: connect: Connection refused (error 111)
I20260807 04:21:54.257432 31829 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.253" port: 42235 } attempt: 4
I20260807 04:21:54.258664 31831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.258116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:42235 (local address 127.0.0.1:41982)
0807 04:21:54.258438 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:54.258527 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.253:42235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143}
I20260807 04:21:54.259799 31831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.259408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:42235 (local address 127.0.0.1:41984)
0807 04:21:54.259593 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:54.259673 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.253:42235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260807 04:21:54.260006 31829 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.253:42235: Network error: Client connection negotiation failed: client connection to 127.7.200.253:42235: connect: Connection refused (error 111)
W20260807 04:21:54.291497 31836 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 04:21:54.291850 31836 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:54.291920 31836 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:54.292003 31836 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:54.299402 31836 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:21:54.299506 31836 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:54.299564 31836 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:54.299608 31836 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:21:54.299674 31836 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:21:54.310111 31836 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:38139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:34459,127.7.200.253:42235,127.7.200.252:38289
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.253.keytab
--principal=kudu/127.7.200.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.253:42235
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.200.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:54.311477 31836 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:54.312760 31836 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:54.324677 31844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:54.324707 31842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:54.324785 31841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:54.325701 31836 server_base.cc:1034] running on GCE node
I20260807 04:21:54.326462 31836 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:54.327791 31836 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:54.329005 31836 hybrid_clock.cc:648] HybridClock initialized: now 1786076514328964 us; error 51 us; skew 500 ppm
I20260807 04:21:54.329334 31836 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:21:54 dist-test-slave-qg60 krb5kdc[31742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076514, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:21:54.332595 31836 init.cc:377] Logged in from keytab as kudu/127.7.200.253@KRBTEST.COM (short username kudu)
I20260807 04:21:54.334036 31836 webserver.cc:460] Webserver started at http://127.7.200.253:41477/ using document root <none> and password file <none>
I20260807 04:21:54.334669 31836 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:54.334757 31836 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:54.335016 31836 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:54.337934 31836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-1/data/instance:
uuid: "8399150bd64943dfbcb26cc61e1c4852"
format_stamp: "Formatted at 2026-08-07 04:21:54 on dist-test-slave-qg60"
server_key: "be01a9e6296ee366da674125a7d90846"
server_key_iv: "920856f7d83905d76574e548d71fd0a8"
server_key_version: "encryptionkey@0"
I20260807 04:21:54.338675 31836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-1/wal/instance:
uuid: "8399150bd64943dfbcb26cc61e1c4852"
format_stamp: "Formatted at 2026-08-07 04:21:54 on dist-test-slave-qg60"
server_key: "be01a9e6296ee366da674125a7d90846"
server_key_iv: "920856f7d83905d76574e548d71fd0a8"
server_key_version: "encryptionkey@0"
I20260807 04:21:54.343752 31836 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260807 04:21:54.347180 31852 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:54.348471 31836 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 04:21:54.348651 31836 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-1/wal
uuid: "8399150bd64943dfbcb26cc61e1c4852"
format_stamp: "Formatted at 2026-08-07 04:21:54 on dist-test-slave-qg60"
server_key: "be01a9e6296ee366da674125a7d90846"
server_key_iv: "920856f7d83905d76574e548d71fd0a8"
server_key_version: "encryptionkey@0"
I20260807 04:21:54.348956 31836 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:54.376662 31836 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:54.381219 31836 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:54.381508 31836 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:54.400877 31836 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.253:42235
I20260807 04:21:54.400899 31907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.253:42235 every 8 connection(s)
I20260807 04:21:54.402245 31836 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-1/data/info.pb
I20260807 04:21:54.402894 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 31836
I20260807 04:21:54.403134 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-1/wal/instance
I20260807 04:21:54.403718 7971 external_mini_cluster.cc:1428] Setting key 942b83cc0344c94cf04d6b0f8df3226c
I20260807 04:21:54.406422 31908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:54.412966 31908 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.254" port: 34459 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 04:21:54 dist-test-slave-qg60 krb5kdc[31742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076514, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.253@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.7.200.252@KRBTEST.COM; defaulting to no policy
I20260807 04:21:54.437091 31910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.415508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33654 (local address 127.7.200.254:34459)
0807 04:21:54.419595 (+ 4087us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:54.419601 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:54.419625 (+ 24us) server_negotiation.cc:407] Connection header received
0807 04:21:54.421501 (+ 1876us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:54.421507 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:54.421606 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:54.421730 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:54.423655 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:54.424436 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:54.426061 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:54.426508 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:54.426645 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:54.430760 (+ 4115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:54.430765 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:54.430769 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:54.430807 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:54.433880 (+ 3073us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:54.434642 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:54.434646 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:54.434649 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:54.434771 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:54.435202 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:54.435207 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:54.435214 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:54.435510 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:54.435684 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:54.436439 (+ 755us) server_negotiation.cc:299] Negotiation successful
0807 04:21:54.436670 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3953,"thread_start_us":3791,"threads_started":1}
I20260807 04:21:54.438063 31911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.416254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:34459 (local address 127.0.0.1:33654)
0807 04:21:54.419279 (+ 3025us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:54.419340 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:54.421214 (+ 1874us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:54.421995 (+ 781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:54.422002 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:54.422765 (+ 763us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:21:54.423412 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:54.423430 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:54.424618 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:54.424622 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:54.425904 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:54.425917 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:54.426752 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:54.426759 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:54.427017 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:54.427800 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:21:54.427824 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:21:54.430522 (+ 2698us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:21:54.434037 (+ 3515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:54.434046 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:54.434063 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:54.434505 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:54.434882 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:54.434887 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:54.434891 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:54.435080 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:54.435640 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:21:54.435650 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:21:54.436058 (+ 408us) client_negotiation.cc:769] Sending connection context
0807 04:21:54.436326 (+ 268us) client_negotiation.cc:240] Negotiation successful
0807 04:21:54.436886 (+ 560us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2681,"thread_start_us":2393,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.252@KRBTEST.COM" created.
I20260807 04:21:54.440115 31908 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.253" port: 42235 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 04:21:54 dist-test-slave-qg60 krb5kdc[31742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076514, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.253@KRBTEST.COM for kudu/127.7.200.253@KRBTEST.COM
I20260807 04:21:54.456033 31911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.440901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:42235 (local address 127.0.0.1:41994)
0807 04:21:54.441158 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:54.441179 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:54.441298 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:54.442362 (+ 1064us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:54.442366 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:54.442814 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:21:54.442967 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:54.442976 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:54.444326 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:54.444331 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:54.445242 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:54.445253 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:54.446066 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:54.446071 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:54.446247 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:54.446924 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:21:54.446942 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:21:54.449452 (+ 2510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:21:54.453017 (+ 3565us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:54.453023 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:54.453026 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:54.453581 (+ 555us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:54.454148 (+ 567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:54.454153 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:54.454156 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:54.454342 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:54.454980 (+ 638us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:21:54.454985 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:21:54.455120 (+ 135us) client_negotiation.cc:769] Sending connection context
0807 04:21:54.455259 (+ 139us) client_negotiation.cc:240] Negotiation successful
0807 04:21:54.455554 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260807 04:21:54.456080 31913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.441242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41994 (local address 127.7.200.253:42235)
0807 04:21:54.441970 (+ 728us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:54.441975 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:54.442001 (+ 26us) server_negotiation.cc:407] Connection header received
0807 04:21:54.442047 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:54.442053 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:54.442219 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:54.442376 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:54.443145 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:54.444185 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:54.445394 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:54.445924 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:54.446057 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:54.449652 (+ 3595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:54.449666 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:54.449687 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:54.449715 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:54.452826 (+ 3111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:54.453709 (+ 883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:54.453737 (+ 28us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:54.453744 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:54.453985 (+ 241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:54.454482 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:54.454485 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:54.454487 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:54.454816 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:54.455053 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:54.455435 (+ 382us) server_negotiation.cc:299] Negotiation successful
0807 04:21:54.455679 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":425,"threads_started":1}
I20260807 04:21:54.458573 31908 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } has no permanent_uuid. Determining permanent_uuid...
I20260807 04:21:54.459827 31911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.459298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:38289 (local address 127.0.0.1:32812)
0807 04:21:54.459539 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:54.459676 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
W20260807 04:21:54.460173 31855 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
I20260807 04:21:54.461799 31911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.461443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:38289 (local address 127.0.0.1:32828)
0807 04:21:54.461606 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:54.461690 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260807 04:21:54.462148 31908 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.252:38289: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.252.keytab.
Entry for principal kudu/127.7.200.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.252.keytab.
I20260807 04:21:54.480957 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.252:38289
--webserver_interface=127.7.200.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.252.keytab
--principal=kudu/127.7.200.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:38139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:34459,127.7.200.253:42235,127.7.200.252:38289
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 04:21:54.511523 31908 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } attempt: 1
I20260807 04:21:54.513016 31911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.512468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:38289 (local address 127.0.0.1:32832)
0807 04:21:54.512693 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:54.512848 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260807 04:21:54.514019 31911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.513670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:38289 (local address 127.0.0.1:32836)
0807 04:21:54.513814 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:54.513911 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 04:21:54.514258 31908 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.252:38289: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
I20260807 04:21:54.559283 31829 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.253" port: 42235 } attempt: 5
Aug 07 04:21:54 dist-test-slave-qg60 krb5kdc[31742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076513, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for kudu/127.7.200.253@KRBTEST.COM
I20260807 04:21:54.580509 31831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.560042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:42235 (local address 127.0.0.1:42010)
0807 04:21:54.560293 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:54.560319 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:54.560490 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:54.560981 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:54.560987 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:54.561570 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:21:54.561837 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:54.561851 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:54.562893 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:54.562902 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:54.564426 (+ 1524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:54.564443 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:54.565317 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:54.565324 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:54.565576 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:54.571748 (+ 6172us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:21:54.571778 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:21:54.574442 (+ 2664us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:21:54.577867 (+ 3425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:54.577873 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:54.577878 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:54.578287 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:54.578693 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:54.578698 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:54.578702 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:54.578839 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:54.579470 (+ 631us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:21:54.579474 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:21:54.579637 (+ 163us) client_negotiation.cc:769] Sending connection context
0807 04:21:54.579810 (+ 173us) client_negotiation.cc:240] Negotiation successful
0807 04:21:54.580123 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82}
I20260807 04:21:54.580509 31913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.560175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42010 (local address 127.7.200.253:42235)
0807 04:21:54.560354 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:54.560359 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:54.560382 (+ 23us) server_negotiation.cc:407] Connection header received
0807 04:21:54.560666 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:54.560670 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:54.560806 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:54.560893 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:54.562013 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:54.562739 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:54.564603 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:54.565144 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:54.565279 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:54.574702 (+ 9423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:54.574708 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:54.574712 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:54.574750 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:54.577704 (+ 2954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:54.578437 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:54.578442 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:54.578445 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:54.578568 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:54.578956 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:54.578962 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:54.578966 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:54.579339 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:54.579493 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:54.579939 (+ 446us) server_negotiation.cc:299] Negotiation successful
0807 04:21:54.580189 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 04:21:54.581880 31829 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } has no permanent_uuid. Determining permanent_uuid...
I20260807 04:21:54.582468 31908 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } attempt: 2
I20260807 04:21:54.583230 31831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.582604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:38289 (local address 127.0.0.1:32850)
0807 04:21:54.582912 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:54.583029 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191}
I20260807 04:21:54.583339 31911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.582937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:38289 (local address 127.0.0.1:32858)
0807 04:21:54.583098 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:54.583179 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260807 04:21:54.584306 31831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.583912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:38289 (local address 127.0.0.1:32866)
0807 04:21:54.584062 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:54.584164 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260807 04:21:54.584415 31911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.584035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:38289 (local address 127.0.0.1:32874)
0807 04:21:54.584194 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:54.584272 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260807 04:21:54.584643 31829 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.252:38289: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
W20260807 04:21:54.584803 31908 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.252:38289: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
I20260807 04:21:54.635911 31829 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } attempt: 1
I20260807 04:21:54.637224 31831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.636690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:38289 (local address 127.0.0.1:32876)
0807 04:21:54.636945 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:54.637046 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260807 04:21:54.638375 31831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.638050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:38289 (local address 127.0.0.1:32886)
0807 04:21:54.638205 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:54.638272 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260807 04:21:54.638645 31829 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.252:38289: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
I20260807 04:21:54.676093 31908 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } attempt: 3
I20260807 04:21:54.678464 31911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.677390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:38289 (local address 127.0.0.1:32896)
0807 04:21:54.677816 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:54.678049 (+ 233us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260807 04:21:54.680909 31911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.679680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:38289 (local address 127.0.0.1:32902)
0807 04:21:54.680217 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:54.680462 (+ 245us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":249}
W20260807 04:21:54.681541 31908 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.252:38289: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
I20260807 04:21:54.706925 31829 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } attempt: 2
I20260807 04:21:54.709093 31831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.708156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:38289 (local address 127.0.0.1:32916)
0807 04:21:54.708522 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:54.708673 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
I20260807 04:21:54.710948 31831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.710357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:38289 (local address 127.0.0.1:32918)
0807 04:21:54.710610 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:54.710741 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260807 04:21:54.711289 31829 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.252:38289: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
I20260807 04:21:54.817612 31829 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } attempt: 3
I20260807 04:21:54.818866 31831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.818329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:38289 (local address 127.0.0.1:32932)
0807 04:21:54.818557 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:54.818659 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260807 04:21:54.820212 31831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.819686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:38289 (local address 127.0.0.1:32946)
0807 04:21:54.820010 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:54.820091 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
W20260807 04:21:54.820417 31829 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.252:38289: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
I20260807 04:21:54.824851 31908 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } attempt: 4
I20260807 04:21:54.826085 31911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.825598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:38289 (local address 127.0.0.1:32960)
0807 04:21:54.825821 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:54.825912 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260807 04:21:54.827162 31911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.826793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:38289 (local address 127.0.0.1:32970)
0807 04:21:54.826953 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:54.827050 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260807 04:21:54.827354 31908 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.252:38289: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
W20260807 04:21:54.903586 31916 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 04:21:54.904022 31916 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:54.904163 31916 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:54.904312 31916 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:54.912544 31916 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:21:54.912688 31916 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:54.912825 31916 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:54.912918 31916 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:21:54.913028 31916 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:21:54.923215 31916 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:38139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:34459,127.7.200.253:42235,127.7.200.252:38289
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.252.keytab
--principal=kudu/127.7.200.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.252:38289
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.200.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:54.924696 31916 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:54.926155 31916 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:54.938447 31923 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:54.938469 31926 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:54.938405 31924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:54.939729 31916 server_base.cc:1034] running on GCE node
I20260807 04:21:54.940521 31916 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:54.942008 31916 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:54.943302 31916 hybrid_clock.cc:648] HybridClock initialized: now 1786076514943204 us; error 39 us; skew 500 ppm
I20260807 04:21:54.943641 31916 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:21:54 dist-test-slave-qg60 krb5kdc[31742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076514, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:21:54.946933 31916 init.cc:377] Logged in from keytab as kudu/127.7.200.252@KRBTEST.COM (short username kudu)
I20260807 04:21:54.948472 31916 webserver.cc:460] Webserver started at http://127.7.200.252:41637/ using document root <none> and password file <none>
I20260807 04:21:54.949236 31916 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:54.949368 31916 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:54.949694 31916 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:54.952898 31916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-2/data/instance:
uuid: "156a2fd4717040c89bd0f529c6a3e17e"
format_stamp: "Formatted at 2026-08-07 04:21:54 on dist-test-slave-qg60"
server_key: "9856c3a9233b843a2a6e6001e58b05cf"
server_key_iv: "367693e4a8cf7237cdf87825e51b90d7"
server_key_version: "encryptionkey@0"
I20260807 04:21:54.953703 31916 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-2/wal/instance:
uuid: "156a2fd4717040c89bd0f529c6a3e17e"
format_stamp: "Formatted at 2026-08-07 04:21:54 on dist-test-slave-qg60"
server_key: "9856c3a9233b843a2a6e6001e58b05cf"
server_key_iv: "367693e4a8cf7237cdf87825e51b90d7"
server_key_version: "encryptionkey@0"
I20260807 04:21:54.959038 31916 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260807 04:21:54.962855 31933 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:54.964376 31916 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 04:21:54.964587 31916 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-2/wal
uuid: "156a2fd4717040c89bd0f529c6a3e17e"
format_stamp: "Formatted at 2026-08-07 04:21:54 on dist-test-slave-qg60"
server_key: "9856c3a9233b843a2a6e6001e58b05cf"
server_key_iv: "367693e4a8cf7237cdf87825e51b90d7"
server_key_version: "encryptionkey@0"
I20260807 04:21:54.964964 31916 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:54.997093 31916 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:54.997628 31829 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } attempt: 4
I20260807 04:21:54.998812 31831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.998334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:38289 (local address 127.0.0.1:32982)
0807 04:21:54.998560 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:54.998667 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260807 04:21:55.000061 31831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:54.999571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:38289 (local address 127.0.0.1:32984)
0807 04:21:54.999792 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:54.999880 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
W20260807 04:21:55.000355 31829 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.252:38289: Network error: Client connection negotiation failed: client connection to 127.7.200.252:38289: connect: Connection refused (error 111)
I20260807 04:21:55.002478 31916 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:55.002725 31916 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:55.022414 31916 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.252:38289
I20260807 04:21:55.022470 31987 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.252:38289 every 8 connection(s)
I20260807 04:21:55.023974 31916 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-2/data/info.pb
I20260807 04:21:55.028012 31988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:55.028466 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 31916
I20260807 04:21:55.028666 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786076137270840-7971-0/minicluster-data/master-2/wal/instance
I20260807 04:21:55.029259 7971 external_mini_cluster.cc:1428] Setting key b27ce9830911ae1000444a2bcfa12fe5
I20260807 04:21:55.037382 31988 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.254" port: 34459 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 04:21:55 dist-test-slave-qg60 krb5kdc[31742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076513, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.252@KRBTEST.COM
Aug 07 04:21:55 dist-test-slave-qg60 krb5kdc[31742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076514, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.252@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:21:55.057443 31991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:55.031305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32998 (local address 127.7.200.252:38289)
0807 04:21:55.032122 (+ 817us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:55.032134 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:55.032174 (+ 40us) server_negotiation.cc:407] Connection header received
0807 04:21:55.034741 (+ 2567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:55.034766 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:55.035203 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:55.035657 (+ 454us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:55.037267 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.038696 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.040140 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.041364 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.041510 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:55.047152 (+ 5642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:55.047162 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:55.047178 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:55.047246 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:55.050870 (+ 3624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:55.051757 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:55.051766 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:55.051775 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:55.051973 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:55.052493 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:55.052500 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:55.052504 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:55.053443 (+ 939us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:55.053798 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:55.055185 (+ 1387us) server_negotiation.cc:299] Negotiation successful
0807 04:21:55.055706 (+ 521us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":606,"thread_start_us":361,"threads_started":1}
I20260807 04:21:55.058493 31992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:55.040004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33670 (local address 127.7.200.254:34459)
0807 04:21:55.040672 (+ 668us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:55.040680 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:55.041152 (+ 472us) server_negotiation.cc:407] Connection header received
0807 04:21:55.041377 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:55.041388 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:55.041495 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:55.041613 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:55.042941 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.044302 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.045900 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.046662 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.046814 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:55.051394 (+ 4580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:55.051399 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:55.051402 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:55.051440 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:55.055103 (+ 3663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:55.056104 (+ 1001us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:55.056109 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:55.056115 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:55.056303 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:55.056823 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:55.056829 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:55.056833 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:55.057247 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:55.057433 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:55.057994 (+ 561us) server_negotiation.cc:299] Negotiation successful
0807 04:21:55.058180 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":511,"thread_start_us":336,"threads_started":1}
I20260807 04:21:55.058629 31993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:55.040008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:34459 (local address 127.0.0.1:33670)
0807 04:21:55.041019 (+ 1011us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:55.041057 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:55.041240 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:55.041694 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:55.041703 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:55.042507 (+ 804us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:21:55.042760 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:55.042769 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.044514 (+ 1745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.044518 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:55.045672 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:55.045718 (+ 46us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.046893 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.046897 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:55.047116 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:55.047869 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:21:55.047904 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:21:55.051187 (+ 3283us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:21:55.055268 (+ 4081us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:55.055279 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:55.055286 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:55.055934 (+ 648us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:55.056461 (+ 527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:55.056466 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:55.056470 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:55.056635 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:55.057396 (+ 761us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:21:55.057402 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:21:55.057618 (+ 216us) client_negotiation.cc:769] Sending connection context
0807 04:21:55.057843 (+ 225us) client_negotiation.cc:240] Negotiation successful
0807 04:21:55.058231 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":799,"thread_start_us":601,"threads_started":1}
I20260807 04:21:55.060469 31988 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.253" port: 42235 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 04:21:55 dist-test-slave-qg60 krb5kdc[31742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076514, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.252@KRBTEST.COM for kudu/127.7.200.253@KRBTEST.COM
Aug 07 04:21:55 dist-test-slave-qg60 krb5kdc[31742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076513, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:21:55.075795 31993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:55.061222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:42235 (local address 127.0.0.1:42024)
0807 04:21:55.061533 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:55.061553 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:55.061664 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:55.062049 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:55.062054 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:55.062511 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:21:55.062658 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:55.062667 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.063734 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.063741 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:55.064809 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:55.064823 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.065661 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.065668 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:55.065860 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:55.066738 (+ 878us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:21:55.066764 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:21:55.069639 (+ 2875us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:21:55.073008 (+ 3369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:55.073014 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:55.073019 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:55.073420 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:55.073894 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:55.073898 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:55.073900 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:55.074039 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:55.074689 (+ 650us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:21:55.074694 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:21:55.074871 (+ 177us) client_negotiation.cc:769] Sending connection context
0807 04:21:55.075043 (+ 172us) client_negotiation.cc:240] Negotiation successful
0807 04:21:55.075361 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174}
I20260807 04:21:55.075846 31913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:55.061390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42024 (local address 127.7.200.253:42235)
0807 04:21:55.061594 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:55.061601 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:55.061624 (+ 23us) server_negotiation.cc:407] Connection header received
0807 04:21:55.061822 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:55.061828 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:55.061907 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:55.062032 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:55.062817 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.063585 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.065005 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.065499 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.065637 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:55.069894 (+ 4257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:55.069899 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:55.069902 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:55.069937 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:55.072864 (+ 2927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:55.073557 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:55.073563 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:55.073567 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:55.073773 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:55.074158 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:55.074166 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:55.074173 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:55.074549 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:55.074730 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:55.075155 (+ 425us) server_negotiation.cc:299] Negotiation successful
0807 04:21:55.075391 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 04:21:55.076537 31992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:55.061529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33676 (local address 127.7.200.254:34459)
0807 04:21:55.061700 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:55.061707 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:55.061725 (+ 18us) server_negotiation.cc:407] Connection header received
0807 04:21:55.061780 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:55.061785 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:55.061860 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:55.061962 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:55.063173 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.063865 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.065131 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.065540 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.065670 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:55.070749 (+ 5079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:55.070759 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:55.070765 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:55.070811 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:55.073532 (+ 2721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:55.074425 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:55.074429 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:55.074431 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:55.074569 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:55.075044 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:55.075049 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:55.075057 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:55.075340 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:55.075625 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:55.075968 (+ 343us) server_negotiation.cc:299] Negotiation successful
0807 04:21:55.076211 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 04:21:55.076848 31988 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 04:21:55 dist-test-slave-qg60 krb5kdc[31742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076514, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.252@KRBTEST.COM for kudu/127.7.200.252@KRBTEST.COM
Aug 07 04:21:55 dist-test-slave-qg60 krb5kdc[31742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076513, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.253@KRBTEST.COM
I20260807 04:21:55.092406 31991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:55.078053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33010 (local address 127.7.200.252:38289)
0807 04:21:55.078210 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:55.078214 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:55.078234 (+ 20us) server_negotiation.cc:407] Connection header received
0807 04:21:55.078275 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:55.078278 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:55.078331 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:55.078410 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:55.079371 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.080544 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.082511 (+ 1967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.083130 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.083256 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:55.086979 (+ 3723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:55.086987 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:55.086992 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:55.087032 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:55.089893 (+ 2861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:55.090519 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:55.090526 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:55.090530 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:55.090653 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:55.090993 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:55.091000 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:55.091003 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:55.091280 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:55.091430 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:55.091783 (+ 353us) server_negotiation.cc:299] Negotiation successful
0807 04:21:55.092018 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":54}
I20260807 04:21:55.092521 31993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:55.077849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:38289 (local address 127.0.0.1:33010)
0807 04:21:55.078054 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:55.078074 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:55.078182 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:55.078468 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:55.078473 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:55.079021 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:21:55.079222 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:55.079234 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.080688 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.080692 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:55.082378 (+ 1686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:55.082392 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.083296 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.083301 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:55.083503 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:55.084132 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:21:55.084151 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:21:55.086759 (+ 2608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:21:55.090028 (+ 3269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:55.090035 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:55.090039 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:55.090399 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:55.090759 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:55.090765 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:55.090769 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:55.090896 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:55.091395 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:21:55.091399 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:21:55.091539 (+ 140us) client_negotiation.cc:769] Sending connection context
0807 04:21:55.091696 (+ 157us) client_negotiation.cc:240] Negotiation successful
0807 04:21:55.092171 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58,"mutex_wait_us":139}
I20260807 04:21:55.095443 31913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:55.078901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42036 (local address 127.7.200.253:42235)
0807 04:21:55.079064 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:55.079070 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:55.079089 (+ 19us) server_negotiation.cc:407] Connection header received
0807 04:21:55.079143 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:55.079151 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:55.079224 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:55.079339 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:55.080985 (+ 1646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.082176 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.083844 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.084302 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.084446 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:55.089539 (+ 5093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:55.089545 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:55.089549 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:55.089585 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:55.092490 (+ 2905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:55.093394 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:55.093402 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:55.093406 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:55.093581 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:55.094074 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:55.094077 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:55.094080 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:55.094343 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:55.094548 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:55.094966 (+ 418us) server_negotiation.cc:299] Negotiation successful
0807 04:21:55.095180 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 04:21:55.098922 31988 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 156a2fd4717040c89bd0f529c6a3e17e: Bootstrap starting.
I20260807 04:21:55.100721 7971 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 04:21:55.102679 31988 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 156a2fd4717040c89bd0f529c6a3e17e: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:55.103953 31988 log.cc:824] T 00000000000000000000000000000000 P 156a2fd4717040c89bd0f529c6a3e17e: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:55.103641 31800 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "c563a282e0ec41ee93650e614be23708"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33676
I20260807 04:21:55.107461 31988 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 156a2fd4717040c89bd0f529c6a3e17e: No bootstrap required, opened a new log
I20260807 04:21:55.115574 31988 raft_consensus.cc:348] T 00000000000000000000000000000000 P 156a2fd4717040c89bd0f529c6a3e17e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c563a282e0ec41ee93650e614be23708" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 34459 } } peers { permanent_uuid: "8399150bd64943dfbcb26cc61e1c4852" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 42235 } } peers { permanent_uuid: "156a2fd4717040c89bd0f529c6a3e17e" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } }
I20260807 04:21:55.115986 31988 raft_consensus.cc:729] T 00000000000000000000000000000000 P 156a2fd4717040c89bd0f529c6a3e17e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156a2fd4717040c89bd0f529c6a3e17e, State: Initialized, Role: FOLLOWER
I20260807 04:21:55.116492 31988 consensus_queue.cc:260] T 00000000000000000000000000000000 P 156a2fd4717040c89bd0f529c6a3e17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c563a282e0ec41ee93650e614be23708" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 34459 } } peers { permanent_uuid: "8399150bd64943dfbcb26cc61e1c4852" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 42235 } } peers { permanent_uuid: "156a2fd4717040c89bd0f529c6a3e17e" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } }
I20260807 04:21:55.117501 31995 sys_catalog.cc:455] T 00000000000000000000000000000000 P 156a2fd4717040c89bd0f529c6a3e17e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c563a282e0ec41ee93650e614be23708" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 34459 } } peers { permanent_uuid: "8399150bd64943dfbcb26cc61e1c4852" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 42235 } } peers { permanent_uuid: "156a2fd4717040c89bd0f529c6a3e17e" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } } }
I20260807 04:21:55.117880 31995 sys_catalog.cc:458] T 00000000000000000000000000000000 P 156a2fd4717040c89bd0f529c6a3e17e [sys.catalog]: This master's current role is: FOLLOWER
I20260807 04:21:55.119005 31988 sys_catalog.cc:564] T 00000000000000000000000000000000 P 156a2fd4717040c89bd0f529c6a3e17e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:21:55.126587 31908 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } attempt: 5
W20260807 04:21:55.129334 32007 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 156a2fd4717040c89bd0f529c6a3e17e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 04:21:55.129460 32007 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 07 04:21:55 dist-test-slave-qg60 krb5kdc[31742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076514, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.253@KRBTEST.COM for kudu/127.7.200.252@KRBTEST.COM
I20260807 04:21:55.127576 31916 master_runner.cc:186] Error getting master registration for 127.7.200.254:34459: OK, instance_id { permanent_uuid: "c563a282e0ec41ee93650e614be23708" instance_seqno: 1786076513848424 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 04:21:55.137823 31916 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 04:21:55.144826 31911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:55.127260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:38289 (local address 127.0.0.1:33012)
0807 04:21:55.127637 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:55.127658 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:55.127776 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:55.128460 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:55.128465 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:55.129054 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:21:55.129275 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:55.129291 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.130887 (+ 1596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.130895 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:55.132304 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:55.132321 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.133766 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.133772 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:55.134020 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:55.134740 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:21:55.134765 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:21:55.137675 (+ 2910us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:21:55.141883 (+ 4208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:55.141888 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:55.141893 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:55.142443 (+ 550us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:55.142860 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:55.142864 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:55.142868 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:55.143031 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:55.143757 (+ 726us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:21:55.143762 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:21:55.143926 (+ 164us) client_negotiation.cc:769] Sending connection context
0807 04:21:55.144072 (+ 146us) client_negotiation.cc:240] Negotiation successful
0807 04:21:55.144390 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241}
I20260807 04:21:55.144827 31991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:55.127759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33012 (local address 127.7.200.252:38289)
0807 04:21:55.127957 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:55.127965 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:55.127989 (+ 24us) server_negotiation.cc:407] Connection header received
0807 04:21:55.128042 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:55.128047 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:55.128140 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:55.128251 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:55.129485 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.130691 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.132468 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.133346 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.133501 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:55.137926 (+ 4425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:55.137933 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:55.137938 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:55.137976 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:55.141729 (+ 3753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:55.142573 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:55.142583 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:55.142588 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:55.142745 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:55.143139 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:55.143144 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:55.143148 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:55.143633 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:55.143779 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:55.144212 (+ 433us) server_negotiation.cc:299] Negotiation successful
0807 04:21:55.144436 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 04:21:55.149847 31908 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8399150bd64943dfbcb26cc61e1c4852: Bootstrap starting.
I20260807 04:21:55.153177 31908 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8399150bd64943dfbcb26cc61e1c4852: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:55.154361 31908 log.cc:824] T 00000000000000000000000000000000 P 8399150bd64943dfbcb26cc61e1c4852: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:55.157172 31908 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8399150bd64943dfbcb26cc61e1c4852: No bootstrap required, opened a new log
I20260807 04:21:55.164306 31908 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8399150bd64943dfbcb26cc61e1c4852 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c563a282e0ec41ee93650e614be23708" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 34459 } } peers { permanent_uuid: "8399150bd64943dfbcb26cc61e1c4852" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 42235 } } peers { permanent_uuid: "156a2fd4717040c89bd0f529c6a3e17e" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } }
I20260807 04:21:55.164664 31908 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8399150bd64943dfbcb26cc61e1c4852 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8399150bd64943dfbcb26cc61e1c4852, State: Initialized, Role: FOLLOWER
I20260807 04:21:55.165177 31908 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8399150bd64943dfbcb26cc61e1c4852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c563a282e0ec41ee93650e614be23708" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 34459 } } peers { permanent_uuid: "8399150bd64943dfbcb26cc61e1c4852" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 42235 } } peers { permanent_uuid: "156a2fd4717040c89bd0f529c6a3e17e" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } }
I20260807 04:21:55.166165 32010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8399150bd64943dfbcb26cc61e1c4852 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c563a282e0ec41ee93650e614be23708" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 34459 } } peers { permanent_uuid: "8399150bd64943dfbcb26cc61e1c4852" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 42235 } } peers { permanent_uuid: "156a2fd4717040c89bd0f529c6a3e17e" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } } }
I20260807 04:21:55.166558 32010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8399150bd64943dfbcb26cc61e1c4852 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 04:21:55.167318 31908 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8399150bd64943dfbcb26cc61e1c4852 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 04:21:55.179831 32022 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8399150bd64943dfbcb26cc61e1c4852: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 04:21:55.180030 32022 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 04:21:55.174981 31836 master_runner.cc:186] Error getting master registration for 127.7.200.254:34459: OK, instance_id { permanent_uuid: "c563a282e0ec41ee93650e614be23708" instance_seqno: 1786076513848424 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 04:21:55.184836 31836 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 04:21:55.254979 31939 tablet.cc:2369] T 00000000000000000000000000000000 P 156a2fd4717040c89bd0f529c6a3e17e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:21:55.277593 31829 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } attempt: 5
Aug 07 04:21:55 dist-test-slave-qg60 krb5kdc[31742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076513, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for kudu/127.7.200.252@KRBTEST.COM
I20260807 04:21:55.292824 31991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:55.278711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33022 (local address 127.7.200.252:38289)
0807 04:21:55.278901 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:55.278907 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:55.278927 (+ 20us) server_negotiation.cc:407] Connection header received
0807 04:21:55.278993 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:55.279001 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:55.279079 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:55.279177 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:55.279989 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.281164 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.282434 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.283140 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.283266 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:55.286881 (+ 3615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:55.286886 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:55.286889 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:55.286928 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:55.289861 (+ 2933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:55.290714 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:55.290722 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:55.290726 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:55.290870 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:55.291307 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:55.291312 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:55.291315 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:55.291582 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:55.291749 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:55.292149 (+ 400us) server_negotiation.cc:299] Negotiation successful
0807 04:21:55.292378 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 04:21:55.292836 31831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:55.278409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:38289 (local address 127.0.0.1:33022)
0807 04:21:55.278598 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:55.278622 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:55.278755 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:55.279203 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:55.279208 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:55.279648 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:21:55.279811 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:55.279820 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.281301 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.281307 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:55.282239 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:55.282250 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.283289 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.283295 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:55.283497 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:55.284138 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:21:55.284156 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:21:55.286689 (+ 2533us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:21:55.290063 (+ 3374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:55.290070 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:55.290077 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:55.290609 (+ 532us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:55.290994 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:55.291000 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:55.291004 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:55.291199 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:55.291712 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:21:55.291718 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:21:55.291890 (+ 172us) client_negotiation.cc:769] Sending connection context
0807 04:21:55.292046 (+ 156us) client_negotiation.cc:240] Negotiation successful
0807 04:21:55.292341 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260807 04:21:55.297852 31829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c563a282e0ec41ee93650e614be23708: Bootstrap starting.
I20260807 04:21:55.301945 31829 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c563a282e0ec41ee93650e614be23708: Neither blocks nor log segments found. Creating new log.
I20260807 04:21:55.303272 31829 log.cc:824] T 00000000000000000000000000000000 P c563a282e0ec41ee93650e614be23708: Log is configured to *not* fsync() on all Append() calls
I20260807 04:21:55.306860 31829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c563a282e0ec41ee93650e614be23708: No bootstrap required, opened a new log
I20260807 04:21:55.314894 31829 raft_consensus.cc:348] T 00000000000000000000000000000000 P c563a282e0ec41ee93650e614be23708 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c563a282e0ec41ee93650e614be23708" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 34459 } } peers { permanent_uuid: "8399150bd64943dfbcb26cc61e1c4852" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 42235 } } peers { permanent_uuid: "156a2fd4717040c89bd0f529c6a3e17e" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } }
I20260807 04:21:55.315307 31829 raft_consensus.cc:729] T 00000000000000000000000000000000 P c563a282e0ec41ee93650e614be23708 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c563a282e0ec41ee93650e614be23708, State: Initialized, Role: FOLLOWER
I20260807 04:21:55.315826 31829 consensus_queue.cc:260] T 00000000000000000000000000000000 P c563a282e0ec41ee93650e614be23708 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c563a282e0ec41ee93650e614be23708" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 34459 } } peers { permanent_uuid: "8399150bd64943dfbcb26cc61e1c4852" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 42235 } } peers { permanent_uuid: "156a2fd4717040c89bd0f529c6a3e17e" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } }
I20260807 04:21:55.317214 32025 sys_catalog.cc:455] T 00000000000000000000000000000000 P c563a282e0ec41ee93650e614be23708 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c563a282e0ec41ee93650e614be23708" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 34459 } } peers { permanent_uuid: "8399150bd64943dfbcb26cc61e1c4852" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 42235 } } peers { permanent_uuid: "156a2fd4717040c89bd0f529c6a3e17e" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } } }
I20260807 04:21:55.317912 32025 sys_catalog.cc:458] T 00000000000000000000000000000000 P c563a282e0ec41ee93650e614be23708 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 04:21:55.318682 31829 sys_catalog.cc:564] T 00000000000000000000000000000000 P c563a282e0ec41ee93650e614be23708 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:21:55.318763 31800 raft_consensus.cc:482] T 00000000000000000000000000000000 P c563a282e0ec41ee93650e614be23708 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 04:21:55.318986 31800 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c563a282e0ec41ee93650e614be23708 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:55.321714 31800 raft_consensus.cc:504] T 00000000000000000000000000000000 P c563a282e0ec41ee93650e614be23708 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c563a282e0ec41ee93650e614be23708" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 34459 } } peers { permanent_uuid: "8399150bd64943dfbcb26cc61e1c4852" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 42235 } } peers { permanent_uuid: "156a2fd4717040c89bd0f529c6a3e17e" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } }
I20260807 04:21:55.323257 31800 leader_election.cc:288] T 00000000000000000000000000000000 P c563a282e0ec41ee93650e614be23708 [CANDIDATE]: Term 1 election: Requested vote from peers 8399150bd64943dfbcb26cc61e1c4852 (127.7.200.253:42235), 156a2fd4717040c89bd0f529c6a3e17e (127.7.200.252:38289)
I20260807 04:21:55.325328 31960 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c563a282e0ec41ee93650e614be23708" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "156a2fd4717040c89bd0f529c6a3e17e"
I20260807 04:21:55.325960 31960 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 156a2fd4717040c89bd0f529c6a3e17e [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:55.324678 31879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c563a282e0ec41ee93650e614be23708" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "8399150bd64943dfbcb26cc61e1c4852"
I20260807 04:21:55.329586 31879 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8399150bd64943dfbcb26cc61e1c4852 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:21:55.334975 31960 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 156a2fd4717040c89bd0f529c6a3e17e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c563a282e0ec41ee93650e614be23708 in term 1.
I20260807 04:21:55.336656 31879 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8399150bd64943dfbcb26cc61e1c4852 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c563a282e0ec41ee93650e614be23708 in term 1.
W20260807 04:21:55.337375 31779 tablet.cc:2369] T 00000000000000000000000000000000 P c563a282e0ec41ee93650e614be23708: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:21:55.337561 31777 leader_election.cc:302] T 00000000000000000000000000000000 P c563a282e0ec41ee93650e614be23708 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8399150bd64943dfbcb26cc61e1c4852, c563a282e0ec41ee93650e614be23708; no voters:
I20260807 04:21:55.338985 32025 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c563a282e0ec41ee93650e614be23708 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:21:55.349040 32025 raft_consensus.cc:686] T 00000000000000000000000000000000 P c563a282e0ec41ee93650e614be23708 [term 1 LEADER]: Becoming Leader. State: Replica: c563a282e0ec41ee93650e614be23708, State: Running, Role: LEADER
I20260807 04:21:55.349839 32025 consensus_queue.cc:237] T 00000000000000000000000000000000 P c563a282e0ec41ee93650e614be23708 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c563a282e0ec41ee93650e614be23708" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 34459 } } peers { permanent_uuid: "8399150bd64943dfbcb26cc61e1c4852" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 42235 } } peers { permanent_uuid: "156a2fd4717040c89bd0f529c6a3e17e" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } }
I20260807 04:21:55.370741 32028 sys_catalog.cc:455] T 00000000000000000000000000000000 P c563a282e0ec41ee93650e614be23708 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c563a282e0ec41ee93650e614be23708. Latest consensus state: current_term: 1 leader_uuid: "c563a282e0ec41ee93650e614be23708" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c563a282e0ec41ee93650e614be23708" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 34459 } } peers { permanent_uuid: "8399150bd64943dfbcb26cc61e1c4852" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 42235 } } peers { permanent_uuid: "156a2fd4717040c89bd0f529c6a3e17e" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } } }
I20260807 04:21:55.371263 32028 sys_catalog.cc:458] T 00000000000000000000000000000000 P c563a282e0ec41ee93650e614be23708 [sys.catalog]: This master's current role is: LEADER
W20260807 04:21:55.384192 31858 tablet.cc:2369] T 00000000000000000000000000000000 P 8399150bd64943dfbcb26cc61e1c4852: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:21:55.387126 32041 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:21:55.414258 31991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:55.359549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33032 (local address 127.7.200.252:38289)
0807 04:21:55.359780 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:55.359788 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:55.374670 (+ 14882us) server_negotiation.cc:407] Connection header received
0807 04:21:55.377445 (+ 2775us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:55.377455 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:55.377585 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:55.377671 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:55.384290 (+ 6619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.385644 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.390178 (+ 4534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.390895 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.390993 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:55.397327 (+ 6334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:55.397333 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:55.397339 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:55.397396 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:55.403423 (+ 6027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:55.408273 (+ 4850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:55.408282 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:55.408289 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:55.408511 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:55.409960 (+ 1449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:55.409969 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:55.409975 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:55.410519 (+ 544us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:55.410863 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:55.413289 (+ 2426us) server_negotiation.cc:299] Negotiation successful
0807 04:21:55.413663 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 04:21:55.416153 31992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:55.359549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33684 (local address 127.7.200.254:34459)
0807 04:21:55.359760 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:55.359767 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:55.370905 (+ 11138us) server_negotiation.cc:407] Connection header received
0807 04:21:55.373717 (+ 2812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:55.373725 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:55.373814 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:55.373892 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:55.380293 (+ 6401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.381710 (+ 1417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.388077 (+ 6367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.388776 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.388913 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:55.398242 (+ 9329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:55.398252 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:55.398262 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:55.398313 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:55.406123 (+ 7810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:55.409152 (+ 3029us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:55.409162 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:55.409168 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:55.409394 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:55.411523 (+ 2129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:55.411532 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:55.411538 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:55.412056 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:55.412481 (+ 425us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:55.415218 (+ 2737us) server_negotiation.cc:299] Negotiation successful
0807 04:21:55.415596 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 04:21:55.424068 32041 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:21:55.431876 31913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:55.375055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42042 (local address 127.7.200.253:42235)
0807 04:21:55.375241 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:55.375247 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:55.387879 (+ 12632us) server_negotiation.cc:407] Connection header received
0807 04:21:55.388308 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:55.388313 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:55.388398 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:55.388471 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:55.390989 (+ 2518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.392151 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.396331 (+ 4180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:55.397111 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:55.397229 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:55.422176 (+ 24947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:55.422187 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:55.422195 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:55.422274 (+ 79us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:55.427362 (+ 5088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:55.428524 (+ 1162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:55.428533 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:55.428539 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:55.428762 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:55.429289 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:55.429296 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:55.429300 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:55.429804 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:55.430162 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:55.430986 (+ 824us) server_negotiation.cc:299] Negotiation successful
0807 04:21:55.431347 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 04:21:55.435860 32050 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 04:21:55.442749 31879 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8399150bd64943dfbcb26cc61e1c4852 [term 1 FOLLOWER]: Refusing update from remote peer c563a282e0ec41ee93650e614be23708: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:21:55.443922 31960 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 156a2fd4717040c89bd0f529c6a3e17e [term 1 FOLLOWER]: Refusing update from remote peer c563a282e0ec41ee93650e614be23708: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:21:55.444967 32025 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c563a282e0ec41ee93650e614be23708 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8399150bd64943dfbcb26cc61e1c4852" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 42235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260807 04:21:55.445719 32028 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c563a282e0ec41ee93650e614be23708 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156a2fd4717040c89bd0f529c6a3e17e" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:21:55.466241 32010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8399150bd64943dfbcb26cc61e1c4852 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c563a282e0ec41ee93650e614be23708. Latest consensus state: current_term: 1 leader_uuid: "c563a282e0ec41ee93650e614be23708" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c563a282e0ec41ee93650e614be23708" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 34459 } } peers { permanent_uuid: "8399150bd64943dfbcb26cc61e1c4852" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 42235 } } peers { permanent_uuid: "156a2fd4717040c89bd0f529c6a3e17e" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } } }
I20260807 04:21:55.466566 32010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8399150bd64943dfbcb26cc61e1c4852 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 04:21:55.470937 32049 mvcc.cc:205] Tried to move back new op lower bound from 7315769407243853824 to 7315769406880374784. Current Snapshot: MvccSnapshot[applied={T|T < 7315769407243853824}]
I20260807 04:21:55.472983 32052 mvcc.cc:205] Tried to move back new op lower bound from 7315769407243853824 to 7315769406880374784. Current Snapshot: MvccSnapshot[applied={T|T < 7315769407243853824}]
I20260807 04:21:55.481455 31995 sys_catalog.cc:455] T 00000000000000000000000000000000 P 156a2fd4717040c89bd0f529c6a3e17e [sys.catalog]: SysCatalogTable state changed. Reason: New leader c563a282e0ec41ee93650e614be23708. Latest consensus state: current_term: 1 leader_uuid: "c563a282e0ec41ee93650e614be23708" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c563a282e0ec41ee93650e614be23708" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 34459 } } peers { permanent_uuid: "8399150bd64943dfbcb26cc61e1c4852" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 42235 } } peers { permanent_uuid: "156a2fd4717040c89bd0f529c6a3e17e" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } } }
I20260807 04:21:55.481935 31995 sys_catalog.cc:458] T 00000000000000000000000000000000 P 156a2fd4717040c89bd0f529c6a3e17e [sys.catalog]: This master's current role is: FOLLOWER
I20260807 04:21:55.492455 32010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8399150bd64943dfbcb26cc61e1c4852 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c563a282e0ec41ee93650e614be23708" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c563a282e0ec41ee93650e614be23708" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 34459 } } peers { permanent_uuid: "8399150bd64943dfbcb26cc61e1c4852" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 42235 } } peers { permanent_uuid: "156a2fd4717040c89bd0f529c6a3e17e" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } } }
I20260807 04:21:55.492722 32010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8399150bd64943dfbcb26cc61e1c4852 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 04:21:55.494096 32053 mvcc.cc:205] Tried to move back new op lower bound from 7315769407243853824 to 7315769406880374784. Current Snapshot: MvccSnapshot[applied={T|T < 7315769407243853824}]
I20260807 04:21:55.495041 32041 catalog_manager.cc:1347] Generated new cluster ID: f7b24eefd1e94e93b25335f72d535ad1
I20260807 04:21:55.495162 32041 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:21:55.495059 31995 sys_catalog.cc:455] T 00000000000000000000000000000000 P 156a2fd4717040c89bd0f529c6a3e17e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c563a282e0ec41ee93650e614be23708" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c563a282e0ec41ee93650e614be23708" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 34459 } } peers { permanent_uuid: "8399150bd64943dfbcb26cc61e1c4852" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 42235 } } peers { permanent_uuid: "156a2fd4717040c89bd0f529c6a3e17e" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } } }
I20260807 04:21:55.495329 31995 sys_catalog.cc:458] T 00000000000000000000000000000000 P 156a2fd4717040c89bd0f529c6a3e17e [sys.catalog]: This master's current role is: FOLLOWER
I20260807 04:21:55.495311 32028 sys_catalog.cc:455] T 00000000000000000000000000000000 P c563a282e0ec41ee93650e614be23708 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c563a282e0ec41ee93650e614be23708" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c563a282e0ec41ee93650e614be23708" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 34459 } } peers { permanent_uuid: "8399150bd64943dfbcb26cc61e1c4852" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 42235 } } peers { permanent_uuid: "156a2fd4717040c89bd0f529c6a3e17e" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } } }
I20260807 04:21:55.495605 32028 sys_catalog.cc:458] T 00000000000000000000000000000000 P c563a282e0ec41ee93650e614be23708 [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:55.495800 32028 sys_catalog.cc:455] T 00000000000000000000000000000000 P c563a282e0ec41ee93650e614be23708 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c563a282e0ec41ee93650e614be23708" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c563a282e0ec41ee93650e614be23708" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 34459 } } peers { permanent_uuid: "8399150bd64943dfbcb26cc61e1c4852" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 42235 } } peers { permanent_uuid: "156a2fd4717040c89bd0f529c6a3e17e" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 38289 } } }
I20260807 04:21:55.496114 32028 sys_catalog.cc:458] T 00000000000000000000000000000000 P c563a282e0ec41ee93650e614be23708 [sys.catalog]: This master's current role is: LEADER
I20260807 04:21:55.551682 32041 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:21:55.554217 32041 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:21:55.571908 32041 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c563a282e0ec41ee93650e614be23708: Generated new TSK 0
I20260807 04:21:55.573293 32041 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 04:21:55.721235 31991 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:21:55.708953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33040 (local address 127.7.200.252:38289)
0807 04:21:55.709206 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:55.709212 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:55.718730 (+ 9518us) server_negotiation.cc:407] Connection header received
0807 04:21:55.719317 (+ 587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:55.719326 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:55.719467 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:55.719556 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:55.720958 (+ 1402us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33040: BlockingRecv error: recv got EOF from 127.0.0.1:33040 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260807 04:21:55.723245 31992 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:21:55.712722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33690 (local address 127.7.200.254:34459)
0807 04:21:55.712977 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:55.712984 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:55.721243 (+ 8259us) server_negotiation.cc:407] Connection header received
0807 04:21:55.721558 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:55.721565 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:55.721650 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:55.721725 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:55.722993 (+ 1268us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33690: BlockingRecv error: recv got EOF from 127.0.0.1:33690 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260807 04:21:55.726890 31913 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:21:55.723255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42050 (local address 127.7.200.253:42235)
0807 04:21:55.723482 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:55.723494 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:55.725038 (+ 1544us) server_negotiation.cc:407] Connection header received
0807 04:21:55.725310 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:55.725317 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:55.725414 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:55.725499 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:55.726662 (+ 1163us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42050: BlockingRecv error: recv got EOF from 127.0.0.1:42050 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260807 04:21:55.754508 31913 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:21:55.751381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42064 (local address 127.7.200.253:42235)
0807 04:21:55.751600 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:55.751606 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:55.752128 (+ 522us) server_negotiation.cc:407] Connection header received
0807 04:21:55.752615 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:55.752624 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:55.752820 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:55.752912 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:55.754165 (+ 1253us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42064: BlockingRecv error: recv got EOF from 127.0.0.1:42064 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
W20260807 04:21:55.763130 31913 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:21:55.760577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42074 (local address 127.7.200.253:42235)
0807 04:21:55.760769 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:55.760775 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:55.761309 (+ 534us) server_negotiation.cc:407] Connection header received
0807 04:21:55.761640 (+ 331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:55.761647 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:55.761740 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:55.761830 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:55.762896 (+ 1066us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42074: BlockingRecv error: recv got EOF from 127.0.0.1:42074 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260807 04:21:55.772162 31913 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:21:55.769790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42088 (local address 127.7.200.253:42235)
0807 04:21:55.769953 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:55.769959 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:55.770491 (+ 532us) server_negotiation.cc:407] Connection header received
0807 04:21:55.770782 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:55.770789 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:55.770897 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:55.770971 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:55.771911 (+ 940us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42088: BlockingRecv error: recv got EOF from 127.0.0.1:42088 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260807 04:21:55.783224 31913 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:21:55.780578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42090 (local address 127.7.200.253:42235)
0807 04:21:55.780834 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:55.780841 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:55.781397 (+ 556us) server_negotiation.cc:407] Connection header received
0807 04:21:55.781735 (+ 338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:55.781742 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:55.781853 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:55.781936 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:55.782949 (+ 1013us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42090: BlockingRecv error: recv got EOF from 127.0.0.1:42090 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260807 04:21:55.798661 31913 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:21:55.796110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42102 (local address 127.7.200.253:42235)
0807 04:21:55.796320 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:55.796326 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:55.796954 (+ 628us) server_negotiation.cc:407] Connection header received
0807 04:21:55.797173 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:55.797179 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:55.797290 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:55.797420 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:55.798369 (+ 949us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42102: BlockingRecv error: recv got EOF from 127.0.0.1:42102 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
W20260807 04:21:55.821973 31913 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:21:55.819249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42110 (local address 127.7.200.253:42235)
0807 04:21:55.819465 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:55.819471 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:55.820090 (+ 619us) server_negotiation.cc:407] Connection header received
0807 04:21:55.820340 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:55.820347 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:55.820462 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:55.820609 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:55.821669 (+ 1060us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42110: BlockingRecv error: recv got EOF from 127.0.0.1:42110 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260807 04:21:55.886842 31913 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:21:55.883050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42116 (local address 127.7.200.253:42235)
0807 04:21:55.883336 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:55.883345 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:55.885323 (+ 1978us) server_negotiation.cc:407] Connection header received
0807 04:21:55.885572 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:55.885578 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:55.885660 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:55.885772 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:55.886574 (+ 802us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42116: BlockingRecv error: recv got EOF from 127.0.0.1:42116 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
W20260807 04:21:55.957363 31913 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:21:55.954891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42132 (local address 127.7.200.253:42235)
0807 04:21:55.955196 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:55.955206 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:55.955808 (+ 602us) server_negotiation.cc:407] Connection header received
0807 04:21:55.956048 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:55.956057 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:55.956134 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:55.956242 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:55.957117 (+ 875us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42132: BlockingRecv error: recv got EOF from 127.0.0.1:42132 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260807 04:21:56.091774 31913 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:21:56.089634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42134 (local address 127.7.200.253:42235)
0807 04:21:56.089840 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:56.089844 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:56.090245 (+ 401us) server_negotiation.cc:407] Connection header received
0807 04:21:56.090466 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:56.090471 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:56.090565 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:56.090664 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:56.091476 (+ 812us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42134: BlockingRecv error: recv got EOF from 127.0.0.1:42134 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
I20260807 04:21:56.131690 32007 catalog_manager.cc:1259] Loaded cluster ID: f7b24eefd1e94e93b25335f72d535ad1
I20260807 04:21:56.131808 32007 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 156a2fd4717040c89bd0f529c6a3e17e: loading cluster ID for follower catalog manager: success
I20260807 04:21:56.134608 32007 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 156a2fd4717040c89bd0f529c6a3e17e: acquiring CA information for follower catalog manager: success
I20260807 04:21:56.137058 32007 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 156a2fd4717040c89bd0f529c6a3e17e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 04:21:56.182370 32022 catalog_manager.cc:1259] Loaded cluster ID: f7b24eefd1e94e93b25335f72d535ad1
I20260807 04:21:56.182533 32022 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8399150bd64943dfbcb26cc61e1c4852: loading cluster ID for follower catalog manager: success
I20260807 04:21:56.185405 32022 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8399150bd64943dfbcb26cc61e1c4852: acquiring CA information for follower catalog manager: success
I20260807 04:21:56.187381 32022 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8399150bd64943dfbcb26cc61e1c4852: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 04:21:56.357575 31913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:56.351679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42142 (local address 127.7.200.253:42235)
0807 04:21:56.351915 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:56.351923 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:56.352189 (+ 266us) server_negotiation.cc:407] Connection header received
0807 04:21:56.352450 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:56.352460 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:56.352613 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:56.352768 (+ 155us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:21:56.353216 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:56.353928 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:56.355305 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:56.355703 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:56.355841 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:56.356371 (+ 530us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:21:56.356941 (+ 570us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:21:56.357101 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:56.357207 (+ 106us) server_negotiation.cc:299] Negotiation successful
0807 04:21:56.357295 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260807 04:21:56.370298 32126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:56.364378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33044 (local address 127.7.200.252:38289)
0807 04:21:56.364855 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:56.364859 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:56.364876 (+ 17us) server_negotiation.cc:407] Connection header received
0807 04:21:56.364972 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:56.364976 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:56.365143 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:56.365293 (+ 150us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:21:56.365653 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:56.366344 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:56.367768 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:56.368191 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:56.368312 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:56.368974 (+ 662us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:21:56.369638 (+ 664us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:21:56.369796 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:56.369882 (+ 86us) server_negotiation.cc:299] Negotiation successful
0807 04:21:56.369970 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":261,"threads_started":1}
I20260807 04:21:56.385134 31913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:56.378796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42152 (local address 127.7.200.253:42235)
0807 04:21:56.379046 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:56.379052 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:56.379623 (+ 571us) server_negotiation.cc:407] Connection header received
0807 04:21:56.379843 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:56.379849 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:56.379946 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:56.380044 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:21:56.380562 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:56.381486 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:56.383257 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:56.383696 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:56.383832 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:56.384304 (+ 472us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:21:56.384435 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:21:56.384526 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:56.384695 (+ 169us) server_negotiation.cc:299] Negotiation successful
0807 04:21:56.384811 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 04:21:56.386282 32126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:56.377736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33056 (local address 127.7.200.252:38289)
0807 04:21:56.377965 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:56.377972 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:56.378706 (+ 734us) server_negotiation.cc:407] Connection header received
0807 04:21:56.379001 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:56.379010 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:56.379123 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:56.379205 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:21:56.380257 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:56.381428 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:56.384081 (+ 2653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:56.384716 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:56.384828 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:56.385468 (+ 640us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:21:56.385616 (+ 148us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:21:56.385683 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:56.385888 (+ 205us) server_negotiation.cc:299] Negotiation successful
0807 04:21:56.385967 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 04:21:56.386775 32133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:56.377369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33692 (local address 127.7.200.254:34459)
0807 04:21:56.377964 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:56.377973 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:56.378546 (+ 573us) server_negotiation.cc:407] Connection header received
0807 04:21:56.378876 (+ 330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:56.378883 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:56.379113 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:56.379294 (+ 181us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:21:56.380253 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:56.381428 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:56.384060 (+ 2632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:56.384624 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:56.384767 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:56.385501 (+ 734us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:21:56.385965 (+ 464us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:21:56.386056 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:56.386319 (+ 263us) server_negotiation.cc:299] Negotiation successful
0807 04:21:56.386435 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":608,"threads_started":1}
I20260807 04:21:56.391830 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 31756
I20260807 04:21:56.392968 31823 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:21:56.505168 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 31756
I20260807 04:21:56.531973 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 31836
I20260807 04:21:56.533254 31903 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:21:56.648252 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 31836
I20260807 04:21:56.671294 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 31916
I20260807 04:21:56.672418 31983 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:21:56.786114 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 31916
2026-08-07T04:21:56Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (4979 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 04:21:56 dist-test-slave-qg60 krb5kdc[32141](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 04:21:56 dist-test-slave-qg60 krb5kdc[32141](info): set up 2 sockets
Aug 07 04:21:56 dist-test-slave-qg60 krb5kdc[32141](info): commencing operation
krb5kdc: starting...
W20260807 04:21:58.016292 7971 mini_kdc.cc:121] Time spent starting KDC: real 1.184s user 0.003s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/krb5kdc/test-user.keytab.
Aug 07 04:21:58 dist-test-slave-qg60 krb5kdc[32141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076518, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T04:21:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T04:21:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.7.200.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
Entry for principal kudu/127.7.200.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab.
I20260807 04:21:58.388967 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:43497
--webserver_interface=127.7.200.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:34411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:43497,127.7.200.253:39163,127.7.200.252:36989
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 04:21:58.771733 32155 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 04:21:58.772194 32155 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:58.772327 32155 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:58.772459 32155 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:58.780182 32155 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:21:58.780313 32155 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:58.780436 32155 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:58.780524 32155 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:21:58.780617 32155 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:21:58.790894 32155 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:34411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:43497,127.7.200.253:39163,127.7.200.252:36989
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.254.keytab
--principal=kudu/127.7.200.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.254:43497
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.200.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:58.792316 32155 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:58.793706 32155 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:58.806128 32161 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:58.806035 32165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:58.806090 32162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:58.807384 32155 server_base.cc:1034] running on GCE node
I20260807 04:21:58.808321 32155 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:58.810050 32155 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:58.811340 32155 hybrid_clock.cc:648] HybridClock initialized: now 1786076518811249 us; error 58 us; skew 500 ppm
I20260807 04:21:58.811729 32155 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:21:58 dist-test-slave-qg60 krb5kdc[32141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076518, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:21:58.815392 32155 init.cc:377] Logged in from keytab as kudu/127.7.200.254@KRBTEST.COM (short username kudu)
I20260807 04:21:58.817188 32155 webserver.cc:460] Webserver started at http://127.7.200.254:40625/ using document root <none> and password file <none>
I20260807 04:21:58.817927 32155 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:58.818063 32155 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:58.818401 32155 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:58.821614 32155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-0/data/instance:
uuid: "042ddca9edfc4a8b84753b675d49f944"
format_stamp: "Formatted at 2026-08-07 04:21:58 on dist-test-slave-qg60"
server_key: "5f9fe758058458e4e09557bbb7250aef"
server_key_iv: "df0735da7deed75e4aa4bb3c1426b265"
server_key_version: "encryptionkey@0"
I20260807 04:21:58.822463 32155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-0/wal/instance:
uuid: "042ddca9edfc4a8b84753b675d49f944"
format_stamp: "Formatted at 2026-08-07 04:21:58 on dist-test-slave-qg60"
server_key: "5f9fe758058458e4e09557bbb7250aef"
server_key_iv: "df0735da7deed75e4aa4bb3c1426b265"
server_key_version: "encryptionkey@0"
I20260807 04:21:58.828189 32155 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 04:21:58.831864 32173 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:58.833377 32155 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 04:21:58.833577 32155 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-0/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-0/wal
uuid: "042ddca9edfc4a8b84753b675d49f944"
format_stamp: "Formatted at 2026-08-07 04:21:58 on dist-test-slave-qg60"
server_key: "5f9fe758058458e4e09557bbb7250aef"
server_key_iv: "df0735da7deed75e4aa4bb3c1426b265"
server_key_version: "encryptionkey@0"
I20260807 04:21:58.833801 32155 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:58.907771 32155 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:58.912338 32155 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:58.912633 32155 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:58.933147 32155 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.254:43497
I20260807 04:21:58.933192 32228 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.254:43497 every 8 connection(s)
I20260807 04:21:58.934558 32155 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-0/data/info.pb
I20260807 04:21:58.937603 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 32155
I20260807 04:21:58.937808 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-0/wal/instance
I20260807 04:21:58.938289 7971 external_mini_cluster.cc:1428] Setting key 75b5cd722fae72cecabf7d919d0f20c5
I20260807 04:21:58.939252 32229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:58.946898 32229 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43497 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 04:21:58 dist-test-slave-qg60 krb5kdc[32141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076518, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:21:58.973837 32231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:58.950756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:43497 (local address 127.0.0.1:34348)
0807 04:21:58.952042 (+ 1286us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:58.952127 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:58.954277 (+ 2150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:58.955245 (+ 968us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:58.955256 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:58.956187 (+ 931us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:21:58.956776 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:58.956807 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:58.958591 (+ 1784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:58.958601 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:58.960834 (+ 2233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:58.960854 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:58.961829 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:58.961839 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:58.962105 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:58.962985 (+ 880us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:21:58.963023 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:21:58.966061 (+ 3038us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:21:58.969452 (+ 3391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:58.969463 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:58.969476 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:58.969890 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:58.970312 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:58.970319 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:58.970322 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:58.970479 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:58.971275 (+ 796us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:21:58.971283 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:21:58.971491 (+ 208us) client_negotiation.cc:769] Sending connection context
0807 04:21:58.971743 (+ 252us) client_negotiation.cc:240] Negotiation successful
0807 04:21:58.972377 (+ 634us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":842,"mutex_wait_us":138,"thread_start_us":539,"threads_started":1}
I20260807 04:21:58.973857 32232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:58.950747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34348 (local address 127.7.200.254:43497)
0807 04:21:58.952673 (+ 1926us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:58.952683 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:58.952759 (+ 76us) server_negotiation.cc:407] Connection header received
0807 04:21:58.954655 (+ 1896us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:58.954661 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:58.954964 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:58.955147 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:58.957132 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:58.958402 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:58.960987 (+ 2585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:58.961562 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:58.961702 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:58.966303 (+ 4601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:58.966311 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:58.966324 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:58.966357 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:58.969311 (+ 2954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:58.970036 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:58.970043 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:58.970045 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:58.970199 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:58.970599 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:58.970609 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:58.970611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:58.971128 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:58.971339 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:58.971886 (+ 547us) server_negotiation.cc:299] Negotiation successful
0807 04:21:58.972225 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1677,"spinlock_wait_cycles":94464,"thread_start_us":1442,"threads_started":1}
WARNING: no policy specified for kudu/127.7.200.253@KRBTEST.COM; defaulting to no policy
I20260807 04:21:58.977020 32229 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.253" port: 39163 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.253@KRBTEST.COM" created.
I20260807 04:21:58.978374 32231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:58.977847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:39163 (local address 127.0.0.1:49702)
0807 04:21:58.978056 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:58.978196 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.253:39163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260807 04:21:58.978662 32174 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.200.253:39163: connect: Connection refused (error 111)
I20260807 04:21:58.980463 32231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:58.980048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:39163 (local address 127.0.0.1:49710)
0807 04:21:58.980242 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:58.980321 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.253:39163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260807 04:21:58.980688 32229 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.253:39163: Network error: Client connection negotiation failed: client connection to 127.7.200.253:39163: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.253.keytab.
Entry for principal kudu/127.7.200.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.253.keytab.
I20260807 04:21:59.019783 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.253:39163
--webserver_interface=127.7.200.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.253.keytab
--principal=kudu/127.7.200.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:34411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:43497,127.7.200.253:39163,127.7.200.252:36989
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 04:21:59.030113 32229 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.253" port: 39163 } attempt: 1
I20260807 04:21:59.031287 32231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.030821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:39163 (local address 127.0.0.1:49722)
0807 04:21:59.031028 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:59.031156 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.253:39163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260807 04:21:59.032609 32231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.032082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:39163 (local address 127.0.0.1:49724)
0807 04:21:59.032286 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:59.032411 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.253:39163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260807 04:21:59.032894 32229 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.253:39163: Network error: Client connection negotiation failed: client connection to 127.7.200.253:39163: connect: Connection refused (error 111)
I20260807 04:21:59.101176 32229 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.253" port: 39163 } attempt: 2
I20260807 04:21:59.102492 32231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.101989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:39163 (local address 127.0.0.1:49738)
0807 04:21:59.102259 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:59.102351 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.253:39163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260807 04:21:59.103454 32231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.103105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:39163 (local address 127.0.0.1:49750)
0807 04:21:59.103243 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:59.103328 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.253:39163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260807 04:21:59.103641 32229 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.253:39163: Network error: Client connection negotiation failed: client connection to 127.7.200.253:39163: connect: Connection refused (error 111)
I20260807 04:21:59.194901 32229 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.253" port: 39163 } attempt: 3
I20260807 04:21:59.196105 32231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.195659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:39163 (local address 127.0.0.1:49762)
0807 04:21:59.195862 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:59.195964 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.253:39163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260807 04:21:59.197160 32231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.196797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:39163 (local address 127.0.0.1:49774)
0807 04:21:59.196942 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:59.197015 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.253:39163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260807 04:21:59.197340 32229 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.253:39163: Network error: Client connection negotiation failed: client connection to 127.7.200.253:39163: connect: Connection refused (error 111)
I20260807 04:21:59.340591 32229 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.253" port: 39163 } attempt: 4
I20260807 04:21:59.341957 32231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.341382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:39163 (local address 127.0.0.1:49780)
0807 04:21:59.341693 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:59.341800 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.253:39163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172}
I20260807 04:21:59.343091 32231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.342638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:39163 (local address 127.0.0.1:49784)
0807 04:21:59.342806 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:59.342898 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.253:39163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 04:21:59.343314 32229 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.253:39163: Network error: Client connection negotiation failed: client connection to 127.7.200.253:39163: connect: Connection refused (error 111)
W20260807 04:21:59.371883 32236 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 04:21:59.372303 32236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:59.372430 32236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:59.372568 32236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:59.380525 32236 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:21:59.380654 32236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:59.380718 32236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:59.380785 32236 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:21:59.380843 32236 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:21:59.391203 32236 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:34411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:43497,127.7.200.253:39163,127.7.200.252:36989
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.253.keytab
--principal=kudu/127.7.200.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.253:39163
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.200.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:59.392668 32236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:59.394090 32236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:59.406275 32241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:59.406293 32242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:59.406796 32244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:59.407186 32236 server_base.cc:1034] running on GCE node
I20260807 04:21:59.408044 32236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:59.409569 32236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:59.410794 32236 hybrid_clock.cc:648] HybridClock initialized: now 1786076519410726 us; error 36 us; skew 500 ppm
I20260807 04:21:59.411141 32236 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:21:59 dist-test-slave-qg60 krb5kdc[32141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076519, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:21:59.414660 32236 init.cc:377] Logged in from keytab as kudu/127.7.200.253@KRBTEST.COM (short username kudu)
I20260807 04:21:59.416188 32236 webserver.cc:460] Webserver started at http://127.7.200.253:46735/ using document root <none> and password file <none>
I20260807 04:21:59.416997 32236 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:59.417119 32236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:59.417455 32236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:59.420746 32236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-1/data/instance:
uuid: "f45bb1e2a15e416884d32f0308ce61c0"
format_stamp: "Formatted at 2026-08-07 04:21:59 on dist-test-slave-qg60"
server_key: "04c3f3e5fb656d5ec5c77504d9c51c20"
server_key_iv: "04b760ea1dc6b27deab6c348b0931be2"
server_key_version: "encryptionkey@0"
I20260807 04:21:59.421753 32236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-1/wal/instance:
uuid: "f45bb1e2a15e416884d32f0308ce61c0"
format_stamp: "Formatted at 2026-08-07 04:21:59 on dist-test-slave-qg60"
server_key: "04c3f3e5fb656d5ec5c77504d9c51c20"
server_key_iv: "04b760ea1dc6b27deab6c348b0931be2"
server_key_version: "encryptionkey@0"
I20260807 04:21:59.427206 32236 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260807 04:21:59.430873 32253 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:59.432356 32236 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 04:21:59.432548 32236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-1/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-1/wal
uuid: "f45bb1e2a15e416884d32f0308ce61c0"
format_stamp: "Formatted at 2026-08-07 04:21:59 on dist-test-slave-qg60"
server_key: "04c3f3e5fb656d5ec5c77504d9c51c20"
server_key_iv: "04b760ea1dc6b27deab6c348b0931be2"
server_key_version: "encryptionkey@0"
I20260807 04:21:59.432821 32236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:59.453275 32236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:21:59.458088 32236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:21:59.458385 32236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:21:59.477279 32236 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.253:39163
I20260807 04:21:59.477303 32308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.253:39163 every 8 connection(s)
I20260807 04:21:59.478646 32236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-1/data/info.pb
I20260807 04:21:59.482393 32309 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:21:59.486048 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 32236
I20260807 04:21:59.486279 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-1/wal/instance
I20260807 04:21:59.486774 7971 external_mini_cluster.cc:1428] Setting key 2ee9d9cfd14f4774efed5f2ef3ef360a
I20260807 04:21:59.489230 32309 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43497 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 04:21:59 dist-test-slave-qg60 krb5kdc[32141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076519, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.253@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:21:59.512087 32311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.491928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34364 (local address 127.7.200.254:43497)
0807 04:21:59.492560 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:59.492570 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:59.493493 (+ 923us) server_negotiation.cc:407] Connection header received
0807 04:21:59.495417 (+ 1924us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:59.495427 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:59.495535 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:59.495694 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:59.497509 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:59.498801 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:59.500321 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:59.501140 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:59.501302 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:59.505601 (+ 4299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:59.505606 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:59.505610 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:59.505656 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:59.508634 (+ 2978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:59.509499 (+ 865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:59.509504 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:59.509507 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:59.509643 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:59.510112 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:59.510123 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:59.510126 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:59.510433 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:59.510622 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:59.511413 (+ 791us) server_negotiation.cc:299] Negotiation successful
0807 04:21:59.511669 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":283,"threads_started":1}
I20260807 04:21:59.513267 32312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.492489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:43497 (local address 127.0.0.1:34364)
0807 04:21:59.493302 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:59.493351 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:59.495119 (+ 1768us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:59.495876 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:59.495884 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:59.496457 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:21:59.497253 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:59.497273 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:59.498967 (+ 1694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:59.498971 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:59.500155 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:59.500167 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:59.501354 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:59.501359 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:59.501563 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:59.502330 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:21:59.502365 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:21:59.505342 (+ 2977us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:21:59.508840 (+ 3498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:59.508849 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:59.508873 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:59.509349 (+ 476us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:59.509763 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:59.509769 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:59.509773 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:59.509978 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:59.510586 (+ 608us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:21:59.510597 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:21:59.510985 (+ 388us) client_negotiation.cc:769] Sending connection context
0807 04:21:59.511284 (+ 299us) client_negotiation.cc:240] Negotiation successful
0807 04:21:59.511857 (+ 573us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":553,"thread_start_us":351,"threads_started":1}
I20260807 04:21:59.515115 32309 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.253" port: 39163 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.7.200.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.7.200.252@KRBTEST.COM" created.
Aug 07 04:21:59 dist-test-slave-qg60 krb5kdc[32141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076519, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.253@KRBTEST.COM for kudu/127.7.200.253@KRBTEST.COM
I20260807 04:21:59.531144 32312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.516095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:39163 (local address 127.0.0.1:49798)
0807 04:21:59.516329 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:59.516352 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:59.516476 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:59.517536 (+ 1060us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:59.517541 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:59.518011 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:21:59.518150 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:59.518159 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:59.519677 (+ 1518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:59.519686 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:59.520670 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:59.520682 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:59.521629 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:59.521635 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:59.521880 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:59.522583 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:21:59.522602 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:21:59.524900 (+ 2298us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:21:59.528304 (+ 3404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:59.528313 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:59.528317 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:59.528722 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:59.529191 (+ 469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:59.529198 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:59.529202 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:59.529361 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:59.529990 (+ 629us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:21:59.530001 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:21:59.530154 (+ 153us) client_negotiation.cc:769] Sending connection context
0807 04:21:59.530307 (+ 153us) client_negotiation.cc:240] Negotiation successful
0807 04:21:59.530625 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61,"mutex_wait_us":5}
I20260807 04:21:59.531186 32314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.516346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49798 (local address 127.7.200.253:39163)
0807 04:21:59.517113 (+ 767us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:59.517119 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:59.517144 (+ 25us) server_negotiation.cc:407] Connection header received
0807 04:21:59.517188 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:59.517193 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:59.517375 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:59.517560 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:59.518333 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:59.519533 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:59.520846 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:59.521474 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:59.521631 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:59.525114 (+ 3483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:59.525125 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:59.525139 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:59.525169 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:59.528165 (+ 2996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:59.528945 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:59.528952 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:59.528954 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:59.529073 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:59.529490 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:59.529495 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:59.529497 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:59.529849 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:59.530100 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:59.530471 (+ 371us) server_negotiation.cc:299] Negotiation successful
0807 04:21:59.530744 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":69,"server-negotiator.queue_time_us":608,"thread_start_us":454,"threads_started":1}
I20260807 04:21:59.533726 32309 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 } has no permanent_uuid. Determining permanent_uuid...
I20260807 04:21:59.535130 32312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.534637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:36989 (local address 127.0.0.1:50318)
0807 04:21:59.534835 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:59.534957 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:36989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260807 04:21:59.535406 32256 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.200.252:36989: connect: Connection refused (error 111)
I20260807 04:21:59.537261 32312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.536846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:36989 (local address 127.0.0.1:50328)
0807 04:21:59.537048 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:59.537133 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:36989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
W20260807 04:21:59.537596 32309 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.252:36989: Network error: Client connection negotiation failed: client connection to 127.7.200.252:36989: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.7.200.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.252.keytab.
Entry for principal kudu/127.7.200.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.252.keytab.
I20260807 04:21:59.564247 7971 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
/tmp/dist-test-taskMk3R5R/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.252:36989
--webserver_interface=127.7.200.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.252.keytab
--principal=kudu/127.7.200.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.7.200.212:34411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.200.254:43497,127.7.200.253:39163,127.7.200.252:36989
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 04:21:59.587049 32309 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 } attempt: 1
I20260807 04:21:59.588312 32312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.587787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:36989 (local address 127.0.0.1:50332)
0807 04:21:59.588026 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:59.588145 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:36989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260807 04:21:59.589457 32312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.589072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:36989 (local address 127.0.0.1:50334)
0807 04:21:59.589255 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:59.589340 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:36989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 04:21:59.589677 32309 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.252:36989: Network error: Client connection negotiation failed: client connection to 127.7.200.252:36989: connect: Connection refused (error 111)
I20260807 04:21:59.642565 32229 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.253" port: 39163 } attempt: 5
Aug 07 04:21:59 dist-test-slave-qg60 krb5kdc[32141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076518, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for kudu/127.7.200.253@KRBTEST.COM
I20260807 04:21:59.657903 32309 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 } attempt: 2
I20260807 04:21:59.659072 32312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.658607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:36989 (local address 127.0.0.1:50348)
0807 04:21:59.658812 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:59.658899 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:36989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260807 04:21:59.660141 32312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.659767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:36989 (local address 127.0.0.1:50352)
0807 04:21:59.659933 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:59.659999 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:36989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 04:21:59.660429 32309 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.252:36989: Network error: Client connection negotiation failed: client connection to 127.7.200.252:36989: connect: Connection refused (error 111)
I20260807 04:21:59.663269 32231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.643315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:39163 (local address 127.0.0.1:49814)
0807 04:21:59.643525 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:59.643549 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 04:21:59.643654 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:21:59.644033 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:21:59.644038 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:21:59.644431 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:21:59.644607 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:59.644617 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:59.646089 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:59.646093 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:59.646966 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:21:59.646979 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:21:59.647973 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:21:59.647978 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:21:59.648158 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:59.653134 (+ 4976us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:21:59.653160 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:21:59.655734 (+ 2574us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:21:59.660647 (+ 4913us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:59.660652 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:59.660655 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:59.661123 (+ 468us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:59.661573 (+ 450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:21:59.661578 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:21:59.661580 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:21:59.661755 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:21:59.662422 (+ 667us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:21:59.662428 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:21:59.662603 (+ 175us) client_negotiation.cc:769] Sending connection context
0807 04:21:59.662726 (+ 123us) client_negotiation.cc:240] Negotiation successful
0807 04:21:59.663036 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260807 04:21:59.663383 32314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.643416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49814 (local address 127.7.200.253:39163)
0807 04:21:59.643635 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 04:21:59.643643 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:21:59.643675 (+ 32us) server_negotiation.cc:407] Connection header received
0807 04:21:59.643777 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:21:59.643785 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:21:59.643881 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:21:59.644010 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:21:59.644793 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:59.645918 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:59.647132 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:21:59.647791 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:21:59.647918 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:21:59.656015 (+ 8097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:21:59.656025 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:21:59.656033 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:21:59.656089 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:21:59.660497 (+ 4408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:59.661246 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:59.661251 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:59.661254 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:59.661422 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:21:59.661878 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:21:59.661882 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:21:59.661886 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:21:59.662268 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:21:59.662434 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0807 04:21:59.662870 (+ 436us) server_negotiation.cc:299] Negotiation successful
0807 04:21:59.663105 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 04:21:59.664354 32229 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 } has no permanent_uuid. Determining permanent_uuid...
I20260807 04:21:59.665469 32231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.665115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:36989 (local address 127.0.0.1:50368)
0807 04:21:59.665259 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:59.665333 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:36989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260807 04:21:59.666388 32231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.666086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:36989 (local address 127.0.0.1:50372)
0807 04:21:59.666219 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:59.666297 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:36989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260807 04:21:59.666697 32229 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.252:36989: Network error: Client connection negotiation failed: client connection to 127.7.200.252:36989: connect: Connection refused (error 111)
I20260807 04:21:59.717983 32229 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 } attempt: 1
I20260807 04:21:59.719354 32231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.718819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:36989 (local address 127.0.0.1:50376)
0807 04:21:59.719072 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:59.719166 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:36989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260807 04:21:59.720407 32231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.720096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:36989 (local address 127.0.0.1:50382)
0807 04:21:59.720229 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:59.720302 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:36989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 04:21:59.720651 32229 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.252:36989: Network error: Client connection negotiation failed: client connection to 127.7.200.252:36989: connect: Connection refused (error 111)
I20260807 04:21:59.751688 32309 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 } attempt: 3
I20260807 04:21:59.753121 32312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.752533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:36989 (local address 127.0.0.1:50398)
0807 04:21:59.752783 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:59.752888 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:36989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260807 04:21:59.754257 32312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.753804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:36989 (local address 127.0.0.1:50408)
0807 04:21:59.754045 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:59.754143 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:36989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138}
W20260807 04:21:59.754508 32309 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.252:36989: Network error: Client connection negotiation failed: client connection to 127.7.200.252:36989: connect: Connection refused (error 111)
I20260807 04:21:59.788986 32229 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 } attempt: 2
I20260807 04:21:59.790414 32231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.789848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:36989 (local address 127.0.0.1:50414)
0807 04:21:59.790124 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:59.790220 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:36989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260807 04:21:59.791601 32231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.791193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:36989 (local address 127.0.0.1:50418)
0807 04:21:59.791391 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:59.791483 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:36989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260807 04:21:59.791952 32229 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.252:36989: Network error: Client connection negotiation failed: client connection to 127.7.200.252:36989: connect: Connection refused (error 111)
I20260807 04:21:59.897768 32309 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 } attempt: 4
I20260807 04:21:59.898192 32229 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 } attempt: 3
I20260807 04:21:59.899255 32312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.898646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:36989 (local address 127.0.0.1:50422)
0807 04:21:59.898933 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:59.899048 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:36989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260807 04:21:59.899468 32231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.898885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:36989 (local address 127.0.0.1:50424)
0807 04:21:59.899149 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:59.899252 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:36989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260807 04:21:59.900579 32312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.900196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:36989 (local address 127.0.0.1:50456)
0807 04:21:59.900367 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:59.900454 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:36989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260807 04:21:59.900700 32231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:21:59.900170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:36989 (local address 127.0.0.1:50440)
0807 04:21:59.900471 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0807 04:21:59.900565 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.200.252:36989: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187}
W20260807 04:21:59.900899 32309 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.252:36989: Network error: Client connection negotiation failed: client connection to 127.7.200.252:36989: connect: Connection refused (error 111)
W20260807 04:21:59.900943 32229 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.200.252:36989: Network error: Client connection negotiation failed: client connection to 127.7.200.252:36989: connect: Connection refused (error 111)
W20260807 04:21:59.922715 32317 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 04:21:59.923136 32317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 04:21:59.923262 32317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 04:21:59.923404 32317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 04:21:59.931190 32317 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 04:21:59.931315 32317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 04:21:59.931434 32317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 04:21:59.931519 32317 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 04:21:59.931630 32317 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 04:21:59.942588 32317 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.200.212:34411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.7.200.254:43497,127.7.200.253:39163,127.7.200.252:36989
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/krb5kdc/kudu_127.7.200.252.keytab
--principal=kudu/127.7.200.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.200.252:36989
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.200.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 02:54:14 UTC on ccycloud.quasar-eedayb.root.comops.site
build id 4571743
ASAN enabled
I20260807 04:21:59.943908 32317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 04:21:59.945287 32317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 04:21:59.957459 32322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:59.957567 32326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 04:21:59.960997 32324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 04:21:59.962244 32317 server_base.cc:1034] running on GCE node
I20260807 04:21:59.963105 32317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 04:21:59.964576 32317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 04:21:59.965852 32317 hybrid_clock.cc:648] HybridClock initialized: now 1786076519965780 us; error 81 us; skew 500 ppm
I20260807 04:21:59.966262 32317 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 04:21:59 dist-test-slave-qg60 krb5kdc[32141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076519, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 04:21:59.969594 32317 init.cc:377] Logged in from keytab as kudu/127.7.200.252@KRBTEST.COM (short username kudu)
I20260807 04:21:59.971133 32317 webserver.cc:460] Webserver started at http://127.7.200.252:40405/ using document root <none> and password file <none>
I20260807 04:21:59.971815 32317 fs_manager.cc:359] Metadata directory not provided
I20260807 04:21:59.971907 32317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 04:21:59.972177 32317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 04:21:59.975188 32317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-2/data/instance:
uuid: "255557e753f44d8f8b289e1a9733a8d8"
format_stamp: "Formatted at 2026-08-07 04:21:59 on dist-test-slave-qg60"
server_key: "36c40b1011e99614be5e20f541b47abc"
server_key_iv: "ff470a64a8048e4d37b67196fbaefa91"
server_key_version: "encryptionkey@0"
I20260807 04:21:59.975942 32317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-2/wal/instance:
uuid: "255557e753f44d8f8b289e1a9733a8d8"
format_stamp: "Formatted at 2026-08-07 04:21:59 on dist-test-slave-qg60"
server_key: "36c40b1011e99614be5e20f541b47abc"
server_key_iv: "ff470a64a8048e4d37b67196fbaefa91"
server_key_version: "encryptionkey@0"
I20260807 04:21:59.981411 32317 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260807 04:21:59.984798 32333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 04:21:59.986210 32317 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 04:21:59.986387 32317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-2/data,/tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-2/wal
uuid: "255557e753f44d8f8b289e1a9733a8d8"
format_stamp: "Formatted at 2026-08-07 04:21:59 on dist-test-slave-qg60"
server_key: "36c40b1011e99614be5e20f541b47abc"
server_key_iv: "ff470a64a8048e4d37b67196fbaefa91"
server_key_version: "encryptionkey@0"
I20260807 04:21:59.986608 32317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 04:21:59.998500 32317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 04:22:00.003518 32317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 04:22:00.003913 32317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 04:22:00.024083 32317 rpc_server.cc:307] RPC server started. Bound to: 127.7.200.252:36989
I20260807 04:22:00.024106 32389 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.200.252:36989 every 8 connection(s)
I20260807 04:22:00.025592 32317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-2/data/info.pb
I20260807 04:22:00.029654 7971 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu as pid 32317
I20260807 04:22:00.029706 32390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 04:22:00.029867 7971 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskMk3R5R/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786076137270840-7971-0/minicluster-data/master-2/wal/instance
I20260807 04:22:00.030336 7971 external_mini_cluster.cc:1428] Setting key 1cee213a3bc3bc3e94740adf6b9e5096
I20260807 04:22:00.039724 32390 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43497 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 04:22:00 dist-test-slave-qg60 krb5kdc[32141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076518, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.252@KRBTEST.COM
Aug 07 04:22:00 dist-test-slave-qg60 krb5kdc[32141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076519, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.252@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
I20260807 04:22:00.055250 32393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:00.032146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50466 (local address 127.7.200.252:36989)
0807 04:22:00.033054 (+ 908us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.033069 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.033111 (+ 42us) server_negotiation.cc:407] Connection header received
0807 04:22:00.034604 (+ 1493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.034624 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.035034 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.035362 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:22:00.037491 (+ 2129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.039092 (+ 1601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.040992 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.041663 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.041803 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:00.047073 (+ 5270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:22:00.047081 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:22:00.047092 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:22:00.047134 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:22:00.050691 (+ 3557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:22:00.051519 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:22:00.051531 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:22:00.051544 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:22:00.051745 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:22:00.052218 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:22:00.052223 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:22:00.052227 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:22:00.052937 (+ 710us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:22:00.053171 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0807 04:22:00.053636 (+ 465us) server_negotiation.cc:299] Negotiation successful
0807 04:22:00.054119 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":698,"thread_start_us":419,"threads_started":1}
I20260807 04:22:00.059353 32394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:00.042648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.254:43497 (local address 127.0.0.1:34374)
0807 04:22:00.043512 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0807 04:22:00.043569 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 04:22:00.043765 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:22:00.044565 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:22:00.044569 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:22:00.045269 (+ 700us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:22:00.045529 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:22:00.045538 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.046689 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.046695 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:22:00.048128 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:22:00.048141 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.049228 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.049233 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:22:00.049361 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:00.049962 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:22:00.049979 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:22:00.052634 (+ 2655us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:22:00.056261 (+ 3627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:22:00.056271 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:22:00.056276 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:22:00.056853 (+ 577us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:22:00.057250 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:22:00.057255 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:22:00.057259 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:22:00.057472 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:22:00.058102 (+ 630us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:22:00.058110 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:22:00.058318 (+ 208us) client_negotiation.cc:769] Sending connection context
0807 04:22:00.058539 (+ 221us) client_negotiation.cc:240] Negotiation successful
0807 04:22:00.058938 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":329,"threads_started":1}
I20260807 04:22:00.059700 32395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:00.042679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34374 (local address 127.7.200.254:43497)
0807 04:22:00.044134 (+ 1455us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.044140 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.044163 (+ 23us) server_negotiation.cc:407] Connection header received
0807 04:22:00.044232 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.044241 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.044347 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.044475 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:22:00.045688 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.046523 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.048296 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.049011 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.049169 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:00.052869 (+ 3700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:22:00.052875 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:22:00.052878 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:22:00.052916 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:22:00.056121 (+ 3205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:22:00.056974 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:22:00.056979 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:22:00.056983 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:22:00.057133 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:22:00.057631 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:22:00.057637 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:22:00.057640 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:22:00.057957 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:22:00.058168 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0807 04:22:00.059008 (+ 840us) server_negotiation.cc:299] Negotiation successful
0807 04:22:00.059250 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1274,"thread_start_us":1112,"threads_started":1}
I20260807 04:22:00.061232 32390 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.253" port: 39163 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 04:22:00 dist-test-slave-qg60 krb5kdc[32141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076518, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.254@KRBTEST.COM
Aug 07 04:22:00 dist-test-slave-qg60 krb5kdc[32141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076519, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.252@KRBTEST.COM for kudu/127.7.200.253@KRBTEST.COM
I20260807 04:22:00.074596 32396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:00.058427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34390 (local address 127.7.200.254:43497)
0807 04:22:00.059069 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.059073 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.059092 (+ 19us) server_negotiation.cc:407] Connection header received
0807 04:22:00.059131 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.059134 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.059199 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.059316 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:22:00.060849 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.061988 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.063270 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.063714 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.063847 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:00.067963 (+ 4116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:22:00.067968 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:22:00.067972 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:22:00.068002 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:22:00.071067 (+ 3065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:22:00.071729 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:22:00.071736 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:22:00.071739 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:22:00.071880 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:22:00.072241 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:22:00.072247 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:22:00.072250 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:22:00.072521 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:22:00.072827 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0807 04:22:00.073939 (+ 1112us) server_negotiation.cc:299] Negotiation successful
0807 04:22:00.074165 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":502,"thread_start_us":301,"threads_started":1}
I20260807 04:22:00.074949 32394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:00.061982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.253:39163 (local address 127.0.0.1:49824)
0807 04:22:00.062298 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0807 04:22:00.062311 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 04:22:00.062433 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:22:00.062746 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:22:00.062750 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:22:00.063144 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:22:00.063287 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:22:00.063295 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.064240 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.064246 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:22:00.065420 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:22:00.065433 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.066157 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.066162 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:22:00.066336 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:00.066869 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:22:00.066885 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:22:00.069032 (+ 2147us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:22:00.072011 (+ 2979us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:22:00.072018 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:22:00.072023 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:22:00.072386 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:22:00.072872 (+ 486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:22:00.072877 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:22:00.072881 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:22:00.073086 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:22:00.073900 (+ 814us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:22:00.073937 (+ 37us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:22:00.074126 (+ 189us) client_negotiation.cc:769] Sending connection context
0807 04:22:00.074316 (+ 190us) client_negotiation.cc:240] Negotiation successful
0807 04:22:00.074608 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227}
I20260807 04:22:00.075593 32314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:00.062016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49824 (local address 127.7.200.253:39163)
0807 04:22:00.062206 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.062214 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.062380 (+ 166us) server_negotiation.cc:407] Connection header received
0807 04:22:00.062551 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.062557 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.062627 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.062723 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:22:00.063425 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.064101 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.065578 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.065997 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.066128 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:00.069224 (+ 3096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:22:00.069229 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:22:00.069232 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:22:00.069291 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:22:00.071870 (+ 2579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:22:00.072500 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:22:00.072505 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:22:00.072508 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:22:00.072704 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:22:00.073221 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:22:00.073228 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:22:00.073231 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:22:00.073587 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:22:00.073758 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0807 04:22:00.074480 (+ 722us) server_negotiation.cc:299] Negotiation successful
0807 04:22:00.074822 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 04:22:00.076526 32390 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 } has no permanent_uuid. Determining permanent_uuid...
I20260807 04:22:00.078150 32229 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 } attempt: 4
Aug 07 04:22:00 dist-test-slave-qg60 krb5kdc[32141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076519, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.252@KRBTEST.COM for kudu/127.7.200.252@KRBTEST.COM
Aug 07 04:22:00 dist-test-slave-qg60 krb5kdc[32141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076518, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.7.200.253@KRBTEST.COM
Aug 07 04:22:00 dist-test-slave-qg60 krb5kdc[32141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076518, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.254@KRBTEST.COM for kudu/127.7.200.252@KRBTEST.COM
I20260807 04:22:00.095010 32394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:00.077489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:36989 (local address 127.0.0.1:50478)
0807 04:22:00.077645 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 04:22:00.077667 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 04:22:00.077784 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:22:00.078170 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:22:00.078174 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:22:00.078681 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:22:00.078909 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:22:00.078926 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.080414 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.080423 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:22:00.081943 (+ 1520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:22:00.081955 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.082955 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.082960 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:22:00.083153 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:00.083849 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:22:00.083880 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:22:00.087843 (+ 3963us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:22:00.092201 (+ 4358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:22:00.092206 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:22:00.092209 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:22:00.092566 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:22:00.092958 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:22:00.092963 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:22:00.092966 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:22:00.093172 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:22:00.093844 (+ 672us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:22:00.093849 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:22:00.094040 (+ 191us) client_negotiation.cc:769] Sending connection context
0807 04:22:00.094235 (+ 195us) client_negotiation.cc:240] Negotiation successful
0807 04:22:00.094575 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":6,"spinlock_wait_cycles":23936}
I20260807 04:22:00.095319 32393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:00.077428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50478 (local address 127.7.200.252:36989)
0807 04:22:00.077592 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.077597 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.077723 (+ 126us) server_negotiation.cc:407] Connection header received
0807 04:22:00.077909 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.077916 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.078007 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.078111 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:22:00.079090 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.080247 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.082071 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.082638 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.082767 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:00.088029 (+ 5262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:22:00.088035 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:22:00.088045 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:22:00.088087 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:22:00.092077 (+ 3990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:22:00.092685 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:22:00.092691 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:22:00.092694 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:22:00.092863 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:22:00.093302 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:22:00.093310 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:22:00.093315 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:22:00.093664 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:22:00.093794 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 04:22:00.094332 (+ 538us) server_negotiation.cc:299] Negotiation successful
0807 04:22:00.094934 (+ 602us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":167,"server-negotiator.queue_time_us":46}
I20260807 04:22:00.095096 32231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:00.078674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:36989 (local address 127.0.0.1:50494)
0807 04:22:00.079164 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0807 04:22:00.079183 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 04:22:00.079289 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:22:00.079708 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:22:00.079715 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:22:00.080151 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:22:00.080291 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:22:00.080300 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.081924 (+ 1624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.081930 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:22:00.083224 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:22:00.083239 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.084118 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.084124 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:22:00.084316 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:00.084914 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:22:00.084932 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:22:00.087735 (+ 2803us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:22:00.092210 (+ 4475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:22:00.092215 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:22:00.092219 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:22:00.092788 (+ 569us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:22:00.093302 (+ 514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:22:00.093307 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:22:00.093311 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:22:00.093473 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:22:00.094084 (+ 611us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:22:00.094089 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:22:00.094279 (+ 190us) client_negotiation.cc:769] Sending connection context
0807 04:22:00.094440 (+ 161us) client_negotiation.cc:240] Negotiation successful
0807 04:22:00.094723 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346}
I20260807 04:22:00.095448 32314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:00.076825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49838 (local address 127.7.200.253:39163)
0807 04:22:00.076982 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.077046 (+ 64us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.077069 (+ 23us) server_negotiation.cc:407] Connection header received
0807 04:22:00.077208 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.077216 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.077297 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.077395 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:22:00.079190 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.080247 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.081638 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.082232 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.082364 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:00.087766 (+ 5402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:22:00.087776 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:22:00.087783 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:22:00.087830 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:22:00.091669 (+ 3839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:22:00.092576 (+ 907us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:22:00.092582 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:22:00.092585 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:22:00.092786 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:22:00.093230 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:22:00.093235 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:22:00.093238 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:22:00.093623 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:22:00.093897 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0807 04:22:00.094850 (+ 953us) server_negotiation.cc:299] Negotiation successful
0807 04:22:00.095108 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 04:22:00.096362 32397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:00.078713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50494 (local address 127.7.200.252:36989)
0807 04:22:00.079445 (+ 732us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.079451 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.079469 (+ 18us) server_negotiation.cc:407] Connection header received
0807 04:22:00.079514 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.079518 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.079569 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.079674 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:22:00.080458 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.081782 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.083372 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.083963 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.084100 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:00.087970 (+ 3870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:22:00.087977 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:22:00.087981 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:22:00.088021 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:22:00.092050 (+ 4029us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:22:00.092956 (+ 906us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:22:00.092960 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:22:00.092963 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:22:00.093156 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:22:00.093603 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:22:00.093606 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:22:00.093608 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:22:00.093953 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:22:00.094107 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 04:22:00.095776 (+ 1669us) server_negotiation.cc:299] Negotiation successful
0807 04:22:00.095983 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":600,"spinlock_wait_cycles":29952,"thread_start_us":613,"threads_started":1}
I20260807 04:22:00.100648 7971 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 04:22:00.101125 32229 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 042ddca9edfc4a8b84753b675d49f944: Bootstrap starting.
I20260807 04:22:00.101454 32390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 255557e753f44d8f8b289e1a9733a8d8: Bootstrap starting.
I20260807 04:22:00.104364 32229 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 042ddca9edfc4a8b84753b675d49f944: Neither blocks nor log segments found. Creating new log.
I20260807 04:22:00.105050 32390 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 255557e753f44d8f8b289e1a9733a8d8: Neither blocks nor log segments found. Creating new log.
I20260807 04:22:00.105684 32229 log.cc:824] T 00000000000000000000000000000000 P 042ddca9edfc4a8b84753b675d49f944: Log is configured to *not* fsync() on all Append() calls
I20260807 04:22:00.106264 32390 log.cc:824] T 00000000000000000000000000000000 P 255557e753f44d8f8b289e1a9733a8d8: Log is configured to *not* fsync() on all Append() calls
I20260807 04:22:00.103899 32203 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "042ddca9edfc4a8b84753b675d49f944"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34390
I20260807 04:22:00.109233 32390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 255557e753f44d8f8b289e1a9733a8d8: No bootstrap required, opened a new log
I20260807 04:22:00.109360 32229 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 042ddca9edfc4a8b84753b675d49f944: No bootstrap required, opened a new log
I20260807 04:22:00.114434 32229 raft_consensus.cc:348] T 00000000000000000000000000000000 P 042ddca9edfc4a8b84753b675d49f944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "042ddca9edfc4a8b84753b675d49f944" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43497 } } peers { permanent_uuid: "f45bb1e2a15e416884d32f0308ce61c0" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 39163 } } peers { permanent_uuid: "255557e753f44d8f8b289e1a9733a8d8" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 } }
I20260807 04:22:00.114768 32229 raft_consensus.cc:729] T 00000000000000000000000000000000 P 042ddca9edfc4a8b84753b675d49f944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 042ddca9edfc4a8b84753b675d49f944, State: Initialized, Role: FOLLOWER
I20260807 04:22:00.115278 32229 consensus_queue.cc:260] T 00000000000000000000000000000000 P 042ddca9edfc4a8b84753b675d49f944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "042ddca9edfc4a8b84753b675d49f944" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43497 } } peers { permanent_uuid: "f45bb1e2a15e416884d32f0308ce61c0" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 39163 } } peers { permanent_uuid: "255557e753f44d8f8b289e1a9733a8d8" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 } }
I20260807 04:22:00.116277 32400 sys_catalog.cc:455] T 00000000000000000000000000000000 P 042ddca9edfc4a8b84753b675d49f944 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "042ddca9edfc4a8b84753b675d49f944" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43497 } } peers { permanent_uuid: "f45bb1e2a15e416884d32f0308ce61c0" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 39163 } } peers { permanent_uuid: "255557e753f44d8f8b289e1a9733a8d8" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 } } }
I20260807 04:22:00.116693 32400 sys_catalog.cc:458] T 00000000000000000000000000000000 P 042ddca9edfc4a8b84753b675d49f944 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 04:22:00.117532 32229 sys_catalog.cc:564] T 00000000000000000000000000000000 P 042ddca9edfc4a8b84753b675d49f944 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:22:00.117720 32203 raft_consensus.cc:482] T 00000000000000000000000000000000 P 042ddca9edfc4a8b84753b675d49f944 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 04:22:00.117980 32203 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 042ddca9edfc4a8b84753b675d49f944 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:22:00.119871 32390 raft_consensus.cc:348] T 00000000000000000000000000000000 P 255557e753f44d8f8b289e1a9733a8d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "042ddca9edfc4a8b84753b675d49f944" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43497 } } peers { permanent_uuid: "f45bb1e2a15e416884d32f0308ce61c0" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 39163 } } peers { permanent_uuid: "255557e753f44d8f8b289e1a9733a8d8" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 } }
I20260807 04:22:00.120312 32390 raft_consensus.cc:729] T 00000000000000000000000000000000 P 255557e753f44d8f8b289e1a9733a8d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 255557e753f44d8f8b289e1a9733a8d8, State: Initialized, Role: FOLLOWER
I20260807 04:22:00.120865 32390 consensus_queue.cc:260] T 00000000000000000000000000000000 P 255557e753f44d8f8b289e1a9733a8d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "042ddca9edfc4a8b84753b675d49f944" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43497 } } peers { permanent_uuid: "f45bb1e2a15e416884d32f0308ce61c0" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 39163 } } peers { permanent_uuid: "255557e753f44d8f8b289e1a9733a8d8" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 } }
I20260807 04:22:00.122188 32203 raft_consensus.cc:504] T 00000000000000000000000000000000 P 042ddca9edfc4a8b84753b675d49f944 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "042ddca9edfc4a8b84753b675d49f944" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43497 } } peers { permanent_uuid: "f45bb1e2a15e416884d32f0308ce61c0" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 39163 } } peers { permanent_uuid: "255557e753f44d8f8b289e1a9733a8d8" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 } }
I20260807 04:22:00.125552 32203 leader_election.cc:288] T 00000000000000000000000000000000 P 042ddca9edfc4a8b84753b675d49f944 [CANDIDATE]: Term 1 election: Requested vote from peers f45bb1e2a15e416884d32f0308ce61c0 (127.7.200.253:39163), 255557e753f44d8f8b289e1a9733a8d8 (127.7.200.252:36989)
I20260807 04:22:00.128263 32155 master_runner.cc:186] Error getting master registration for 127.7.200.253:39163: OK, instance_id { permanent_uuid: "f45bb1e2a15e416884d32f0308ce61c0" instance_seqno: 1786076519471819 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 04:22:00.141623 32155 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 04:22:00.141847 32412 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 042ddca9edfc4a8b84753b675d49f944: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260807 04:22:00.142464 32407 sys_catalog.cc:455] T 00000000000000000000000000000000 P 255557e753f44d8f8b289e1a9733a8d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "042ddca9edfc4a8b84753b675d49f944" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43497 } } peers { permanent_uuid: "f45bb1e2a15e416884d32f0308ce61c0" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 39163 } } peers { permanent_uuid: "255557e753f44d8f8b289e1a9733a8d8" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 } } }
I20260807 04:22:00.142975 32407 sys_catalog.cc:458] T 00000000000000000000000000000000 P 255557e753f44d8f8b289e1a9733a8d8 [sys.catalog]: This master's current role is: FOLLOWER
W20260807 04:22:00.143168 32412 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 04:22:00.143299 32390 sys_catalog.cc:564] T 00000000000000000000000000000000 P 255557e753f44d8f8b289e1a9733a8d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:22:00.143457 32364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "042ddca9edfc4a8b84753b675d49f944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "255557e753f44d8f8b289e1a9733a8d8"
I20260807 04:22:00.144084 32364 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 255557e753f44d8f8b289e1a9733a8d8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:22:00.148221 32364 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 255557e753f44d8f8b289e1a9733a8d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 042ddca9edfc4a8b84753b675d49f944 in term 1.
I20260807 04:22:00.148985 32176 leader_election.cc:302] T 00000000000000000000000000000000 P 042ddca9edfc4a8b84753b675d49f944 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 042ddca9edfc4a8b84753b675d49f944, 255557e753f44d8f8b289e1a9733a8d8; no voters:
I20260807 04:22:00.149567 32400 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 042ddca9edfc4a8b84753b675d49f944 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 04:22:00.161965 32400 raft_consensus.cc:686] T 00000000000000000000000000000000 P 042ddca9edfc4a8b84753b675d49f944 [term 1 LEADER]: Becoming Leader. State: Replica: 042ddca9edfc4a8b84753b675d49f944, State: Running, Role: LEADER
I20260807 04:22:00.163255 32400 consensus_queue.cc:237] T 00000000000000000000000000000000 P 042ddca9edfc4a8b84753b675d49f944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "042ddca9edfc4a8b84753b675d49f944" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43497 } } peers { permanent_uuid: "f45bb1e2a15e416884d32f0308ce61c0" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 39163 } } peers { permanent_uuid: "255557e753f44d8f8b289e1a9733a8d8" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 } }
W20260807 04:22:00.165866 32179 tablet.cc:2369] T 00000000000000000000000000000000 P 042ddca9edfc4a8b84753b675d49f944: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 04:22:00.170418 32424 sys_catalog.cc:455] T 00000000000000000000000000000000 P 042ddca9edfc4a8b84753b675d49f944 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 042ddca9edfc4a8b84753b675d49f944. Latest consensus state: current_term: 1 leader_uuid: "042ddca9edfc4a8b84753b675d49f944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "042ddca9edfc4a8b84753b675d49f944" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43497 } } peers { permanent_uuid: "f45bb1e2a15e416884d32f0308ce61c0" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 39163 } } peers { permanent_uuid: "255557e753f44d8f8b289e1a9733a8d8" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 } } }
I20260807 04:22:00.171485 32424 sys_catalog.cc:458] T 00000000000000000000000000000000 P 042ddca9edfc4a8b84753b675d49f944 [sys.catalog]: This master's current role is: LEADER
I20260807 04:22:00.173417 32397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:00.148690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50506 (local address 127.7.200.252:36989)
0807 04:22:00.148957 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.148966 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.149541 (+ 575us) server_negotiation.cc:407] Connection header received
0807 04:22:00.149860 (+ 319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.149868 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.149977 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.150058 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:22:00.155210 (+ 5152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.156530 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.158680 (+ 2150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.159336 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.159436 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:00.163280 (+ 3844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:22:00.163286 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:22:00.163291 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:22:00.163332 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:22:00.167193 (+ 3861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:22:00.169252 (+ 2059us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:22:00.169258 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:22:00.169262 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:22:00.169417 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:22:00.171389 (+ 1972us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:22:00.171394 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:22:00.171398 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:22:00.171791 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:22:00.172047 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0807 04:22:00.172783 (+ 736us) server_negotiation.cc:299] Negotiation successful
0807 04:22:00.173039 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260807 04:22:00.185408 32435 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 04:22:00.187250 32396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:00.151103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34406 (local address 127.7.200.254:43497)
0807 04:22:00.151307 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.151313 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.156094 (+ 4781us) server_negotiation.cc:407] Connection header received
0807 04:22:00.159457 (+ 3363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.159467 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.159570 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.159661 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:22:00.165497 (+ 5836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.166591 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.174494 (+ 7903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.175294 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.175431 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:00.179642 (+ 4211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:22:00.179649 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:22:00.179654 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:22:00.179695 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:22:00.183635 (+ 3940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:22:00.184505 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:22:00.184512 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:22:00.184518 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:22:00.184676 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:22:00.185223 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:22:00.185228 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:22:00.185232 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:22:00.185717 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:22:00.185986 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0807 04:22:00.186600 (+ 614us) server_negotiation.cc:299] Negotiation successful
0807 04:22:00.186856 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 04:22:00.193070 32433 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 04:22:00.195353 32433 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 04:22:00.198028 32314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:00.149816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49848 (local address 127.7.200.253:39163)
0807 04:22:00.150030 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.150040 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.154217 (+ 4177us) server_negotiation.cc:407] Connection header received
0807 04:22:00.156228 (+ 2011us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.156236 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.156326 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.156399 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:22:00.169595 (+ 13196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.170799 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.177292 (+ 6493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.178217 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.178348 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:00.189677 (+ 11329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:22:00.189701 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:22:00.189707 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:22:00.189761 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:22:00.193829 (+ 4068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:22:00.195233 (+ 1404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:22:00.195239 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:22:00.195243 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:22:00.195424 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:22:00.196086 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:22:00.196093 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:22:00.196096 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:22:00.196490 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:22:00.196781 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0807 04:22:00.197387 (+ 606us) server_negotiation.cc:299] Negotiation successful
0807 04:22:00.197633 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 04:22:00.200156 32309 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 } attempt: 5
I20260807 04:22:00.205225 32364 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 255557e753f44d8f8b289e1a9733a8d8 [term 1 FOLLOWER]: Refusing update from remote peer 042ddca9edfc4a8b84753b675d49f944: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:22:00.193547 32317 master_runner.cc:186] Error getting master registration for 127.7.200.253:39163: OK, instance_id { permanent_uuid: "f45bb1e2a15e416884d32f0308ce61c0" instance_seqno: 1786076519471819 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 04:22:00.206178 32317 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 04:22:00.206274 32424 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 042ddca9edfc4a8b84753b675d49f944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "255557e753f44d8f8b289e1a9733a8d8" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Aug 07 04:22:00 dist-test-slave-qg60 krb5kdc[32141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786076519, etypes {rep=17 tkt=17 ses=17}, kudu/127.7.200.253@KRBTEST.COM for kudu/127.7.200.252@KRBTEST.COM
I20260807 04:22:00.216486 32407 sys_catalog.cc:455] T 00000000000000000000000000000000 P 255557e753f44d8f8b289e1a9733a8d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 042ddca9edfc4a8b84753b675d49f944. Latest consensus state: current_term: 1 leader_uuid: "042ddca9edfc4a8b84753b675d49f944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "042ddca9edfc4a8b84753b675d49f944" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43497 } } peers { permanent_uuid: "f45bb1e2a15e416884d32f0308ce61c0" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 39163 } } peers { permanent_uuid: "255557e753f44d8f8b289e1a9733a8d8" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 } } }
I20260807 04:22:00.216851 32407 sys_catalog.cc:458] T 00000000000000000000000000000000 P 255557e753f44d8f8b289e1a9733a8d8 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 04:22:00.221832 32400 sys_catalog.cc:455] T 00000000000000000000000000000000 P 042ddca9edfc4a8b84753b675d49f944 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "042ddca9edfc4a8b84753b675d49f944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "042ddca9edfc4a8b84753b675d49f944" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43497 } } peers { permanent_uuid: "f45bb1e2a15e416884d32f0308ce61c0" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 39163 } } peers { permanent_uuid: "255557e753f44d8f8b289e1a9733a8d8" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 } } }
I20260807 04:22:00.222205 32400 sys_catalog.cc:458] T 00000000000000000000000000000000 P 042ddca9edfc4a8b84753b675d49f944 [sys.catalog]: This master's current role is: LEADER
I20260807 04:22:00.222276 32438 mvcc.cc:205] Tried to move back new op lower bound from 7315769426748231680 to 7315769426602033152. Current Snapshot: MvccSnapshot[applied={T|T < 7315769426748231680}]
I20260807 04:22:00.225912 32312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:00.200709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.200.252:36989 (local address 127.0.0.1:50520)
0807 04:22:00.200982 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0807 04:22:00.201000 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 04:22:00.201117 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 04:22:00.201661 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 04:22:00.201666 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 04:22:00.202178 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0807 04:22:00.202384 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:22:00.202399 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.204071 (+ 1672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.204077 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:22:00.205546 (+ 1469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 04:22:00.205561 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.206580 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.206586 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 04:22:00.206856 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:00.207583 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 04:22:00.207607 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 04:22:00.210541 (+ 2934us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 04:22:00.219658 (+ 9117us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:22:00.219666 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:22:00.219670 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:22:00.220320 (+ 650us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:22:00.223264 (+ 2944us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 04:22:00.223273 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 04:22:00.223279 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 04:22:00.223534 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 04:22:00.224608 (+ 1074us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 04:22:00.224616 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 04:22:00.224873 (+ 257us) client_negotiation.cc:769] Sending connection context
0807 04:22:00.225068 (+ 195us) client_negotiation.cc:240] Negotiation successful
0807 04:22:00.225514 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161}
I20260807 04:22:00.227690 32397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:00.200813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50520 (local address 127.7.200.252:36989)
0807 04:22:00.200984 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.200991 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.201063 (+ 72us) server_negotiation.cc:407] Connection header received
0807 04:22:00.201232 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.201237 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.201323 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.201433 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:22:00.202820 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.203921 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.205703 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.206418 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.206568 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:00.210811 (+ 4243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 04:22:00.210818 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 04:22:00.210827 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 04:22:00.210867 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 04:22:00.219513 (+ 8646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:22:00.222829 (+ 3316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:22:00.222838 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:22:00.222845 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:22:00.223070 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 04:22:00.223725 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 04:22:00.223733 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 04:22:00.223739 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 04:22:00.224240 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 04:22:00.226634 (+ 2394us) server_negotiation.cc:1035] Waiting for connection context
0807 04:22:00.226778 (+ 144us) server_negotiation.cc:299] Negotiation successful
0807 04:22:00.227114 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 04:22:00.228348 32433 catalog_manager.cc:1347] Generated new cluster ID: e002549b1d674aaeb5a0bdd0d92a2fdb
I20260807 04:22:00.228456 32433 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 04:22:00.234066 32309 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f45bb1e2a15e416884d32f0308ce61c0: Bootstrap starting.
I20260807 04:22:00.238055 32407 sys_catalog.cc:455] T 00000000000000000000000000000000 P 255557e753f44d8f8b289e1a9733a8d8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "042ddca9edfc4a8b84753b675d49f944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "042ddca9edfc4a8b84753b675d49f944" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43497 } } peers { permanent_uuid: "f45bb1e2a15e416884d32f0308ce61c0" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 39163 } } peers { permanent_uuid: "255557e753f44d8f8b289e1a9733a8d8" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 } } }
I20260807 04:22:00.238340 32407 sys_catalog.cc:458] T 00000000000000000000000000000000 P 255557e753f44d8f8b289e1a9733a8d8 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 04:22:00.240415 32309 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f45bb1e2a15e416884d32f0308ce61c0: Neither blocks nor log segments found. Creating new log.
I20260807 04:22:00.241899 32433 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 04:22:00.243788 32433 catalog_manager.cc:1504] Loading token signing keys...
I20260807 04:22:00.243769 32309 log.cc:824] T 00000000000000000000000000000000 P f45bb1e2a15e416884d32f0308ce61c0: Log is configured to *not* fsync() on all Append() calls
I20260807 04:22:00.254505 32309 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f45bb1e2a15e416884d32f0308ce61c0: No bootstrap required, opened a new log
I20260807 04:22:00.260625 32433 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 042ddca9edfc4a8b84753b675d49f944: Generated new TSK 0
I20260807 04:22:00.261751 32433 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 04:22:00.265901 32309 raft_consensus.cc:348] T 00000000000000000000000000000000 P f45bb1e2a15e416884d32f0308ce61c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "042ddca9edfc4a8b84753b675d49f944" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43497 } } peers { permanent_uuid: "f45bb1e2a15e416884d32f0308ce61c0" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 39163 } } peers { permanent_uuid: "255557e753f44d8f8b289e1a9733a8d8" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 } }
I20260807 04:22:00.266351 32309 raft_consensus.cc:729] T 00000000000000000000000000000000 P f45bb1e2a15e416884d32f0308ce61c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f45bb1e2a15e416884d32f0308ce61c0, State: Initialized, Role: FOLLOWER
I20260807 04:22:00.266855 32309 consensus_queue.cc:260] T 00000000000000000000000000000000 P f45bb1e2a15e416884d32f0308ce61c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "042ddca9edfc4a8b84753b675d49f944" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43497 } } peers { permanent_uuid: "f45bb1e2a15e416884d32f0308ce61c0" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 39163 } } peers { permanent_uuid: "255557e753f44d8f8b289e1a9733a8d8" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 } }
I20260807 04:22:00.268157 32444 sys_catalog.cc:455] T 00000000000000000000000000000000 P f45bb1e2a15e416884d32f0308ce61c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "042ddca9edfc4a8b84753b675d49f944" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43497 } } peers { permanent_uuid: "f45bb1e2a15e416884d32f0308ce61c0" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 39163 } } peers { permanent_uuid: "255557e753f44d8f8b289e1a9733a8d8" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 } } }
I20260807 04:22:00.269111 32444 sys_catalog.cc:458] T 00000000000000000000000000000000 P f45bb1e2a15e416884d32f0308ce61c0 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 04:22:00.269490 32309 sys_catalog.cc:564] T 00000000000000000000000000000000 P f45bb1e2a15e416884d32f0308ce61c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 04:22:00.269855 32280 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f45bb1e2a15e416884d32f0308ce61c0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 04:22:00.270803 32281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "042ddca9edfc4a8b84753b675d49f944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "f45bb1e2a15e416884d32f0308ce61c0"
I20260807 04:22:00.273723 32280 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f45bb1e2a15e416884d32f0308ce61c0 [term 1 FOLLOWER]: Refusing update from remote peer 042ddca9edfc4a8b84753b675d49f944: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 04:22:00.280886 32400 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 042ddca9edfc4a8b84753b675d49f944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f45bb1e2a15e416884d32f0308ce61c0" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 39163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 04:22:00.282514 32281 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f45bb1e2a15e416884d32f0308ce61c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 042ddca9edfc4a8b84753b675d49f944 in term 1.
I20260807 04:22:00.344344 32458 sys_catalog.cc:455] T 00000000000000000000000000000000 P f45bb1e2a15e416884d32f0308ce61c0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "042ddca9edfc4a8b84753b675d49f944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "042ddca9edfc4a8b84753b675d49f944" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43497 } } peers { permanent_uuid: "f45bb1e2a15e416884d32f0308ce61c0" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 39163 } } peers { permanent_uuid: "255557e753f44d8f8b289e1a9733a8d8" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 } } }
I20260807 04:22:00.344861 32458 sys_catalog.cc:458] T 00000000000000000000000000000000 P f45bb1e2a15e416884d32f0308ce61c0 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 04:22:00.344383 32444 sys_catalog.cc:455] T 00000000000000000000000000000000 P f45bb1e2a15e416884d32f0308ce61c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 042ddca9edfc4a8b84753b675d49f944. Latest consensus state: current_term: 1 leader_uuid: "042ddca9edfc4a8b84753b675d49f944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "042ddca9edfc4a8b84753b675d49f944" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43497 } } peers { permanent_uuid: "f45bb1e2a15e416884d32f0308ce61c0" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 39163 } } peers { permanent_uuid: "255557e753f44d8f8b289e1a9733a8d8" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 } } }
I20260807 04:22:00.345314 32444 sys_catalog.cc:458] T 00000000000000000000000000000000 P f45bb1e2a15e416884d32f0308ce61c0 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 04:22:00.360069 32465 catalog_manager.cc:1259] Loaded cluster ID: e002549b1d674aaeb5a0bdd0d92a2fdb
I20260807 04:22:00.360219 32465 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f45bb1e2a15e416884d32f0308ce61c0: loading cluster ID for follower catalog manager: success
I20260807 04:22:00.364115 32465 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f45bb1e2a15e416884d32f0308ce61c0: acquiring CA information for follower catalog manager: success
I20260807 04:22:00.366700 32465 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f45bb1e2a15e416884d32f0308ce61c0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260807 04:22:00.388756 32314 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:22:00.379259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49852 (local address 127.7.200.253:39163)
0807 04:22:00.379441 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.379447 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.386090 (+ 6643us) server_negotiation.cc:407] Connection header received
0807 04:22:00.386301 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.386307 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.386423 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.386535 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:22:00.388455 (+ 1920us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49852: BlockingRecv error: recv got EOF from 127.0.0.1:49852 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260807 04:22:00.394894 32396 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:22:00.379629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34422 (local address 127.7.200.254:43497)
0807 04:22:00.379930 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.379936 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.392598 (+ 12662us) server_negotiation.cc:407] Connection header received
0807 04:22:00.393096 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.393103 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.393209 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.393292 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:22:00.394580 (+ 1288us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34422: BlockingRecv error: recv got EOF from 127.0.0.1:34422 (error 108)
Metrics: {"server-negotiator.queue_time_us":154}
W20260807 04:22:00.396834 32397 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:22:00.379241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50532 (local address 127.7.200.252:36989)
0807 04:22:00.379443 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.379449 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.388615 (+ 9166us) server_negotiation.cc:407] Connection header received
0807 04:22:00.388797 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.388803 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.388919 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.389038 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:22:00.396552 (+ 7514us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50532: BlockingRecv error: recv got EOF from 127.0.0.1:50532 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 04:22:00.409914 32314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:00.401505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49854 (local address 127.7.200.253:39163)
0807 04:22:00.401691 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.401697 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.402386 (+ 689us) server_negotiation.cc:407] Connection header received
0807 04:22:00.402621 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.402627 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.402832 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.403005 (+ 173us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:22:00.403628 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.404859 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.406858 (+ 1999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.407579 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.407718 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:00.408276 (+ 558us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:22:00.409048 (+ 772us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:22:00.409212 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 04:22:00.409329 (+ 117us) server_negotiation.cc:299] Negotiation successful
0807 04:22:00.409424 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
W20260807 04:22:00.423139 32397 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:22:00.417017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50542 (local address 127.7.200.252:36989)
0807 04:22:00.417210 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.417216 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.421415 (+ 4199us) server_negotiation.cc:407] Connection header received
0807 04:22:00.421697 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.421704 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.421846 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.421959 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:22:00.422878 (+ 919us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50542: BlockingRecv error: recv got EOF from 127.0.0.1:50542 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 04:22:00.436017 32314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:00.428660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49856 (local address 127.7.200.253:39163)
0807 04:22:00.428912 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.428919 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.429474 (+ 555us) server_negotiation.cc:407] Connection header received
0807 04:22:00.429732 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.429742 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.429841 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.429941 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:22:00.430427 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.431638 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.433820 (+ 2182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.434528 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.434669 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:00.435181 (+ 512us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:22:00.435330 (+ 149us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:22:00.435426 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 04:22:00.435589 (+ 163us) server_negotiation.cc:299] Negotiation successful
0807 04:22:00.435688 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
W20260807 04:22:00.453490 32397 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:22:00.451724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50548 (local address 127.7.200.252:36989)
0807 04:22:00.451936 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.451943 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.451963 (+ 20us) server_negotiation.cc:407] Connection header received
0807 04:22:00.452049 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.452054 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.452146 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.452260 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:22:00.453249 (+ 989us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50548: BlockingRecv error: recv got EOF from 127.0.0.1:50548 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 04:22:00.485888 32314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:00.464368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49862 (local address 127.7.200.253:39163)
0807 04:22:00.464558 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.464565 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.477619 (+ 13054us) server_negotiation.cc:407] Connection header received
0807 04:22:00.477981 (+ 362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.478012 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.478121 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.478206 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:22:00.479071 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.480570 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.483013 (+ 2443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.483894 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.484025 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:00.484863 (+ 838us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:22:00.485045 (+ 182us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:22:00.485118 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 04:22:00.485404 (+ 286us) server_negotiation.cc:299] Negotiation successful
0807 04:22:00.485507 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260807 04:22:00.513123 32397 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:22:00.510736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50554 (local address 127.7.200.252:36989)
0807 04:22:00.510944 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.510951 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.511524 (+ 573us) server_negotiation.cc:407] Connection header received
0807 04:22:00.511728 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.511734 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.511832 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.511942 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:22:00.512877 (+ 935us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50554: BlockingRecv error: recv got EOF from 127.0.0.1:50554 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 04:22:00.527664 32314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:00.520644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49864 (local address 127.7.200.253:39163)
0807 04:22:00.520881 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.520887 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.521388 (+ 501us) server_negotiation.cc:407] Connection header received
0807 04:22:00.521626 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.521632 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.521729 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.521835 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:22:00.522301 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.523413 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.525428 (+ 2015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.526174 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.526324 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:00.526831 (+ 507us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:22:00.526983 (+ 152us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:22:00.527085 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 04:22:00.527258 (+ 173us) server_negotiation.cc:299] Negotiation successful
0807 04:22:00.527363 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116}
W20260807 04:22:00.537664 32397 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:22:00.535096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50566 (local address 127.7.200.252:36989)
0807 04:22:00.535370 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.535376 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.535949 (+ 573us) server_negotiation.cc:407] Connection header received
0807 04:22:00.536208 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.536214 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.536311 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.536412 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:22:00.537420 (+ 1008us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50566: BlockingRecv error: recv got EOF from 127.0.0.1:50566 (error 108)
Metrics: {"server-negotiator.queue_time_us":152}
I20260807 04:22:00.558329 32314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:00.550753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49880 (local address 127.7.200.253:39163)
0807 04:22:00.550967 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.550974 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.551559 (+ 585us) server_negotiation.cc:407] Connection header received
0807 04:22:00.551781 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.551788 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.551895 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.552009 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:22:00.552937 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.554124 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.556112 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.556884 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.557028 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:00.557489 (+ 461us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:22:00.557654 (+ 165us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:22:00.557742 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 04:22:00.557916 (+ 174us) server_negotiation.cc:299] Negotiation successful
0807 04:22:00.558002 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260807 04:22:00.567212 32397 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:22:00.564846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50578 (local address 127.7.200.252:36989)
0807 04:22:00.565027 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.565034 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.565570 (+ 536us) server_negotiation.cc:407] Connection header received
0807 04:22:00.565758 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.565766 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.565881 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.566006 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:22:00.566929 (+ 923us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50578: BlockingRecv error: recv got EOF from 127.0.0.1:50578 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 04:22:00.594568 32314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:00.587191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49890 (local address 127.7.200.253:39163)
0807 04:22:00.587396 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.587402 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.587966 (+ 564us) server_negotiation.cc:407] Connection header received
0807 04:22:00.588191 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.588199 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.588304 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.588426 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:22:00.588944 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.590247 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.592314 (+ 2067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.593019 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.593185 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:00.593708 (+ 523us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:22:00.593891 (+ 183us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:22:00.593999 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 04:22:00.594170 (+ 171us) server_negotiation.cc:299] Negotiation successful
0807 04:22:00.594276 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
W20260807 04:22:00.606937 32397 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:22:00.602550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50584 (local address 127.7.200.252:36989)
0807 04:22:00.602750 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.602757 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.605273 (+ 2516us) server_negotiation.cc:407] Connection header received
0807 04:22:00.605489 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.605497 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.605602 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.605728 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:22:00.606682 (+ 954us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50584: BlockingRecv error: recv got EOF from 127.0.0.1:50584 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 04:22:00.653067 32314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:00.645349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49900 (local address 127.7.200.253:39163)
0807 04:22:00.645605 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.645612 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.646196 (+ 584us) server_negotiation.cc:407] Connection header received
0807 04:22:00.646449 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.646456 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.646611 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.646737 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:22:00.647258 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.648426 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.650614 (+ 2188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.651382 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.651542 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:00.652097 (+ 555us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:22:00.652242 (+ 145us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:22:00.652360 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 04:22:00.652562 (+ 202us) server_negotiation.cc:299] Negotiation successful
0807 04:22:00.652658 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260807 04:22:00.665891 32397 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:22:00.663224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50596 (local address 127.7.200.252:36989)
0807 04:22:00.663460 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.663469 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.664123 (+ 654us) server_negotiation.cc:407] Connection header received
0807 04:22:00.664347 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.664354 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.664483 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.664605 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:22:00.665639 (+ 1034us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50596: BlockingRecv error: recv got EOF from 127.0.0.1:50596 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
I20260807 04:22:00.741127 32314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:00.734140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49902 (local address 127.7.200.253:39163)
0807 04:22:00.734392 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.734399 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.734846 (+ 447us) server_negotiation.cc:407] Connection header received
0807 04:22:00.735028 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.735036 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.735150 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.735278 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:22:00.736046 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.737234 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.739141 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.739655 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.739820 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:00.740280 (+ 460us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:22:00.740411 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:22:00.740517 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 04:22:00.740697 (+ 180us) server_negotiation.cc:299] Negotiation successful
0807 04:22:00.740836 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
W20260807 04:22:00.758860 32397 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:22:00.751692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50612 (local address 127.7.200.252:36989)
0807 04:22:00.757289 (+ 5597us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.757293 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.757312 (+ 19us) server_negotiation.cc:407] Connection header received
0807 04:22:00.757382 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.757386 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.757470 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.757643 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:22:00.758571 (+ 928us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50612: BlockingRecv error: recv got EOF from 127.0.0.1:50612 (error 108)
Metrics: {"server-negotiator.queue_time_us":5465}
I20260807 04:22:00.805088 32400 sys_catalog.cc:455] T 00000000000000000000000000000000 P 042ddca9edfc4a8b84753b675d49f944 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "042ddca9edfc4a8b84753b675d49f944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "042ddca9edfc4a8b84753b675d49f944" member_type: VOTER last_known_addr { host: "127.7.200.254" port: 43497 } } peers { permanent_uuid: "f45bb1e2a15e416884d32f0308ce61c0" member_type: VOTER last_known_addr { host: "127.7.200.253" port: 39163 } } peers { permanent_uuid: "255557e753f44d8f8b289e1a9733a8d8" member_type: VOTER last_known_addr { host: "127.7.200.252" port: 36989 } } }
I20260807 04:22:00.805501 32400 sys_catalog.cc:458] T 00000000000000000000000000000000 P 042ddca9edfc4a8b84753b675d49f944 [sys.catalog]: This master's current role is: LEADER
I20260807 04:22:00.896461 32314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:00.890956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49904 (local address 127.7.200.253:39163)
0807 04:22:00.891216 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.891224 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.891622 (+ 398us) server_negotiation.cc:407] Connection header received
0807 04:22:00.891870 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.891875 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.891963 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.892070 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:22:00.892526 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.893238 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.894657 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:00.895143 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:00.895290 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:00.895700 (+ 410us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:22:00.895811 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:22:00.895908 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 04:22:00.896074 (+ 166us) server_negotiation.cc:299] Negotiation successful
0807 04:22:00.896163 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
W20260807 04:22:00.904768 32397 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:22:00.902492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50622 (local address 127.7.200.252:36989)
0807 04:22:00.902732 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:00.902740 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:00.903048 (+ 308us) server_negotiation.cc:407] Connection header received
0807 04:22:00.903267 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:00.903274 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:00.903361 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:00.903476 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:22:00.904535 (+ 1059us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50622: BlockingRecv error: recv got EOF from 127.0.0.1:50622 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
I20260807 04:22:01.172338 32314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:01.166651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49912 (local address 127.7.200.253:39163)
0807 04:22:01.166940 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:01.166947 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:01.167342 (+ 395us) server_negotiation.cc:407] Connection header received
0807 04:22:01.167614 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:01.167625 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:01.167703 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:01.167812 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:22:01.168349 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:01.169197 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:01.170752 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:01.171183 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:01.171282 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:01.171707 (+ 425us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:22:01.171808 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:22:01.171875 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 04:22:01.172070 (+ 195us) server_negotiation.cc:299] Negotiation successful
0807 04:22:01.172137 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
W20260807 04:22:01.180981 32397 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 04:22:01.178965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50624 (local address 127.7.200.252:36989)
0807 04:22:01.179218 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:01.179227 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:01.179522 (+ 295us) server_negotiation.cc:407] Connection header received
0807 04:22:01.179686 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:01.179691 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:01.179777 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:01.179864 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 04:22:01.180729 (+ 865us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50624: BlockingRecv error: recv got EOF from 127.0.0.1:50624 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
I20260807 04:22:01.190658 32435 catalog_manager.cc:1259] Loaded cluster ID: e002549b1d674aaeb5a0bdd0d92a2fdb
I20260807 04:22:01.190822 32435 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 255557e753f44d8f8b289e1a9733a8d8: loading cluster ID for follower catalog manager: success
I20260807 04:22:01.194721 32435 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 255557e753f44d8f8b289e1a9733a8d8: acquiring CA information for follower catalog manager: success
I20260807 04:22:01.197280 32435 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 255557e753f44d8f8b289e1a9733a8d8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 04:22:01.708047 32589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:01.702434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49926 (local address 127.7.200.253:39163)
0807 04:22:01.703014 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:01.703020 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:01.703206 (+ 186us) server_negotiation.cc:407] Connection header received
0807 04:22:01.703471 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:01.703476 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:01.703548 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:01.703662 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:22:01.704118 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:01.704901 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:01.706276 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:01.706706 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:01.706849 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:01.707282 (+ 433us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:22:01.707399 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:22:01.707500 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 04:22:01.707656 (+ 156us) server_negotiation.cc:299] Negotiation successful
0807 04:22:01.707744 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":314,"threads_started":1}
I20260807 04:22:01.720454 32595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:01.714091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50636 (local address 127.7.200.252:36989)
0807 04:22:01.714639 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:01.714644 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:01.714778 (+ 134us) server_negotiation.cc:407] Connection header received
0807 04:22:01.714892 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:01.714897 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:01.715089 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:01.715212 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:22:01.715627 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:01.716479 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:01.718088 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:01.718535 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:01.718639 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:01.719190 (+ 551us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:22:01.719772 (+ 582us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:22:01.719897 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 04:22:01.720055 (+ 158us) server_negotiation.cc:299] Negotiation successful
0807 04:22:01.720135 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":295,"threads_started":1}
I20260807 04:22:01.734673 32589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:01.726815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49934 (local address 127.7.200.253:39163)
0807 04:22:01.726996 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:01.727018 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:01.728441 (+ 1423us) server_negotiation.cc:407] Connection header received
0807 04:22:01.728589 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:01.728598 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:01.728694 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:01.728811 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:22:01.729680 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:01.730720 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:01.732515 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:01.733109 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:01.733231 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:01.733766 (+ 535us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:22:01.733897 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:22:01.733981 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 04:22:01.734204 (+ 223us) server_negotiation.cc:299] Negotiation successful
0807 04:22:01.734295 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 04:22:01.735236 32600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:01.726511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34424 (local address 127.7.200.254:43497)
0807 04:22:01.727372 (+ 861us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:01.727378 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:01.727848 (+ 470us) server_negotiation.cc:407] Connection header received
0807 04:22:01.728242 (+ 394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:01.728247 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:01.728448 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:01.728637 (+ 189us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:22:01.729493 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:01.730352 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:01.732792 (+ 2440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:01.733400 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:01.733550 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:01.734149 (+ 599us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:22:01.734574 (+ 425us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:22:01.734660 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 04:22:01.734853 (+ 193us) server_negotiation.cc:299] Negotiation successful
0807 04:22:01.734941 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":690,"thread_start_us":571,"threads_started":1}
I20260807 04:22:01.736518 32595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 04:22:01.726529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50650 (local address 127.7.200.252:36989)
0807 04:22:01.726712 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 04:22:01.726717 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 04:22:01.728051 (+ 1334us) server_negotiation.cc:407] Connection header received
0807 04:22:01.728351 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 04:22:01.728360 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 04:22:01.728450 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 04:22:01.728525 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 04:22:01.729589 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:01.730687 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:01.733100 (+ 2413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 04:22:01.733817 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 04:22:01.733970 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 04:22:01.735311 (+ 1341us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 04:22:01.735768 (+ 457us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 04:22:01.735874 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 04:22:01.736109 (+ 235us) server_negotiation.cc:299] Negotiation successful
0807 04:22:01.736236 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 04:22:01.741616 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 32155
I20260807 04:22:01.742730 32224 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:22:01.868341 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 32155
W20260807 04:22:01.892925 32256 connection.cc:535] server connection from 127.0.0.1:49814 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 04:22:01.893591 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 32236
I20260807 04:22:01.894819 32303 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:22:02.006189 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 32236
I20260807 04:22:02.029695 7971 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu pid 32317
I20260807 04:22:02.030845 32384 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 04:22:02.146085 7971 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskMk3R5R/build/asan/bin/kudu with pid 32317
2026-08-07T04:22:02Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (5369 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (10348 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (384852 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST